Devtoolwatch BoardBest LLM SDKs and gateways, ranked by real usage
22 LLM SDKs and gateways ranked by new GitHub stars and npm and PyPI download growth, the week of Oct 25–31, 2026. Updated every Monday.
| Rank | Tool | Stars | Downloads/wk | vs 4-wk avg |
|---|---|---|---|---|
| #1 | thinking-orbsthinking-orbs is a React library of dotted, animated thought-orb loading indicators for AI and agent user interfaces. | 3.9k | 1.4M | +44% |
| #2 | HeadroomHeadroom compresses tool outputs, logs, files, and RAG chunks locally before they reach the LLM, as a library, proxy, or MCP server. | 78.5k | 125.8k | +22% |
| #3 | LiteLLMLiteLLM is an open source AI gateway and Python SDK that calls 100+ LLM providers through one OpenAI-format interface. | 62.5k | 23.1M | +4% |
| #4 | Honcho Memory library for building stateful agents | 7.9k | – | – |
| #5 | Anthropic SDKAnthropic SDK is the official Python library for calling the Claude API from Python applications. | 4k | 111M | +14% |
| #6 | Hugging Face HubHugging Face Hub is the official CLI and Python client for downloading, uploading and managing models, datasets and Spaces on the… | 4k | 68.3M | +11% |
| #7 | OpenAI SDKOpenAI SDK is the official Python library for the OpenAI API, with typed sync and async clients generated from OpenAI's OpenAPI… | 32k | 141.3M | +9% |
| #8 | EverOSOne portable memory layer for every AI agent: local-first, Markdown-native, user-owned, and self-evolving across apps, tools, and workflows. | 13.7k | 3.9k | −4% |
| #9 | Portkey GatewayPortkey Gateway is an open-source AI gateway that routes requests to many LLM providers through one OpenAI-compatible API, with guardrails. | 13.3k | 1M | +19% |
| #10 | BAMLBAML is an open-source, TypeScript-like programming language for agents, with runtime types, typed errors, and native LLM functions,… | 9.5k | 533.7k | +21% |
| #11 | fal clientfal client is a Python package for calling fal model APIs or your own deployed fal endpoints, with a JavaScript and TypeScript counterpart. | 979 | 3.1M | +12% |
| #12 | OpenRouter AI SDK providerOpenRouter AI SDK provider is a TypeScript package that connects the Vercel AI SDK to models on the OpenRouter chat and completion APIs. | 693 | 4.3M | +14% |
| #13 | aisuiteaisuite is a lightweight Python library offering a unified Chat Completions API across LLM providers plus an Agents API with tools and… | 16.4k | 21k | +105% |
| #14 | Google Gen AI SDKGoogle Gen AI SDK is a Python library for integrating Google's generative models into applications through the Gemini Developer API or… | 4k | 67.8M | +4% |
| #15 | @shadcn/lintAn agent-first linter for Tailwind design systems. Write design system rules that agents can verify. | 3.3k | – | – |
| #16 | MemoriMemori is agent-native memory infrastructure. A LLM-agnostic layer that turns agent execution and conversation into structured,… | 17.3k | 3.8k | +1% |
| #17 | Transformers.jsTransformers.js is a JavaScript library from Hugging Face that runs pretrained Transformers models directly in the browser, with no… | 16.4k | 4.9M | +5% |
| #18 | OutlinesStructured Outputs | 16k | 371k | +12% |
| #19 | InstructorInstructor is a Python library for getting validated, structured outputs from LLMs using Pydantic models, with retries and streaming. | 14.1k | 2.2M | +3% |
| #20 | Cohere SDKCohere SDK is a Python library for accessing Cohere models through the Cohere API and cloud platforms like AWS, Azure, GCP and OCI. | 407 | 3.3M | +4% |
| #21 | Replicate SDKReplicate SDK is the Python client for Replicate, letting you run, stream, and manage cloud-hosted machine learning models from Python… | 918 | 1.2M | +5% |
| #22 | Together SDKTogether SDK is the official Python client for Together's API, with synchronous and asynchronous clients plus a command-line interface. | 81 | 541.1k | +3% |
FAQ
What is the fastest-growing of the LLM SDKs and gateways right now?
thinking-orbs ranked #1 among LLM SDKs and gateways on the Devtoolwatch Board in the week of Oct 25–31, 2026, with a momentum score of 69 out of 100.
Which of the LLM SDKs and gateways has the most GitHub stars?
Of the LLM SDKs and gateways ranked in the week of Oct 25–31, 2026, Headroom has the most GitHub stars: 78.5k.
Which of the LLM SDKs and gateways is downloaded the most?
OpenAI SDK's main package had the most downloads of the ranked LLM SDKs and gateways: 141.3M in the week of Oct 25–31, 2026.
How does Devtoolwatch rank LLM SDKs and gateways?
Every Monday the Board averages four percentile ranks: new GitHub stars from daily snapshots, new stars for the repo's size, added npm and PyPI downloads, and download growth beyond the market. Star spikes without forks, downloads or Hacker News to back them are held back.
Rankings come from Devtoolwatch's daily GitHub snapshots and the npm and PyPI download APIs. How the ranking works.