Together SDK review
Together SDK is the official Python client for Together's API, with synchronous and asynchronous clients plus a command-line interface.
TL;DR
Together SDK is the official Python library for Together's REST API. It covers chat, completions, images, embeddings, reranking, fine-tuning and batch jobs. It is for Python 3.10+ developers building on Together-hosted models. The together-python repo holds the deprecated V1 codebase, and new development happens in the 2.0 SDK.
- 81GitHub stars
- +0new stars, week of Oct 25
- ~541.1kdownloads a week, +3% vs 4-week avg
- #22in Model SDKs and gateways this week
Together SDK at a glance
- Category
- Model SDKs and gateways
- Maintained by
- Together (organization, @togethercomputer on GitHub)
- License
- Apache 2.0
- Language
- Python, Makefile, Dockerfile
- Repository
- github.com/togethercomputer/together-python
- Website
- pypi.org/project/together
- npm package
- together-ai 0.58.0
- PyPI package
- together 2.42.0
- Latest release
- v1.5.36 on GitHub, Oct 21, 2026
- First published
- Apr 5, 2023
What Together SDK does
- Together SDK sends chat completions with plain text, image, or video content, and supports streaming responses.
- Together SDK generates images, creates embeddings, and reranks documents through Together-hosted models.
- Together SDK uploads training files and creates, lists, cancels, and downloads fine-tuning jobs.
- Together SDK submits batch inference jobs, which have a 24-hour turnaround time.
- Together SDK can return token-level logprobs, which you can use to estimate the model's confidence in its outputs.
- Together SDK includes a `together` CLI for chat, completions, image generation, files, fine-tuning, and listing models.
- Together SDK 2.0 includes type definitions for all request params and response fields, and an RL training SDK.
How it works
Together SDK is a Python package that calls Together's REST API. You create a Together or AsyncTogether client, and it reads the TOGETHER_API_KEY environment variable by default. The 2.0 library uses httpx for HTTP requests. Its async client can optionally use aiohttp instead. The same package installs a CLI that streams output to stdout by default.
How to install and start using Together SDK
With pip
pip install togetherWith uv
uv add togetherWith the Tinker extra
pip install 'together[tinker]'Requirements
- Python 3.10 or later.
- A Together.ai account and a Together API key.
- Python 3.11 or later for the Tinker-compatible post-training entry point.
First steps
- Create a Together.ai account and copy an API key from the settings page.
- Set your key as an environment variable: export TOGETHER_API_KEY=xxxxx
- Create a client with `client = Together()` and call `client.chat.completions.create` with a model and messages.
- List the available models with `together models list`.
Who Together SDK is for
- Python developers calling Together-hosted open models for chat, completions, or vision.
- Teams fine-tuning models on Together from Python code or the command line.
- Developers building retrieval pipelines that need embeddings and reranking from one client.
- Workloads with large inference jobs that can tolerate a 24-hour batch turnaround.
Limitations to know
- Together SDK V1 in the together-python repo is deprecated and in maintenance mode. New features go to the 2.0 SDK in together-py.
- Together SDK only works with Together's API platform and requires a Together account.
- Together SDK batch inference jobs have a 24-hour turnaround time.
- Together SDK deprecated prompt cache support in both the SDK and the CLI in v1.5.35.
Is Together SDK growing? Usage data
In the week of Oct 25–31, 2026, Together SDK ranked #347 on the Devtoolwatch Board and #22 in Model SDKs and gateways, with a momentum score of 22 out of 100. Its main package had about 541.1k downloads that week, +3% against its own 4-week average.
Show the weekly numbers
| Week of | New stars |
|---|---|
| Aug 9, 2026 | 0 |
| Aug 16, 2026 | 0 |
| Aug 23, 2026 | 0 |
| Aug 30, 2026 | 0 |
| Sep 6, 2026 | 0 |
| Sep 13, 2026 | 1 |
| Sep 20, 2026 | 0 |
| Sep 27, 2026 | 0 |
| Oct 4, 2026 | 0 |
| Oct 11, 2026 | 0 |
| Oct 18, 2026 | 0 |
| Oct 25, 2026 | 0 |
On Hacker News
- PyPI Was Subpoenaed, 1153 points and 597 comments (May 24, 2023)
- Black, the uncompromising Python code formatter, is stable, 500 points and 288 comments (Jan 29, 2022)
- Pypi.org is running a survey on the state of Python packaging, 234 points and 188 comments (Sep 7, 2022)
- Tariff: A Python package that imposes tariffs on Python imports, 221 points and 29 comments (Apr 14, 2025)
- PyPI now supports digital attestations, 218 points and 186 comments (Nov 14, 2024)
The Board ranks tools by four signals each week: new stars, new stars for the repo's size, added downloads and download growth beyond the market. How the ranking works.
Together SDK alternatives
Other LLM SDKs and gateways on the Board in the week of Oct 25–31, 2026, by momentum:
| Rank | Tool | Stars | Downloads/wk |
|---|---|---|---|
| #1 | thinking-orbsthinking-orbs is a React library of dotted, animated thought-orb loading indicators for AI and agent user interfaces. | 3.9k | 1.4M |
| #2 | HeadroomHeadroom compresses tool outputs, logs, files, and RAG chunks locally before they reach the LLM, as a library, proxy, or MCP server. | 78.5k | 125.8k |
| #3 | LiteLLMLiteLLM is an open source AI gateway and Python SDK that calls 100+ LLM providers through one OpenAI-format interface. | 62.5k | 23.1M |
| #4 | Honcho Memory library for building stateful agents | 7.9k | – |
| #5 | Anthropic SDKAnthropic SDK is the official Python library for calling the Claude API from Python applications. | 4k | 111M |
| #6 | Hugging Face HubHugging Face Hub is the official CLI and Python client for downloading, uploading and managing models, datasets and Spaces on the… | 4k | 68.3M |
Recent Together SDK releases
Together SDK FAQ
Is Together SDK free and open source?
Yes. Together SDK's source code is on GitHub (togethercomputer/together-python) under the Apache 2.0 license, so you can use it for free.
How do I install Together SDK?
Run pip install together. The install section above has the other options from the project's README.
Is Together SDK still maintained?
Yes. The togethercomputer/together-python repository was last updated on Oct 21, 2026, and the latest release, v1.5.36 on GitHub, came out on Oct 21, 2026.
How popular is Together SDK?
Together SDK has 81 GitHub stars as of Nov 1, 2026. It gained 0 new stars in the week of Oct 25–31, 2026, against a 12-week average of 0 a week. Its main package had about 541.1k downloads that week, +3% against its own 4-week average. That made it #22 among LLM SDKs and gateways on the Devtoolwatch Board.
What are the best alternatives to Together SDK?
Other LLM SDKs and gateways on the Devtoolwatch Board in the week of Oct 25–31, 2026, by momentum: thinking-orbs (#1), Headroom (#2), LiteLLM (#3), Honcho (#4), Anthropic SDK (#5). The alternatives table above has their numbers.
Is the together-python repo still the current Together SDK?
No. The together-python repo holds Together Python V1, which is deprecated and in maintenance mode. All new development happens in the 2.0 SDK at together-py. A migration guide is available at docs.together.ai.
How do I set my Together API key?
Together SDK reads the TOGETHER_API_KEY environment variable by default. You can also pass api_key to the client directly. The 2.0 docs recommend storing the key in a .env file with python-dotenv so it stays out of source control.
Does Together SDK support async code?
Yes. Together SDK provides an AsyncTogether client that you use with await. Its functionality is otherwise identical to the synchronous client. In the 2.0 SDK, the async client can optionally use aiohttp as its HTTP backend.
Can Together SDK send images or video to a model?
Yes. Together SDK chat completions accept multi-modal content arrays. Use image_url items for images and video_url items for video, alongside text items.
Does Together SDK have a command-line tool?
Yes. Together SDK installs a together CLI. It covers chat completions, completions, image generation, files, fine-tuning, and models. Chat and completions output streams to stdout by default, and --no-stream turns streaming off.
Sources
- togethercomputer/together-python on GitHub
- Together SDK README
- together-ai on npm
- together on PyPI
- Together SDK website
- Release v1.5.36 (Oct 21, 2026)
- Release v1.5.35 (Jan 21, 2026)
- Release v1.5.34 (Dec 23, 2025)
- Hacker News: PyPI Was Subpoenaed
- Hacker News: Black, the uncompromising Python code formatter, is stable
- Hacker News: Pypi.org is running a survey on the state of Python packaging
- Devtoolwatch Board, the week of Oct 25–31, 2026
Together SDK README badge
Maintainers can show the tool's weekly Board rank in their README:
[](https://index.devtoolwatch.com/tools/together-sdk/)How this page is made: Devtoolwatch writes each review from the project's README, releases, package metadata and website, with an AI model, then checks every claim against the source it cites and drops what the sources don't support. The numbers come from Devtoolwatch's daily GitHub snapshots, GitHub's stargazer history, and the npm and PyPI download APIs. Spotted an error? Email [email protected].