Oumi review
Oumi is an open-source Python platform for fine-tuning, evaluating, and deploying open text and multimodal models, including agentic tool-using LLMs.
TL;DR
Oumi is an Apache-2.0 platform covering the model lifecycle: data preparation, training, evaluation, inference, and deployment. It is for ML engineers and researchers who fine-tune open models such as Llama, Gemma, and Qwen. It sets itself apart with ready-made YAML recipes, one CLI that runs from laptops to clouds, and tool-use training with GRPO over executable environments.
- 9.4kGitHub stars
- +12new stars, week of Oct 25
- 9.6kdownloads a week, +28% vs 4-week avg
- #30in Agent frameworks this week
Oumi at a glance
- Category
- Agent frameworks
- Maintained by
- Oumi (organization, @oumi-ai on GitHub)
- License
- Apache 2.0
- Language
- Python, Jupyter Notebook, Shell
- Repository
- github.com/oumi-ai/oumi
- Website
- oumi.ai
- PyPI package
- oumi 0.9
- Latest release
- v0.9 on GitHub, Sep 16, 2026
- First published
- May 7, 2024
What Oumi does
- Oumi trains and fine-tunes models from 10M to 400B+ parameters using SFT, LoRA, QLoRA, DPO, GRPO, and other techniques.
- Oumi trains agentic models with tool-calling SFT and runs GRPO with verl over database, HTTP, lookup, and simulated tool environments.
- Oumi synthesizes and curates training data, including multi-turn tool-use conversations, using LLM judges and the `oumi synth` module.
- Oumi evaluates models on standard benchmarks and with multi-criteria rubric judges such as `RubricJudge`.
- Oumi serves models with vLLM or SGLang and deploys them to dedicated endpoints on Fireworks and Parasail via `oumi deploy`.
- Oumi launches remote jobs on AWS, Azure, GCP, Lambda, Modal, Slurm, and other platforms with `oumi launch`.
- Oumi provides an `oumi-mcp` MCP server so Claude or Cursor can drive Oumi workflows.
How it works
Oumi runs as a Python package and CLI. You point commands such as `oumi train`, `oumi evaluate`, and `oumi infer` at YAML config recipes. Jobs run locally, in Docker, or on cloud clusters through `oumi launch`. Oumi connects to open models and commercial APIs such as OpenAI, Anthropic, Vertex AI, Together, Fireworks, and Parasail. It supports FSDP, DeepSpeed, and DDP for distributed training.
How to install and start using Oumi
With uv pip
uv pip install oumiWith GPU support
uv pip install 'oumi[gpu]'With Docker
docker pull ghcr.io/oumi-ai/oumi:latestRequirements
- Python 3.10 or later and below 3.15.
- A GPU for the `oumi[gpu]` install and the Docker commands, which use `--gpus all`.
- API keys for hosted engines, such as the FIREWORKS_API_KEY environment variable for Fireworks.
- A cloud account (AWS, Azure, GCP, Lambda, and others) for remote jobs via `oumi launch`.
First steps
- Train a small model with the quickstart recipe: oumi train -c configs/recipes/smollm/sft/135m/quickstart_train.yaml
- Evaluate it with: oumi evaluate -c configs/recipes/smollm/evaluation/135m/quickstart_eval.yaml
- Chat with a model interactively: oumi infer -c configs/recipes/smollm/inference/135m_infer.yaml --interactive
- Open the Getting Started tour notebook in Colab to explore training, evaluation, inference, and job management.
Who Oumi is for
- ML engineers fine-tuning open models like Llama, Gemma, Qwen, or DeepSeek from config recipes.
- Teams training agentic, tool-using models with tool-calling SFT and reinforcement learning.
- Researchers who need reproducible experiments that scale from a laptop to cloud clusters.
- Developers distilling large models into smaller, specialized ones for deployment.
Limitations to know
- Oumi focuses on training and serving models, not on building agent applications at runtime.
Is Oumi growing? Usage data
In the week of Oct 25–31, 2026, Oumi ranked #304 on the Devtoolwatch Board and #30 in Agent frameworks, with a momentum score of 31 out of 100. Its main package had 9.6k downloads that week, +28% against its own 4-week average.
Show the weekly numbers
| Week of | New stars |
|---|---|
| Aug 9, 2026 | 11 |
| Aug 16, 2026 | 3 |
| Aug 23, 2026 | 9 |
| Aug 30, 2026 | 4 |
| Sep 6, 2026 | 4 |
| Sep 13, 2026 | 5 |
| Sep 20, 2026 | 4 |
| Sep 27, 2026 | 2 |
| Oct 4, 2026 | 9 |
| Oct 11, 2026 | 12 |
| Oct 18, 2026 | 14 |
| Oct 25, 2026 | 12 |
On Hacker News
- Oumi-AI/oumi: Everything you need to build foundation models, end-to-end, 14 points and 0 comments (Jan 30, 2025)
- Everything you need to build foundation models, end-to-end, 8 points and 2 comments (Feb 2, 2025)
- Small Fine-Tuned Models Are All You Need, 6 points and 2 comments (Oct 19, 2025)
The Board ranks tools by four signals each week: new stars, new stars for the repo's size, added downloads and download growth beyond the market. How the ranking works.
Oumi alternatives
Other AI agent frameworks on the Board in the week of Oct 25–31, 2026, by momentum:
| Rank | Tool | Stars | Downloads/wk |
|---|---|---|---|
| #1 | Harness²Harness² is a Python framework from Google Research for recursive agent harnessing, refining an agent's prompts, tools, memory and… | 21.7k | – |
| #2 | HyperFramesHyperFrames is an open-source framework that turns HTML, CSS, media, and seekable animations into deterministic MP4 videos, built for AI… | 76.6k | 1.5M |
| #3 | AgentScopeAgentScope is a Python agent framework with an SDK for building ReAct agents and an agent service backend with a web UI. | 35k | 51.4k |
| #4 | AG-UIAG-UI is an open, event-based protocol that standardizes how AI agents connect to user-facing frontend applications. | 16.9k | 4.6M |
| #5 | LangGraphLangGraph is a low-level orchestration framework and runtime for building, managing, and deploying long-running, stateful agents in… | 44.2k | 18.5M |
| #6 | BifrostOpen-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for… | 9.3k | – |
Recent Oumi releases
Oumi FAQ
Is Oumi free and open source?
Yes. Oumi's source code is on GitHub (oumi-ai/oumi) under the Apache 2.0 license, so you can use it for free. Its website also links to a pricing page (https://oumi.ai/pricing) for any paid plans.
How do I install Oumi?
Run uv pip install oumi. The oumi package needs Python 3.10 or newer, below 3.15. The install section above has the other options from the project's README.
Is Oumi still maintained?
Yes. The oumi-ai/oumi repository was last updated on Oct 21, 2026, and the latest release, v0.9 on GitHub, came out on Sep 16, 2026.
How popular is Oumi?
Oumi has 9.4k GitHub stars as of Nov 1, 2026. It gained 12 new stars in the week of Oct 25–31, 2026, against a 12-week average of 7 a week. Its main package had 9.6k downloads that week, +28% against its own 4-week average. That made it #30 among AI agent frameworks on the Devtoolwatch Board.
What are the best alternatives to Oumi?
Other AI agent frameworks on the Devtoolwatch Board in the week of Oct 25–31, 2026, by momentum: Harness² (#1), HyperFrames (#2), AgentScope (#3), AG-UI (#4), LangGraph (#5). The alternatives table above has their numbers.
How does Oumi work?
Oumi works through a CLI and Python API driven by YAML configs. You run oumi train, oumi evaluate, oumi infer, or oumi launch with a recipe. It handles data synthesis, training, evaluation, inference, and deployment for open text and vision-language models.
What is the difference between Oumi and HallOumi?
Oumi is the open-source platform for building and training models. HallOumi is a claim-verification model that the Oumi team introduced in April 2025.
Can Oumi train tool-using agent models?
Yes. Since v0.9, Oumi supports tool-calling SFT and DPO, executable tool environments (database, HTTP, lookup, simulated), multi-turn tool conversation synthesis, and GRPO over those environments with verl.
Can I use Oumi from Claude or Cursor?
Yes. Oumi v0.8 added the oumi-mcp MCP server, which lets MCP-capable assistants such as Claude and Cursor drive Oumi.
Which cloud platforms can Oumi run jobs on?
Oumi runs remote jobs on AWS, Azure, GCP, Lambda, Modal, Slurm, and others through oumi launch. Version 0.4.2 also added the NERSC Perlmutter HPC cluster.
Sources
- oumi-ai/oumi on GitHub
- Oumi README
- oumi on PyPI
- Oumi website
- Release v0.9 (Sep 16, 2026)
- Release v0.8 (May 7, 2026)
- Release v0.7 (Jan 29, 2026)
- Hacker News: Oumi-AI/oumi: Everything you need to build foundation models, end-to-end
- Hacker News: Everything you need to build foundation models, end-to-end
- Hacker News: Small Fine-Tuned Models Are All You Need
- Devtoolwatch Board, the week of Oct 25–31, 2026
Oumi README badge
Maintainers can show the tool's weekly Board rank in their README:
[](https://index.devtoolwatch.com/tools/oumi-ai-oumi/)How this page is made: Devtoolwatch writes each review from the project's README, releases, package metadata and website, with an AI model, then checks every claim against the source it cites and drops what the sources don't support. The numbers come from Devtoolwatch's daily GitHub snapshots, GitHub's stargazer history, and the npm and PyPI download APIs. Spotted an error? Email [email protected].