Devtoolwatch BoardGet it every Monday

Oumi review

Oumi is an open-source Python platform for fine-tuning, evaluating, and deploying open text and multimodal models, including agentic tool-using LLMs.

Updated Nov 1, 2026. Review written Oct 22, 2026 from the project's own sources; usage data refreshed every Monday.

TL;DR

Oumi is an Apache-2.0 platform covering the model lifecycle: data preparation, training, evaluation, inference, and deployment. It is for ML engineers and researchers who fine-tune open models such as Llama, Gemma, and Qwen. It sets itself apart with ready-made YAML recipes, one CLI that runs from laptops to clouds, and tool-use training with GRPO over executable environments.

Oumi at a glance

Category
Agent frameworks
Maintained by
Oumi (organization, @oumi-ai on GitHub)
License
Apache 2.0
Language
Python, Jupyter Notebook, Shell
Repository
github.com/oumi-ai/oumi
Website
oumi.ai
PyPI package
oumi 0.9
Latest release
v0.9 on GitHub, Sep 16, 2026
First published
May 7, 2024

What Oumi does

  • Oumi trains and fine-tunes models from 10M to 400B+ parameters using SFT, LoRA, QLoRA, DPO, GRPO, and other techniques.
  • Oumi trains agentic models with tool-calling SFT and runs GRPO with verl over database, HTTP, lookup, and simulated tool environments.
  • Oumi synthesizes and curates training data, including multi-turn tool-use conversations, using LLM judges and the `oumi synth` module.
  • Oumi evaluates models on standard benchmarks and with multi-criteria rubric judges such as `RubricJudge`.
  • Oumi serves models with vLLM or SGLang and deploys them to dedicated endpoints on Fireworks and Parasail via `oumi deploy`.
  • Oumi launches remote jobs on AWS, Azure, GCP, Lambda, Modal, Slurm, and other platforms with `oumi launch`.
  • Oumi provides an `oumi-mcp` MCP server so Claude or Cursor can drive Oumi workflows.

How it works

Oumi runs as a Python package and CLI. You point commands such as `oumi train`, `oumi evaluate`, and `oumi infer` at YAML config recipes. Jobs run locally, in Docker, or on cloud clusters through `oumi launch`. Oumi connects to open models and commercial APIs such as OpenAI, Anthropic, Vertex AI, Together, Fireworks, and Parasail. It supports FSDP, DeepSpeed, and DDP for distributed training.

How to install and start using Oumi

With uv pip

uv pip install oumi

With GPU support

uv pip install 'oumi[gpu]'

With Docker

docker pull ghcr.io/oumi-ai/oumi:latest

Requirements

  • Python 3.10 or later and below 3.15.
  • A GPU for the `oumi[gpu]` install and the Docker commands, which use `--gpus all`.
  • API keys for hosted engines, such as the FIREWORKS_API_KEY environment variable for Fireworks.
  • A cloud account (AWS, Azure, GCP, Lambda, and others) for remote jobs via `oumi launch`.

First steps

  1. Train a small model with the quickstart recipe: oumi train -c configs/recipes/smollm/sft/135m/quickstart_train.yaml
  2. Evaluate it with: oumi evaluate -c configs/recipes/smollm/evaluation/135m/quickstart_eval.yaml
  3. Chat with a model interactively: oumi infer -c configs/recipes/smollm/inference/135m_infer.yaml --interactive
  4. Open the Getting Started tour notebook in Colab to explore training, evaluation, inference, and job management.

Who Oumi is for

  • ML engineers fine-tuning open models like Llama, Gemma, Qwen, or DeepSeek from config recipes.
  • Teams training agentic, tool-using models with tool-calling SFT and reinforcement learning.
  • Researchers who need reproducible experiments that scale from a laptop to cloud clusters.
  • Developers distilling large models into smaller, specialized ones for deployment.

Limitations to know

  • Oumi focuses on training and serving models, not on building agent applications at runtime.

Is Oumi growing? Usage data

In the week of Oct 25–31, 2026, Oumi ranked #304 on the Devtoolwatch Board and #30 in Agent frameworks, with a momentum score of 31 out of 100. Its main package had 9.6k downloads that week, +28% against its own 4-week average.

New GitHub stars per week for Oumi12 weeks from Aug 9, 2026: 11, 3, 9, 4, 4, 5, 4, 2, 9, 12, 14, 12 new stars, an average of 7 a week.Aug 9week of Oct 25
New GitHub stars per week for the last 12 weeks, from GitHub's stargazer history (today's stargazers by the week they starred).
Show the weekly numbers
New GitHub stars per week for Oumi
Week ofNew stars
Aug 9, 202611
Aug 16, 20263
Aug 23, 20269
Aug 30, 20264
Sep 6, 20264
Sep 13, 20265
Sep 20, 20264
Sep 27, 20262
Oct 4, 20269
Oct 11, 202612
Oct 18, 202614
Oct 25, 202612

On Hacker News

The Board ranks tools by four signals each week: new stars, new stars for the repo's size, added downloads and download growth beyond the market. How the ranking works.

Oumi alternatives

Other AI agent frameworks on the Board in the week of Oct 25–31, 2026, by momentum:

Agent frameworks ranked by momentum, the week of Oct 25–31, 2026
RankToolStarsDownloads/wk
#1Harness²Harness² is a Python framework from Google Research for recursive agent harnessing, refining an agent's prompts, tools, memory and…21.7k–
#2HyperFramesHyperFrames is an open-source framework that turns HTML, CSS, media, and seekable animations into deterministic MP4 videos, built for AI…76.6k1.5M
#3AgentScopeAgentScope is a Python agent framework with an SDK for building ReAct agents and an agent service backend with a web UI.35k51.4k
#4AG-UIAG-UI is an open, event-based protocol that standardizes how AI agents connect to user-facing frontend applications.16.9k4.6M
#5LangGraphLangGraph is a low-level orchestration framework and runtime for building, managing, and deploying long-running, stateful agents in…44.2k18.5M
#6BifrostOpen-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for…9.3k–

All AI agent frameworks, ranked

Recent Oumi releases

Oumi FAQ

Is Oumi free and open source?

Yes. Oumi's source code is on GitHub (oumi-ai/oumi) under the Apache 2.0 license, so you can use it for free. Its website also links to a pricing page (https://oumi.ai/pricing) for any paid plans.

How do I install Oumi?

Run uv pip install oumi. The oumi package needs Python 3.10 or newer, below 3.15. The install section above has the other options from the project's README.

Is Oumi still maintained?

Yes. The oumi-ai/oumi repository was last updated on Oct 21, 2026, and the latest release, v0.9 on GitHub, came out on Sep 16, 2026.

How popular is Oumi?

Oumi has 9.4k GitHub stars as of Nov 1, 2026. It gained 12 new stars in the week of Oct 25–31, 2026, against a 12-week average of 7 a week. Its main package had 9.6k downloads that week, +28% against its own 4-week average. That made it #30 among AI agent frameworks on the Devtoolwatch Board.

What are the best alternatives to Oumi?

Other AI agent frameworks on the Devtoolwatch Board in the week of Oct 25–31, 2026, by momentum: Harness² (#1), HyperFrames (#2), AgentScope (#3), AG-UI (#4), LangGraph (#5). The alternatives table above has their numbers.

How does Oumi work?

Oumi works through a CLI and Python API driven by YAML configs. You run oumi train, oumi evaluate, oumi infer, or oumi launch with a recipe. It handles data synthesis, training, evaluation, inference, and deployment for open text and vision-language models.

What is the difference between Oumi and HallOumi?

Oumi is the open-source platform for building and training models. HallOumi is a claim-verification model that the Oumi team introduced in April 2025.

Can Oumi train tool-using agent models?

Yes. Since v0.9, Oumi supports tool-calling SFT and DPO, executable tool environments (database, HTTP, lookup, simulated), multi-turn tool conversation synthesis, and GRPO over those environments with verl.

Can I use Oumi from Claude or Cursor?

Yes. Oumi v0.8 added the oumi-mcp MCP server, which lets MCP-capable assistants such as Claude and Cursor drive Oumi.

Which cloud platforms can Oumi run jobs on?

Oumi runs remote jobs on AWS, Azure, GCP, Lambda, Modal, Slurm, and others through oumi launch. Version 0.4.2 also added the NERSC Perlmutter HPC cluster.

Sources

  1. oumi-ai/oumi on GitHub
  2. Oumi README
  3. oumi on PyPI
  4. Oumi website
  5. Release v0.9 (Sep 16, 2026)
  6. Release v0.8 (May 7, 2026)
  7. Release v0.7 (Jan 29, 2026)
  8. Hacker News: Oumi-AI/oumi: Everything you need to build foundation models, end-to-end
  9. Hacker News: Everything you need to build foundation models, end-to-end
  10. Hacker News: Small Fine-Tuned Models Are All You Need
  11. Devtoolwatch Board, the week of Oct 25–31, 2026

Oumi README badge

Maintainers can show the tool's weekly Board rank in their README:

Devtoolwatch badge for Oumi

[![Devtoolwatch](https://index.devtoolwatch.com/badge/oumi-ai-oumi.svg)](https://index.devtoolwatch.com/tools/oumi-ai-oumi/)

How this page is made: Devtoolwatch writes each review from the project's README, releases, package metadata and website, with an AI model, then checks every claim against the source it cites and drops what the sources don't support. The numbers come from Devtoolwatch's daily GitHub snapshots, GitHub's stargazer history, and the npm and PyPI download APIs. Spotted an error? Email [email protected].