# Best LLM inference and training tools, ranked by real usage

the week of Oct 25–31, 2026. Canonical page: https://index.devtoolwatch.com/categories/inference-and-training/

| Rank | Tool | Stars | Downloads/wk |
|---|---|---|---|
| #1 | [dsh-our-free-model](https://index.devtoolwatch.com/tools/ebony-vinyl-dsh-our-free-model/) | 54.3k | – |
| #2 | [magpie](https://index.devtoolwatch.com/tools/yetone-magpie/) | 26.9k | – |
| #3 | [Strata](https://index.devtoolwatch.com/tools/niko1221-strata/) | 37.1k | – |
| #4 | [edge0](https://index.devtoolwatch.com/tools/edge0-ai-edge0/) | 8.9k | – |
| #5 | [OmniRoute](https://index.devtoolwatch.com/tools/diegosouzapw-omniroute/) | 83.2k | 106k |
| #6 | [CLIProxyAPI](https://index.devtoolwatch.com/tools/router-for-me-cliproxyapi/) | 57.1k | – |
| #7 | [codex-chatgpt-web](https://index.devtoolwatch.com/tools/miuuyy-codex-chatgpt-web/) | 15.3k | – |
| #8 | [9Router](https://index.devtoolwatch.com/tools/decolua-9router/) | 31.8k | 108.8k |
| #9 | [vLLM](https://index.devtoolwatch.com/tools/vllm/) | 96k | 677.2k |
| #10 | [audio.cpp](https://index.devtoolwatch.com/tools/0xshug0-audio-cpp/) | 3.9k | – |
| #11 | [Sub2API](https://index.devtoolwatch.com/tools/wei-shaw-sub2api/) | 45.2k | – |
| #12 | [llama.cpp](https://index.devtoolwatch.com/tools/llama-cpp/) | 133k | – |
| #13 | [LibreChat](https://index.devtoolwatch.com/tools/librechat/) | 46.6k | – |
| #14 | [Transformers](https://index.devtoolwatch.com/tools/transformers/) | 168.4k | 27.8M |
| #15 | [FlashInfer](https://index.devtoolwatch.com/tools/flashinfer-ai-flashinfer/) | 6.8k | 938.6k |
| #16 | [TurboFieldfare](https://index.devtoolwatch.com/tools/drumih-turbo-fieldfare/) | 7.1k | – |
| #17 | [AnythingLLM](https://index.devtoolwatch.com/tools/anythingllm/) | 67.8k | – |
| #18 | [kimi-k3-in-c](https://index.devtoolwatch.com/tools/fareedkhan-dev-kimi-k3-in-c/) | 9.3k | – |
| #19 | [Dynamo](https://index.devtoolwatch.com/tools/ai-dynamo-dynamo/) | 8.4k | 20.7k |
| #20 | [LocalAI](https://index.devtoolwatch.com/tools/localai/) | 50.1k | – |
| #21 | [MLX](https://index.devtoolwatch.com/tools/mlx/) | 29k | 356.9k |
| #22 | [Laya](https://index.devtoolwatch.com/tools/nandhakishorm-laya/) | 34.8k | 54.5k |
| #23 | [SGLang](https://index.devtoolwatch.com/tools/sglang/) | 38.3k | 336.7k |
| #24 | [Rapid-MLX](https://index.devtoolwatch.com/tools/raullenchai-rapid-mlx/) | 4.1k | 2.1k |
| #25 | [LMDeploy](https://index.devtoolwatch.com/tools/lmdeploy/) | 8.1k | 13.7k |
| #26 | [GPUStack](https://index.devtoolwatch.com/tools/gpustack-gpustack/) | 5.9k | – |
| #27 | [Jan](https://index.devtoolwatch.com/tools/jan/) | 45.2k | – |
| #28 | [Lemonade](https://index.devtoolwatch.com/tools/lemonade-sdk-lemonade/) | 6k | – |
| #29 | [Ollama](https://index.devtoolwatch.com/tools/ollama/) | 185.5k | 4M |
| #30 | [BentoML](https://index.devtoolwatch.com/tools/bentoml-bentoml/) | 8.9k | 51.1k |
| #31 | [Open WebUI](https://index.devtoolwatch.com/tools/open-webui/) | 157.4k | 158.6k |
| #32 | [Unsloth](https://index.devtoolwatch.com/tools/unsloth/) | 78.9k | 170.5k |
| #33 | [MTPLX](https://index.devtoolwatch.com/tools/youssofal-mtplx/) | 2.7k | 443 |
| #34 | [PEFT](https://index.devtoolwatch.com/tools/peft/) | 21.9k | 2.2M |
| #35 | [OpenVINO](https://index.devtoolwatch.com/tools/openvinotoolkit-openvino/) | 11.1k | 228.8k |
| #36 | [exo](https://index.devtoolwatch.com/tools/exo/) | 48.1k | – |
| #37 | [KServe](https://index.devtoolwatch.com/tools/kserve-kserve/) | 6.2k | 13k |
| #38 | [verl](https://index.devtoolwatch.com/tools/verl/) | 24.1k | 4.2k |
| #39 | [MLX LM](https://index.devtoolwatch.com/tools/mlx-lm/) | 7.5k | 137k |
| #40 | [LLaMA-Factory](https://index.devtoolwatch.com/tools/llama-factory/) | 75.8k | 3.3k |
| #41 | [Laya-MLX](https://index.devtoolwatch.com/tools/mizorewww-laya-mlx/) | 7.1k | 724 |
| #42 | [GPT4All](https://index.devtoolwatch.com/tools/nomic-ai-gpt4all/) | 77.3k | 11.9k |
| #43 | [TensorRT-LLM](https://index.devtoolwatch.com/tools/tensorrt-llm/) | 15k | 1.3k |
| #44 | [llamafile](https://index.devtoolwatch.com/tools/llamafile/) | 26.5k | – |
| #45 | [TRL](https://index.devtoolwatch.com/tools/trl/) | 19.6k | 536k |

## FAQ

### What is the fastest-growing of the LLM inference and training tools right now?

dsh-our-free-model ranked #1 among LLM inference and training tools on the Devtoolwatch Board in the week of Oct 25–31, 2026, with a momentum score of 100 out of 100.

### Which of the LLM inference and training tools has the most GitHub stars?

Of the LLM inference and training tools ranked in the week of Oct 25–31, 2026, Ollama has the most GitHub stars: 185.5k.

### Which of the LLM inference and training tools is downloaded the most?

Transformers's main package had the most downloads of the ranked LLM inference and training tools: 27.8M in the week of Oct 25–31, 2026.

### How does Devtoolwatch rank LLM inference and training tools?

Every Monday the Board averages four percentile ranks: new GitHub stars from daily snapshots, new stars for the repo's size, added npm and PyPI downloads, and download growth beyond the market. Star spikes without forks, downloads or Hacker News to back them are held back.