Devtoolwatch BoardGet it every Monday

LMDeploy review

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Updated Nov 1, 2026. Review written Nov 1, 2026 from the project's own sources; usage data refreshed every Monday.

LMDeploy at a glance

Category
Inference and training
Website
lmdeploy.readthedocs.io/en/latest

Is LMDeploy growing? Usage data

In the week of Oct 25–31, 2026, LMDeploy ranked #231 on the Devtoolwatch Board and #25 in Inference and training, with a momentum score of 40 out of 100. Its main package had 13.7k downloads that week, +145% against its own 4-week average.

New GitHub stars per week for LMDeploy12 weeks from Aug 9, 2026: 13, 12, 22, 13, 20, 19, 19, 11, 4, 7, 13, 14 new stars, an average of 14 a week.Aug 9week of Oct 25
New GitHub stars per week for the last 12 weeks, from GitHub's stargazer history (today's stargazers by the week they starred).
Show the weekly numbers
New GitHub stars per week for LMDeploy
Week ofNew stars
Aug 9, 202613
Aug 16, 202612
Aug 23, 202622
Aug 30, 202613
Sep 6, 202620
Sep 13, 202619
Sep 20, 202619
Sep 27, 202611
Oct 4, 20264
Oct 11, 20267
Oct 18, 202613
Oct 25, 202614

The Board ranks tools by four signals each week: new stars, new stars for the repo's size, added downloads and download growth beyond the market. How the ranking works.

LMDeploy alternatives

Other LLM inference and training tools on the Board in the week of Oct 25–31, 2026, by momentum:

Inference and training ranked by momentum, the week of Oct 25–31, 2026
RankToolStarsDownloads/wk
#1dsh-our-free-modeldsh-our-free-model is a dsh plugin that provides DeepSeek V4.1 Flash, Kimi K3 and other models without login, sign-up or API key.54.3k–
#2magpiemagpie is a local gateway and app that lets coding agents like Claude Code, Codex and Gemini CLI use any provider's model.26.9k–
#3StrataStrata is a local inference engine and app that runs large open models like Qwen3.8-Flash-Next on consumer hardware with…37.1k–
#4edge0edge0 is an open-source streaming inference framework that runs large sparse mixture-of-experts models on consumer hardware by streaming…8.9k–
#5OmniRouteOmniRoute is an open-source AI gateway that routes requests across many model providers through one OpenAI-compatible endpoint, with…83.2k106k
#6CLIProxyAPICLIProxyAPI is a Go proxy server that exposes CLI coding accounts like Codex, Claude Code and Gemini CLI through OpenAI, Gemini and…57.1k–

All LLM inference and training tools, ranked

LMDeploy FAQ

How popular is LMDeploy?

LMDeploy has 8.1k GitHub stars as of Nov 1, 2026. It gained 14 new stars in the week of Oct 25–31, 2026, against a 12-week average of 14 a week. Its main package had 13.7k downloads that week, +145% against its own 4-week average. That made it #25 among LLM inference and training tools on the Devtoolwatch Board.

What are the best alternatives to LMDeploy?

Other LLM inference and training tools on the Devtoolwatch Board in the week of Oct 25–31, 2026, by momentum: dsh-our-free-model (#1), magpie (#2), Strata (#3), edge0 (#4), OmniRoute (#5). The alternatives table above has their numbers.

Sources

  1. Devtoolwatch Board, the week of Oct 25–31, 2026

LMDeploy README badge

Maintainers can show the tool's weekly Board rank in their README:

Devtoolwatch badge for LMDeploy

[![Devtoolwatch](https://index.devtoolwatch.com/badge/lmdeploy.svg)](https://index.devtoolwatch.com/tools/lmdeploy/)

How this page is made: Devtoolwatch writes each review from the project's README, releases, package metadata and website, with an AI model, then checks every claim against the source it cites and drops what the sources don't support. The numbers come from Devtoolwatch's daily GitHub snapshots, GitHub's stargazer history, and the npm and PyPI download APIs. Spotted an error? Email [email protected].