Devtoolwatch BoardGet it every Monday

Evidently review

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Updated Nov 1, 2026. Review written Nov 1, 2026 from the project's own sources; usage data refreshed every Monday.

Evidently at a glance

Category
Evals and observability
Website
discord.gg/xZjKRaNp8b

Is Evidently growing? Usage data

In the week of Oct 25–31, 2026, Evidently ranked #321 on the Devtoolwatch Board and #17 in Evals and observability, with a momentum score of 28 out of 100. Its main package had 196.7k downloads that week, +5% against its own 4-week average.

New GitHub stars per week for Evidently12 weeks from Aug 9, 2026: 20, 23, 31, 34, 20, 19, 13, 32, 16, 17, 11, 25 new stars, an average of 22 a week.Aug 9week of Oct 25
New GitHub stars per week for the last 12 weeks, from GitHub's stargazer history (today's stargazers by the week they starred).
Show the weekly numbers
New GitHub stars per week for Evidently
Week ofNew stars
Aug 9, 202620
Aug 16, 202623
Aug 23, 202631
Aug 30, 202634
Sep 6, 202620
Sep 13, 202619
Sep 20, 202613
Sep 27, 202632
Oct 4, 202616
Oct 11, 202617
Oct 18, 202611
Oct 25, 202625

The Board ranks tools by four signals each week: new stars, new stars for the repo's size, added downloads and download growth beyond the market. How the ranking works.

Evidently alternatives

Other LLM evals and observability tools on the Board in the week of Oct 25–31, 2026, by momentum:

Evals and observability ranked by momentum, the week of Oct 25–31, 2026
RankToolStarsDownloads/wk
#1SkillSpectorSkillSpector is NVIDIA's security scanner that checks AI agent skills for vulnerabilities, malicious patterns, and supply-chain risks…23.7k–
#2JudgevalJudgeval is an open-source Python SDK for tracing and evaluating LLM-powered agents with prompt-based judges and online monitoring.1.1k80.2k
#3A.I.G (AI-Infra-Guard)A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak…7.2k–
#4LangfuseLangfuse is an open source LLM engineering platform for tracing, evaluating, prompt management, and debugging LLM applications and agents.36.8k9.8M
#5OpikOpik is an open-source platform from Comet for tracing, evaluating, and monitoring LLM applications, RAG systems, and AI agents.23.1k709.1k
#6promptfoopromptfoo is a CLI and library for evaluating and red-teaming LLM-based apps, including prompts, agents, and RAG pipelines.26.7k1.2M

All LLM evals and observability tools, ranked

Evidently FAQ

How popular is Evidently?

Evidently has 8k GitHub stars as of Nov 1, 2026. It gained 25 new stars in the week of Oct 25–31, 2026, against a 12-week average of 22 a week. Its main package had 196.7k downloads that week, +5% against its own 4-week average. That made it #17 among LLM evals and observability tools on the Devtoolwatch Board.

What are the best alternatives to Evidently?

Other LLM evals and observability tools on the Devtoolwatch Board in the week of Oct 25–31, 2026, by momentum: SkillSpector (#1), Judgeval (#2), A.I.G (AI-Infra-Guard) (#3), Langfuse (#4), Opik (#5). The alternatives table above has their numbers.

Sources

  1. Devtoolwatch Board, the week of Oct 25–31, 2026

Evidently README badge

Maintainers can show the tool's weekly Board rank in their README:

Devtoolwatch badge for Evidently

[![Devtoolwatch](https://index.devtoolwatch.com/badge/evidently.svg)](https://index.devtoolwatch.com/tools/evidently/)

How this page is made: Devtoolwatch writes each review from the project's README, releases, package metadata and website, with an AI model, then checks every claim against the source it cites and drops what the sources don't support. The numbers come from Devtoolwatch's daily GitHub snapshots, GitHub's stargazer history, and the npm and PyPI download APIs. Spotted an error? Email [email protected].