Opik review

Q: How do I install Opik?

Run pip install opik. It needs Node.js >=18. The install section above has the other options from the project's README.

Opik is an open-source platform from Comet for tracing, evaluating, and monitoring LLM applications, RAG systems, and AI agents.

Updated Nov 1, 2026. Review written Oct 22, 2026 from the project's own sources; usage data refreshed every Monday.

TL;DR

Opik is an Apache-2.0 platform for LLM observability, evaluation, prompt management, and production monitoring, built by Comet. It is for ML engineers and AI teams moving LLM apps and agents from prototype to production. The full platform, backend included, can be self-hosted, and Opik is framework-agnostic.

23.1kGitHub stars
+190new stars, week of Oct 25
~709.1kdownloads a week, +33% vs 4-week avg
#5in Evals and observability this week

Opik at a glance

Category: Evals and observability
Maintained by: Comet (organization, @comet-ml on GitHub)
License: Apache 2.0
Language: Python, TypeScript, Shell
Repository: github.com/comet-ml/opik
Website: www.comet.com/docs/opik
npm package: opik 2.2.113
PyPI package: opik 2.2.113
Latest release: 2.2.113 on GitHub, Oct 21, 2026
First published: May 10, 2023

What Opik does

Opik traces LLM calls, tool executions, retrieval steps, and agent activity, with full trace trees for multi-step agents.
Opik runs evaluations with datasets, experiments, code-based metrics, and LLM-as-a-judge metrics for hallucination, moderation, and RAG assessment.
Opik monitors feedback scores, trace counts, and token usage in dashboards, and scores incoming traces with online evaluation rules.
Opik stores and versions prompts and offers a Prompt Playground for experimenting with prompts and models.
Opik provides a PyTest integration to evaluate LLM pipelines in CI/CD on every commit.
Opik includes an MCP server so Claude Code, Cursor, VS Code Copilot, Codex, or opencode can read traces and run evaluations from chat.

How it works

Opik runs as a server with a web app, either on Comet.com Cloud or self-hosted with Docker Compose or Kubernetes and Helm. Your application sends traces through the Python or TypeScript SDK, a REST API, or OpenTelemetry. In Python, you wrap functions with the @track decorator to log calls, including nested calls. Integrations cover frameworks such as Google ADK, Autogen, and Flowise AI.

How to install and start using Opik

Python SDK with pip

pip install opik

Connect a coding agent via MCP

uvx opik mcp configure

Self-host on Linux or Mac (from the cloned repo)

./opik.sh

Requirements

The Python SDK requires Python 3.10 or later.
The TypeScript and JavaScript SDK requires Node.js 18 or later.
The MCP setup command needs uv.
Either a Comet account for Opik Cloud, or Docker or Kubernetes to self-host.

First steps

Install the Python SDK, then run opik configure to point it at Opik Cloud or your self-hosted server.
Wrap a function with the @track decorator so every call, including nested calls, is logged to Opik.
For a local self-hosted instance, run ./opik.sh in the cloned repo and open localhost:5173 in your browser.
Turn a wrong-looking trace into a test case through the UI or SDK, then run the test suite to verify fixes.

Who Opik is for

ML engineers building LLM-powered agents who need trace trees for multi-step agents and tool calls.
AI teams moving LLM apps from prototype to production monitoring.
Teams that need self-hosted observability with no data leaving their own environment.
Developers who want LLM evaluations to run in CI through PyTest.

Limitations to know

Opik's Docker Compose setup is aimed at local development and testing. Production self-hosting uses Kubernetes and Helm.
Opik's one-click MCP badges and add-mcp fallback target Opik Cloud only. Self-hosted setups use the uvx command.
Opik's native SDKs cover Python and TypeScript. Other languages such as Java and Ruby connect through OpenTelemetry.
Running ./opik.sh --clean removes all Opik data volumes, and all Opik data is lost.

Is Opik growing? Usage data

In the week of Oct 25–31, 2026, Opik ranked #75 on the Devtoolwatch Board and #5 in Evals and observability, with a momentum score of 69 out of 100. Its main package had about 709.1k downloads that week, +33% against its own 4-week average.

New GitHub stars per week for the last 12 weeks, from GitHub's stargazer history (today's stargazers by the week they starred).

Show the weekly numbers

New GitHub stars per week for Opik
Week of	New stars
Aug 9, 2026	190
Aug 16, 2026	143
Aug 23, 2026	146
Aug 30, 2026	158
Sep 6, 2026	159
Sep 13, 2026	187
Sep 20, 2026	111
Sep 27, 2026	126
Oct 4, 2026	149
Oct 11, 2026	215
Oct 18, 2026	207
Oct 25, 2026	190

On Hacker News

Show HN: Opik, an open source LLM evaluation framework, 86 points and 15 comments (Sep 17, 2024)
Open-Source SDK for Automated Prompt and Agent Optimization, 8 points and 1 comments (May 22, 2025)
Opik Agent Optimizer – Open-Source Prompt Optimization Framework, 6 points and 1 comments (Dec 14, 2025)

The Board ranks tools by four signals each week: new stars, new stars for the repo's size, added downloads and download growth beyond the market. How the ranking works.

Opik alternatives

Other LLM evals and observability tools on the Board in the week of Oct 25–31, 2026, by momentum:

Evals and observability ranked by momentum, the week of Oct 25–31, 2026
Rank	Tool	Stars	Downloads/wk
#1	SkillSpectorSkillSpector is NVIDIA's security scanner that checks AI agent skills for vulnerabilities, malicious patterns, and supply-chain risks…	23.7k	–
#2	JudgevalJudgeval is an open-source Python SDK for tracing and evaluating LLM-powered agents with prompt-based judges and online monitoring.	1.1k	80.2k
#3	A.I.G (AI-Infra-Guard)A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak…	7.2k	–
#4	LangfuseLangfuse is an open source LLM engineering platform for tracing, evaluating, prompt management, and debugging LLM applications and agents.	36.8k	9.8M
#6	promptfoopromptfoo is a CLI and library for evaluating and red-teaming LLM-based apps, including prompts, agents, and RAG pipelines.	26.7k	1.2M
#7	garakgarak is a command-line LLM vulnerability scanner from NVIDIA that probes models for jailbreaks, prompt injection, data leakage,…	9.8k	12.9k

All LLM evals and observability tools, ranked

Recent Opik releases

2.2.113, Oct 21, 2026
2.2.112, Oct 21, 2026
2.2.111, Oct 21, 2026
2.2.110, Oct 21, 2026
2.2.109, Oct 20, 2026

Opik FAQ

Is Opik free and open source?

Yes. Opik's source code is on GitHub (comet-ml/opik) under the Apache 2.0 license, so you can use it for free. Its website also links to a pricing page (https://www.comet.com/site/pricing/) for any paid plans.

How do I install Opik?

Run pip install opik. It needs Node.js >=18. The install section above has the other options from the project's README.

Is Opik still maintained?

Yes. The comet-ml/opik repository was last updated on Oct 22, 2026, and the latest release, 2.2.113 on GitHub, came out on Oct 21, 2026.

How popular is Opik?

Opik has 23.1k GitHub stars as of Nov 1, 2026. It gained 190 new stars in the week of Oct 25–31, 2026, against a 12-week average of 165 a week. Its main package had about 709.1k downloads that week, +33% against its own 4-week average. That made it #5 among LLM evals and observability tools on the Devtoolwatch Board.

Opik vs Langfuse: how do they compare?

Opik and Langfuse are both tracked by Devtoolwatch as LLM evals and observability tools. Opik has 23.1k GitHub stars and Langfuse has 36.8k. In the week of Oct 25–31, 2026, Opik's main package had 709.1k downloads and Langfuse's had 9.8M. Langfuse is an open source LLM engineering platform for tracing, evaluating, prompt management, and debugging LLM applications and agents. Langfuse review.

Opik vs MLflow: how do they compare?

Opik and MLflow are both tracked by Devtoolwatch as LLM evals and observability tools. Opik has 23.1k GitHub stars and MLflow has 28.6k. In the week of Oct 25–31, 2026, Opik's main package had 709.1k downloads and MLflow's had 5.2M. MLflow is an open source AI engineering platform for tracing, evaluating, monitoring, and managing agents, LLM applications, and ML models. MLflow review.

What are the best alternatives to Opik?

Other LLM evals and observability tools on the Devtoolwatch Board in the week of Oct 25–31, 2026, by momentum: SkillSpector (#1), Judgeval (#2), A.I.G (AI-Infra-Guard) (#3), Langfuse (#4), promptfoo (#6). The alternatives table above has their numbers.

Is Opik open source?

Yes. Opik is licensed under Apache 2.0. The server, web application, and core observability and evaluation features can be self-hosted without a commercial license.

Can I self-host Opik?

Yes. Opik can run locally with Docker Compose using the opik.sh or opik.ps1 script, or on Kubernetes with a Helm chart for larger deployments.

Does Opik support AI agent tracing?

Yes. Opik captures multi-step traces containing LLM calls, tool executions, retrieval steps, and other agent activity.

Is Opik tied to a specific agent framework?

No. Opik is framework-agnostic. It supports its own SDK, OpenTelemetry, and framework-specific integrations, and works with OpenAI, Anthropic, LangChain, and many other providers and frameworks.

What evaluation metrics does Opik include?

Opik offers LLM-as-a-judge and heuristic metrics, including hallucination detection, moderation, answer relevance, context precision, and context recall.

Sources

Opik README badge

Maintainers can show the tool's weekly Board rank in their README:

[![Devtoolwatch](https://index.devtoolwatch.com/badge/opik.svg)](https://index.devtoolwatch.com/tools/opik/)

How this page is made: Devtoolwatch writes each review from the project's README, releases, package metadata and website, with an AI model, then checks every claim against the source it cites and drops what the sources don't support. The numbers come from Devtoolwatch's daily GitHub snapshots, GitHub's stargazer history, and the npm and PyPI download APIs. Spotted an error? Email [email protected].