# Arize Phoenix review

> Arize Phoenix is an open-source, self-hosted AI observability platform for tracing, evaluating, and troubleshooting LLM applications and agents.

Devtoolwatch Board, the week of Oct 25–31, 2026. Canonical page: https://index.devtoolwatch.com/tools/phoenix/

## TL;DR

Arize Phoenix is Arize's open-source AI observability platform for experimentation, evaluation, and troubleshooting. It is for developers building LLM applications and agents who want to trace runs, score outputs, and test prompt changes. Phoenix is built on OpenTelemetry and OpenInference, and it is vendor and language agnostic.

## Arize Phoenix at a glance

- **Category:** [Evals and observability](https://index.devtoolwatch.com/categories/evals-and-observability/)
- **Maintained by:** Arize AI (organization, [@Arize-ai](https://github.com/Arize-ai) on GitHub)
- **Language:** Python, TypeScript, Jupyter Notebook
- **Repository:** [github.com/Arize-ai/phoenix](https://github.com/Arize-ai/phoenix)
- **Website:** [arize.com/docs/phoenix](https://arize.com/docs/phoenix)
- **PyPI package:** [arize-phoenix](https://pypi.org/project/arize-phoenix/) 20.24.0
- **Latest release:** [arize-phoenix-v20.24.0](https://github.com/Arize-ai/phoenix/releases/tag/arize-phoenix-v20.24.0) on GitHub, Oct 21, 2026
- **First published:** Nov 9, 2022

## What Arize Phoenix does

- Arize Phoenix traces LLM application runtime with OpenTelemetry-based instrumentation, capturing model calls, retrieval, tool use, and custom logic.
- Arize Phoenix scores traces and spans with LLM-based evaluators, code-based checks, or human labels.
- Arize Phoenix creates versioned datasets of examples for experimentation, evaluation, and fine-tuning.
- Arize Phoenix runs experiments that track and evaluate changes to prompts, LLMs, and retrieval on the same inputs.
- Arize Phoenix includes a playground to optimize prompts, compare models, adjust parameters, and replay traced LLM calls.
- Arize Phoenix manages prompt changes with version control, tagging, and experimentation.
- Arize Phoenix exposes a remote MCP server at `/mcp` so Claude Code, Cursor, and other MCP clients can query traces, datasets, and experiments.

### How it works

Arize Phoenix runs as a server on your local machine, in a container, or in the cloud. Your application sends traces to it over OpenTelemetry (OTLP), usually through OpenInference auto-instrumentation for frameworks like LangChain, LlamaIndex, DSPy, and Vercel AI SDK. Lightweight Python and TypeScript packages provide OpenTelemetry wrappers, a REST API client, and eval tooling.

## How to install Arize Phoenix

**With pip**

```
pip install arize-phoenix
```

**With uvx (no install)**

```
uvx arize-phoenix serve
```

**Instrument your app via CLI**

```
npx @arizeai/phoenix-cli setup
```

### Requirements

- Python 3.11 or later, below 3.15, for the arize-phoenix package.
- Node.js with npx to use the @arizeai/phoenix-cli setup command.

### First steps

1. Start the Phoenix server with `phoenix serve` after installing the arize-phoenix package.
2. From your project directory, run the Phoenix CLI setup to detect your framework and LLM provider and install OpenInference instrumentation.
3. Run your application and inspect the exported traces in the Phoenix UI.
4. Attach evaluators to a dataset so they run automatically during experiments.

## Who Arize Phoenix is for

- Developers debugging LLM apps and agents built with LangChain, LlamaIndex, DSPy, CrewAI, or Vercel AI SDK.
- Teams that want self-hosted observability built on OpenTelemetry standards.
- Developers evaluating RAG relevance and answer relevance in LLM applications.
- Developers who use coding agents like Claude Code or Cursor and want them to query traces.

### Limitations

- Arize Phoenix is self-hosted. A managed platform is offered separately as Arize AX.
- The Azure deployment template serves plain HTTP and needs a TLS proxy before production use.
- The TypeScript evals package, @arizeai/phoenix-evals, is an alpha release.
- The standalone stdio MCP server package is in maintenance mode, superseded by the built-in remote MCP server.

## Usage data (the week of Oct 25–31, 2026)

- Board rank: #219 overall, #10 in Evals and observability, momentum score 42
- Downloads that week: 158.1k (+2% vs 4-week average)
- New GitHub stars per week (last 12 weeks): Aug 9: 117; Aug 16: 86; Aug 23: 102; Aug 30: 102; Sep 6: 93; Sep 13: 113; Sep 20: 91; Sep 27: 79; Oct 4: 91; Oct 11: 110; Oct 18: 106; Oct 25: 101

## Arize Phoenix alternatives

| Rank | Tool | Stars | Downloads/wk |
|---|---|---|---|
| #1 | [SkillSpector](https://index.devtoolwatch.com/tools/nvidia-skillspector/) | 23.7k | – |
| #2 | [Judgeval](https://index.devtoolwatch.com/tools/judgmentlabs-judgeval/) | 1.1k | 80.2k |
| #3 | [A.I.G (AI-Infra-Guard)](https://index.devtoolwatch.com/tools/tencent-ai-infra-guard/) | 7.2k | – |
| #4 | [Langfuse](https://index.devtoolwatch.com/tools/langfuse/) | 36.8k | 9.8M |
| #5 | [Opik](https://index.devtoolwatch.com/tools/opik/) | 23.1k | 709.1k |
| #6 | [promptfoo](https://index.devtoolwatch.com/tools/promptfoo/) | 26.7k | 1.2M |

## Arize Phoenix FAQ

### Is Arize Phoenix free and open source?

Arize Phoenix's code is on GitHub (Arize-ai/phoenix), but the repository doesn't declare a standard open-source license. Check its license file before using it commercially.

### How do I install Arize Phoenix?

Run `pip install arize-phoenix`. The arize-phoenix package needs Python 3.11 or newer, below 3.15. The install section above has the other options from the project's README.

### Is Arize Phoenix still maintained?

Yes. The Arize-ai/phoenix repository was last updated on Oct 21, 2026, and the latest release, arize-phoenix-v20.24.0 on GitHub, came out on Oct 21, 2026.

### How popular is Arize Phoenix?

Arize Phoenix has 12.1k GitHub stars as of Nov 1, 2026. It gained 101 new stars in the week of Oct 25–31, 2026, against a 12-week average of 99 a week. Its main package had 158.1k downloads that week, +2% against its own 4-week average. That made it #10 among LLM evals and observability tools on the Devtoolwatch Board.

### Arize Phoenix vs Langfuse: how do they compare?

Arize Phoenix and Langfuse are both tracked by Devtoolwatch as LLM evals and observability tools. Arize Phoenix has 12.1k GitHub stars and Langfuse has 36.8k. In the week of Oct 25–31, 2026, Arize Phoenix's main package had 158.1k downloads and Langfuse's had 9.8M. Langfuse is an open source LLM engineering platform for tracing, evaluating, prompt management, and debugging LLM applications and agents. [Langfuse review](https://index.devtoolwatch.com/tools/langfuse/)

### Arize Phoenix vs MLflow: how do they compare?

Arize Phoenix and MLflow are both tracked by Devtoolwatch as LLM evals and observability tools. Arize Phoenix has 12.1k GitHub stars and MLflow has 28.6k. In the week of Oct 25–31, 2026, Arize Phoenix's main package had 158.1k downloads and MLflow's had 5.2M. MLflow is an open source AI engineering platform for tracing, evaluating, monitoring, and managing agents, LLM applications, and ML models. [MLflow review](https://index.devtoolwatch.com/tools/mlflow/)

### What are the best alternatives to Arize Phoenix?

Other LLM evals and observability tools on the Devtoolwatch Board in the week of Oct 25–31, 2026, by momentum: SkillSpector (#1), Judgeval (#2), A.I.G (AI-Infra-Guard) (#3), Langfuse (#4), Opik (#5). The alternatives table above has their numbers.

### What is Arize Phoenix?

Arize Phoenix is Arize's open-source AI observability platform for experimentation, evaluation, and troubleshooting of AI applications. It provides tracing, evaluation, datasets, experiments, a prompt playground, and prompt management.

### What is Arize Phoenix used for?

Arize Phoenix is used to debug and improve AI applications. You send traces to see what happened in a run, score outputs to find failures and regressions, iterate on prompts with real production examples, and compare changes with experiments.

### How does Arize Phoenix work?

Arize Phoenix is built on OpenTelemetry and powered by OpenInference instrumentation. It accepts traces over OTLP and auto-instruments frameworks and providers such as LangChain, LlamaIndex, OpenAI, Anthropic, and Bedrock, in Python, TypeScript, and Java.

### What is the difference between Arize Phoenix and Arize AX?

Arize Phoenix is open-source and self-hosted. Arize AX is Arize's managed enterprise platform built on the same open standards. The same OpenTelemetry and OpenInference instrumentation works with both.

### Can I use my own evaluators with Arize Phoenix?

Arize Phoenix supports pre-built and custom LLM-based evaluators. It also accepts evaluators from Ragas, Deepeval, or Cleanlab, along with code-based checks and human annotations added in the UI.

## Sources

1. [Arize-ai/phoenix on GitHub](https://github.com/Arize-ai/phoenix)
2. [Arize Phoenix README](https://github.com/Arize-ai/phoenix/blob/main/README.md)
3. [arize-phoenix on PyPI](https://pypi.org/project/arize-phoenix/)
4. [Arize Phoenix website](https://arize.com/docs/phoenix)
5. [Release arize-phoenix-v20.24.0 (Oct 21, 2026)](https://github.com/Arize-ai/phoenix/releases/tag/arize-phoenix-v20.24.0)
6. [Release @arizeai/phoenix-mcp@4.3.17 (Oct 21, 2026)](https://github.com/Arize-ai/phoenix/releases/tag/%40arizeai/phoenix-mcp%404.3.17)
7. [Release @arizeai/phoenix-cli@1.18.9 (Oct 21, 2026)](https://github.com/Arize-ai/phoenix/releases/tag/%40arizeai/phoenix-cli%401.18.9)
8. [Hacker News: Show HN: Phoenix OSS – Applying LLM Spans, Traces, and Evals for AI Insights](https://news.ycombinator.com/item?id=37765954)
9. [Devtoolwatch Board, the week of Oct 25–31, 2026](https://index.devtoolwatch.com/)