Devtoolwatch BoardW&B Weave review
W&B Weave is a toolkit from Weights & Biases for tracing and evaluating AI agents and LLM applications.
TL;DR
W&B Weave is an observability and evaluation toolkit for agents and LLM applications, built by Weights & Biases. W&B Weave is for Python and TypeScript developers who want traces of conversations, LLM calls and tool calls, plus evaluations with LLM judges and custom scorers. Supported agent SDKs are autopatched after a single weave.init() call.
- 1.1kGitHub stars
- +3new stars, week of Oct 25
- –not ranked this week
W&B Weave at a glance
- Category
- Evals and observability
- Maintained by
- Weights & Biases (organization, @wandb on GitHub)
- License
- Apache 2.0
- Language
- Python, TypeScript, JavaScript
- Repository
- github.com/wandb/weave
- Website
- wandb.me/weave
- npm package
- weave 0.16.9
- PyPI package
- weave 0.53.12
- Latest release
- v0.53.12 on GitHub, Oct 13, 2026
- First published
- Jun 7, 2023
What W&B Weave does
- W&B Weave traces agent conversations, turns, LLM calls and tool calls, which appear in the Agents tab.
- W&B Weave traces individual functions with the @weave.op decorator, and those traces land in the Calls tab.
- W&B Weave evaluates agent and application responses using LLM judges and custom scorers.
- W&B Weave autopatches the OpenAI Agents SDK, Claude Agent SDK and Google ADK after weave.init().
- W&B Weave auto-traces plain openai calls into the Calls tab after weave.init().
- W&B Weave accepts OpenTelemetry spans at its OTLP endpoint, with no Weave SDK installation required.
- W&B Weave offers a Conversation SDK with start_conversation, start_turn, start_llm and start_tool for wrapping custom agent loops.
How it works
You install the Python or TypeScript library and call weave.init() with your team and project name. weave.init() then prints a project URL. Supported agent SDKs and plain openai calls are patched automatically. Custom loops use the Conversation SDK context managers. Traces are sent to the Weights & Biases trace server and viewed in the Agents or Calls tab. OTel-instrumented agents can send spans directly to the OTLP endpoint.
How to install and start using W&B Weave
With pip
pip install weaveWith npm
npm install weaveWith pip, for the OpenAI Agents SDK example
pip install weave openai-agents requestsRequirements
- Python 3.10 or higher
- A Weights & Biases account (free tier available)
- A W&B API key set in WANDB_API_KEY
- An OpenAI API key in OPENAI_API_KEY for the README examples
First steps
- Create a Weights & Biases account and set WANDB_API_KEY to the key from wandb.ai/authorize.
- Call weave.init("<your-team>/<your-project-name>") at the start of your code.
- Run your agent with a supported SDK, or decorate functions with @weave.op.
- Open the printed project URL and check the Agents tab or the Calls tab.
Who W&B Weave is for
- Developers building agents with the OpenAI Agents SDK, Claude Agent SDK or Google ADK who want traces
- Teams evaluating LLM applications, including RAG apps, with LLM judges and custom scorers
- Developers with OpenTelemetry-instrumented agents who want to send spans without adding an SDK
Limitations to know
- W&B Weave requires a Weights & Biases account and API key to store traces.
- W&B Weave does not infer provider_name from the model name in start_llm, so you must always pass it.
- W&B Weave's start_session and Session are deprecated and should not be used in new code.
- W&B Weave's engine and boards code is paused while the project focuses on tracing and evaluations.
Is W&B Weave growing? Usage data
W&B Weave was not ranked on the Devtoolwatch Board in the week of Oct 25–31, 2026: it needs 25 or more new stars or 1,000 or more added downloads in a week to rank.
Show the weekly numbers
| Week of | New stars |
|---|---|
| Aug 9, 2026 | 5 |
| Aug 16, 2026 | 3 |
| Aug 23, 2026 | 1 |
| Aug 30, 2026 | 3 |
| Sep 6, 2026 | 3 |
| Sep 13, 2026 | 1 |
| Sep 20, 2026 | 2 |
| Sep 27, 2026 | 4 |
| Oct 4, 2026 | 4 |
| Oct 11, 2026 | 3 |
| Oct 18, 2026 | 0 |
| Oct 25, 2026 | 3 |
On Hacker News
- Whitepaper: Current Best Practices for Training LLMs from Scratch, 93 points and 3 comments (Apr 13, 2023)
- Weave: Interactive Data Exploration Toolkit by Weights and Biases, 49 points and 3 comments (Jun 8, 2023)
The Board ranks tools by four signals each week: new stars, new stars for the repo's size, added downloads and download growth beyond the market. How the ranking works.
W&B Weave alternatives
Other LLM evals and observability tools on the Board in the week of Oct 25–31, 2026, by momentum:
| Rank | Tool | Stars | Downloads/wk |
|---|---|---|---|
| #1 | SkillSpectorSkillSpector is NVIDIA's security scanner that checks AI agent skills for vulnerabilities, malicious patterns, and supply-chain risks… | 23.7k | – |
| #2 | JudgevalJudgeval is an open-source Python SDK for tracing and evaluating LLM-powered agents with prompt-based judges and online monitoring. | 1.1k | 80.2k |
| #3 | A.I.G (AI-Infra-Guard)A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak… | 7.2k | – |
| #4 | LangfuseLangfuse is an open source LLM engineering platform for tracing, evaluating, prompt management, and debugging LLM applications and agents. | 36.8k | 9.8M |
| #5 | OpikOpik is an open-source platform from Comet for tracing, evaluating, and monitoring LLM applications, RAG systems, and AI agents. | 23.1k | 709.1k |
| #6 | promptfoopromptfoo is a CLI and library for evaluating and red-teaming LLM-based apps, including prompts, agents, and RAG pipelines. | 26.7k | 1.2M |
Recent W&B Weave releases
W&B Weave FAQ
Is W&B Weave free and open source?
Yes. W&B Weave's source code is on GitHub (wandb/weave) under the Apache 2.0 license, so you can use it for free.
How do I install W&B Weave?
Run pip install weave. The install section above has the other options from the project's README.
Is W&B Weave still maintained?
Yes. The wandb/weave repository was last updated on Oct 22, 2026, and the latest release, v0.53.12 on GitHub, came out on Oct 13, 2026.
How popular is W&B Weave?
W&B Weave has 1.1k GitHub stars as of Nov 1, 2026. It gained 3 new stars in the week of Oct 25–31, 2026, against a 12-week average of 3 a week.
What are the best alternatives to W&B Weave?
Other LLM evals and observability tools on the Devtoolwatch Board in the week of Oct 25–31, 2026, by momentum: SkillSpector (#1), Judgeval (#2), A.I.G (AI-Infra-Guard) (#3), Langfuse (#4), Opik (#5). The alternatives table above has their numbers.
What is W&B Weave?
W&B Weave is an observability and evaluation platform from Weights & Biases for agents and LLM applications. W&B Weave traces conversations, LLM calls and tool calls. It also evaluates responses with LLM judges and custom scorers.
What is the difference between the Agents tab and the Calls tab?
W&B Weave sends agent SDK and Conversation SDK traces to the Agents tab. Functions traced with @weave.op and plain openai calls go to the Calls tab. Use @weave.op for evaluations, scorers and LLM calls that are not an agent loop.
Can I trace an agent that doesn't use a supported SDK?
Yes. W&B Weave lets you wrap your own loop with start_conversation, start_turn, start_llm and start_tool. In Python these are context managers that close on exceptions.
Do I need the Weave SDK to send traces?
No. W&B Weave can receive OpenTelemetry spans at its OTLP endpoint. No Weave SDK installation is required for OTel-instrumented agents.
How does W&B Weave relate to CoreWeave Agent Lens?
W&B Weave's agent tracing workflows are also available in CoreWeave Agent Lens, which the docs call the successor to Weights & Biases Weave. Both services already receive your agent tracing data, so there is nothing to migrate.
Sources
- wandb/weave on GitHub
- W&B Weave README
- weave on npm
- weave on PyPI
- W&B Weave website
- Release v0.53.12 (Oct 13, 2026)
- Release v0.53.11 (Oct 13, 2026)
- Release v0.53.10 (Oct 13, 2026)
- Hacker News: Whitepaper: Current Best Practices for Training LLMs from Scratch
- Hacker News: Weave: Interactive Data Exploration Toolkit by Weights and Biases
- Devtoolwatch Board, the week of Oct 25–31, 2026
W&B Weave README badge
Maintainers can show the tool's weekly Board rank in their README:
[](https://index.devtoolwatch.com/tools/weave/)How this page is made: Devtoolwatch writes each review from the project's README, releases, package metadata and website, with an AI model, then checks every claim against the source it cites and drops what the sources don't support. The numbers come from Devtoolwatch's daily GitHub snapshots, GitHub's stargazer history, and the npm and PyPI download APIs. Spotted an error? Email [email protected].