Devtoolwatch BoardSkillOpt review
SkillOpt is a Python text-space optimizer that trains reusable natural-language skill documents for frozen LLM agents without changing model weights.
TL;DR
SkillOpt treats a compact skill document as the trainable state of a frozen agent. An optimizer model turns scored rollouts into bounded edits, and an edit is accepted only when it improves held-out validation. SkillOpt is for developers who want better agent behavior from an unchanged model. Its output is a deployable best_skill.md file.
- 18.8kGitHub stars
- +134new stars, week of Oct 25
- 6.4kdownloads a week, +19% vs 4-week avg
- #17in Agent frameworks this week
SkillOpt at a glance
- Category
- Agent frameworks
- Maintained by
- Microsoft (organization, @microsoft on GitHub)
- License
- MIT
- Language
- Python, HTML, JavaScript
- Repository
- github.com/microsoft/SkillOpt
- Website
- aka.ms/skillopt
- PyPI package
- skillopt 0.2.0
- Latest release
- v0.2.0 on GitHub, Jul 2, 2026
- First published
- May 8, 2026
What SkillOpt does
- SkillOpt runs a training loop of rollout, reflect, aggregate, select, update and evaluate on a single skill document.
- SkillOpt makes bounded add, delete and replace edits, with an edit budget that acts as a textual learning rate.
- SkillOpt accepts a candidate edit only when it strictly improves a held-out validation score in the default paper-style path.
- SkillOpt exports a compact best_skill.md, typically 300–2,000 tokens, that runs against the unchanged target model with zero added inference-time calls.
- SkillOpt-Sleep harvests coding agent session transcripts, mines recurring tasks, replays them offline, and consolidates validated skills nightly.
- SkillOpt supports chat and exec backends including OpenAI, Azure, Claude, Qwen, MiniMax, Codex, Claude Code, Cursor and Copilot.
- SkillOpt ships six built-in benchmarks: ALFWorld, SpreadsheetBench, SearchQA, DocVQA, OfficeQA and LiveMath.
How it works
SkillOpt is a Python package configured with YAML. A frozen target model runs tasks with the current skill and records scored trajectories. A separate optimizer model reflects on successes and failures and proposes edits. Held-out validation decides whether the candidate becomes the current skill. Backends connect to model APIs or agent CLIs such as Codex and Claude Code. An optional Gradio WebUI monitors training.
How to install and start using SkillOpt
With pip
pip install skilloptWebUI from source
pip install -e ".[webui]"Requirements
- Python 3.10 or newer.
- Access to a supported model backend, such as OpenAI, Azure OpenAI, Claude, Qwen or an OpenAI-compatible provider.
First steps
- Install SkillOpt with pip, using Python 3.10 or newer.
- Follow the versioned SkillOpt documentation for data preparation, training and evaluation commands, and configuration.
- Optionally launch the monitoring dashboard with python -m skillopt_webui.app, which binds to 127.0.0.1:7860 by default.
Who SkillOpt is for
- Developers improving a frozen LLM agent's procedure without fine-tuning model weights.
- Teams using Claude Code, Codex or Copilot who want nightly skill consolidation from past sessions.
- Researchers studying reproducible, validation-gated optimization of natural-language agent skills.
Limitations to know
- SkillOpt optimizes one skill document; the target model, backend and harness stay fixed.
- SkillOpt's integration plugin and MCP files for Claude Code, Codex, Copilot and Devin live in the repository, not the PyPI wheel.
- SkillOpt's main CLI keeps conservative defaults and does not expose every experiment-harness control as a flag.
- SkillOpt training needs scored tasks; new benchmarks require an adapter, data loader, scored rollout helper and YAML config.
Is SkillOpt growing? Usage data
In the week of Oct 25–31, 2026, SkillOpt ranked #171 on the Devtoolwatch Board and #17 in Agent frameworks, with a momentum score of 48 out of 100. Its main package had 6.4k downloads that week, +19% against its own 4-week average.
Show the weekly numbers
| Week of | New stars |
|---|---|
| Aug 9, 2026 | 269 |
| Aug 16, 2026 | 222 |
| Aug 23, 2026 | 221 |
| Aug 30, 2026 | 237 |
| Sep 6, 2026 | 263 |
| Sep 13, 2026 | 323 |
| Sep 20, 2026 | 334 |
| Sep 27, 2026 | 431 |
| Oct 4, 2026 | 221 |
| Oct 11, 2026 | 335 |
| Oct 18, 2026 | 166 |
| Oct 25, 2026 | 134 |
On Hacker News
- Microsoft Releases Open Source ML Library for Distributed Search Engine Creation, 57 points and 11 comments (Mar 6, 2019)
- Test Windows Phone 7 on iOs or Android, 19 points and 10 comments (Nov 29, 2011)
- Cassandra vs. DynamoDB vs. Cosmos DB: The Total Cost of (Non) Ownership, 18 points and 2 comments (Jun 26, 2017)
- Microsoft Joins Cloud Foundry Foundation, 18 points and 0 comments (Jun 13, 2017)
- Develop ASP.NET on a Mac using Sublime Text 3, 7 points and 0 comments (Aug 6, 2014)
The Board ranks tools by four signals each week: new stars, new stars for the repo's size, added downloads and download growth beyond the market. How the ranking works.
SkillOpt alternatives
Other AI agent frameworks on the Board in the week of Oct 25–31, 2026, by momentum:
| Rank | Tool | Stars | Downloads/wk |
|---|---|---|---|
| #1 | Harness²Harness² is a Python framework from Google Research for recursive agent harnessing, refining an agent's prompts, tools, memory and… | 21.7k | – |
| #2 | HyperFramesHyperFrames is an open-source framework that turns HTML, CSS, media, and seekable animations into deterministic MP4 videos, built for AI… | 76.6k | 1.5M |
| #3 | AgentScopeAgentScope is a Python agent framework with an SDK for building ReAct agents and an agent service backend with a web UI. | 35k | 51.4k |
| #4 | AG-UIAG-UI is an open, event-based protocol that standardizes how AI agents connect to user-facing frontend applications. | 16.9k | 4.6M |
| #5 | LangGraphLangGraph is a low-level orchestration framework and runtime for building, managing, and deploying long-running, stateful agents in… | 44.2k | 18.5M |
| #6 | BifrostOpen-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for… | 9.3k | – |
Recent SkillOpt releases
SkillOpt FAQ
Is SkillOpt free and open source?
Yes. SkillOpt's source code is on GitHub (microsoft/SkillOpt) under the MIT license, so you can use it for free.
How do I install SkillOpt?
Run pip install skillopt. The skillopt package needs Python 3.10 or newer. The install section above has the other options from the project's README.
Is SkillOpt still maintained?
Yes. The microsoft/SkillOpt repository was last updated on Oct 18, 2026, and the latest release, v0.2.0 on GitHub, came out on Jul 2, 2026.
How popular is SkillOpt?
SkillOpt has 18.8k GitHub stars as of Nov 1, 2026. It gained 134 new stars in the week of Oct 25–31, 2026, against a 12-week average of 263 a week. Its main package had 6.4k downloads that week, +19% against its own 4-week average. That made it #17 among AI agent frameworks on the Devtoolwatch Board.
What are the best alternatives to SkillOpt?
Other AI agent frameworks on the Devtoolwatch Board in the week of Oct 25–31, 2026, by momentum: Harness² (#1), HyperFrames (#2), AgentScope (#3), AG-UI (#4), LangGraph (#5). The alternatives table above has their numbers.
Does SkillOpt change model weights?
No. SkillOpt trains only the natural-language skill document. The target model stays frozen, and the deployed best_skill.md runs against the unchanged model with zero added inference-time model calls.
What is SkillOpt-Sleep?
SkillOpt-Sleep is a nightly offline self-evolution engine shipped in v0.2.0 as the skillopt-sleep CLI. It harvests coding agent session transcripts, mines recurring tasks, replays them, and consolidates skills behind a held-out validation gate.
Can SkillOpt use a provider not listed as a backend?
Yes, if the provider implements the OpenAI Chat Completions protocol. SkillOpt suggests trying the built-in openai_compatible backend before writing a new backend module.
Do trained SkillOpt skills transfer to other models?
According to the README, optimized skill artifacts transfer across model scales, between Codex and Claude Code harnesses, and to nearby benchmarks without further optimization.
Sources
- microsoft/SkillOpt on GitHub
- SkillOpt README
- skillopt on PyPI
- SkillOpt website
- Release v0.2.0 (Jul 2, 2026)
- Release v0.1.0 (Jun 2, 2026)
- Hacker News: Microsoft Releases Open Source ML Library for Distributed Search Engine Creation
- Hacker News: Test Windows Phone 7 on iOs or Android
- Hacker News: Cassandra vs. DynamoDB vs. Cosmos DB: The Total Cost of (Non) Ownership
- Devtoolwatch Board, the week of Oct 25–31, 2026
SkillOpt README badge
Maintainers can show the tool's weekly Board rank in their README:
[](https://index.devtoolwatch.com/tools/microsoft-skillopt/)How this page is made: Devtoolwatch writes each review from the project's README, releases, package metadata and website, with an AI model, then checks every claim against the source it cites and drops what the sources don't support. The numbers come from Devtoolwatch's daily GitHub snapshots, GitHub's stargazer history, and the npm and PyPI download APIs. Spotted an error? Email [email protected].