comet-ml/opik-mcp
View on GitHub ↗Model Context Protocol (MCP) server for Opik, the open-source LLM observability and evaluation platform, built by Comet. Read traces, log scores, and manage prompts from Claude Code, Cursor, or VS Code.
218 ★36 forksPythonUpdated 21d ago
What you need to know
Official MCP server for Opik, the open-source LLM observability and evaluation platform by Comet; lets you read traces, log scores, save prompt versions and ask Opik's in-product AI assistant (Ollie) investigative questions from any AI host.
Install
curl -LsSf https://astral.sh/uv/install.sh | sh # install uv once claude mcp add --transport stdio opik-mcp --env OPIK_API_KEY=<your-key> --env OPIK_WORKSPACE=<workspace> -- uvx opik-mcp Set OPIK_API_KEY (required) and OPIK_WORKSPACE (optional, defaults to 'default')
Usage
- •Ask 'list my Opik projects' — Claude calls the list tool and shows your workspace's projects
- •Use read/list to browse traces, spans, prompts, test suites and experiments; write to log spans, score, comment and save prompt versions
- •Use ask_ollie for investigative questions and run_experiment to run evaluation experiments end-to-end
Key features
- ✓Small outcome-oriented surface: read, list, ask_ollie, write, schema and run_experiment
- ✓Ollie in-product AI assistant with direct workspace access and mid-stream writes (YOLO mode default, audit-logged)
- ✓Universal write dispatcher with schema introspection for valid payload construction
- ✓stdio or streamable-http transport, self-hosted support via COMET_URL_OVERRIDE
Best for
LLM engineers already running Opik who want to drive observability and evaluation from their coding assistant.
Caveats
- ⚠Requires Python 3.13+; currently run via uvx until the first PyPI release
- ⚠ask_ollie and run_experiment are Comet Cloud only — they fail on self-hosted
- ⚠Cursor enforces a hard 60s tool-call timeout that does not reset on progress; long Ollie turns fail there
Platforms: macOS · Linux · WindowsClients: Claude Code · Cursor · VS Code Copilot · MCP Inspector
Reviewed 2026-08-11
Topics
- Stars
- 218★
- Forks
- 36
- Language
- Python
- License
- Apache-2.0
- Created
- 2025-03-11
- Last push
- 2026-08-14