Getting it into your agent
One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.
npx skills add comet-ml/opik-mcp --skill opik-optimizegit clone --depth 1 https://github.com/comet-ml/opik-mcpWrote this? Show the measurements
A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.
[](https://agentmods.dev/skills/comet-ml/opik-mcp/opik-optimize)<a href="https://agentmods.dev/skills/comet-ml/opik-mcp/opik-optimize"><img src="https://agentmods.dev/badge/skills/comet-ml/opik-mcp/opik-optimize/github.svg" alt="Measured on agentmods" height="20"></a>Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.
<a href="https://agentmods.dev/skills/comet-ml/opik-mcp/opik-optimize"><img src="https://agentmods.dev/badge/skills/comet-ml/opik-mcp/opik-optimize.svg" alt="Reviewed on agentmods" width="80" height="20"></a>What it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5.1 | $0.00143 | $0.02478 |
| Opus 5.5 | $0.00057 | $0.00991 |
| Sonnet 5.5 | $0.00029 | $0.00496 |
| Haiku 4.5 | $0.00014 | $0.00248 |
Grade A, and why
opik-optimize scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 14d ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Nothing flagged
None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.
Copies of this mod
2 near-identical copies found in the catalogue:
- opik-optimize — 100% identical, 54 lines differ
- opik-optimize — 98% identical, 54 lines differ
How it starts
The opening of the file, as written. The whole thing — 101 lines — stays where its author put it; the contents beside it link to each section on GitHub.
Optimize — Improve a Prompt Against Data
Definition of done: an optimized prompt whose score on the metric beats the baseline on data it was not tuned on, the optimization run link in Opik, the cost of getting there, and the winner saved as a new prompt version (when the prompt lives in the library) — with the swap into code left as the next step. If the optimization can't run within a stated budget, stop at the first genuine blocker and return exactly one next step. A prompt that scores higher only on its own training items is not an improvement.
Operate: measure the baseline first, state the budget before spending it, hold data out, pick the algorithm for the failure you see, save the winner where it can be versioned — and change no application code. The only file this skill writes is a runner outside the repo; the prompt is saved to Opik, not into the codebase.
Inputs
The entry point is /opik-optimize <prompt-name> (a prompt-library prompt), /opik-optimize <path or function> (a prompt in code), or /opik-optimize (find the system prompt in this repo). Infer the rest; treat these as optional overrides:
- dataset (default: existing dataset for the project → export the regression suite → build from traces) · metric (default: heuristic on
expected_outputif present, else one binary judge) · algorithm (default:MetaPromptOptimizer) · budget (default:n_samples=50,max_trials=10) · model · validation split (default: hold out 20%).
Ask only at a genuine, non-inferable blocker (see Blockers).
Activation — the only in-scope work
1. Resolve the prompt
- Library:
client.get_chat_prompt(name)(orget_promptfor a text prompt). Note the currentversion— that is the baseline. - Code: grep for the system prompt /
messages=[...]; read it verbatim. Note where it lives; you will not edit it. - Trace: the
llmspan'sinput.messageson a representative trace.
The optimizer's opik_optimizer.ChatPrompt is a different class from the library's opik.ChatPrompt — build it from the raw messages yourself: references/sdk-snippets.md (Resolve the prompt).
What ships with it
11 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.
- evals/.gitignore 7 B
- evals/cases.yaml 2.5 KB
- evals/fixtures/format/pyproject.toml 114 B
- evals/fixtures/format/seed.py 2.5 KB runs code
- evals/grader.py 4.7 KB runs code
- evals/HARNESS.md 3.1 KB
- evals/metrics.py 2.4 KB runs code
- evals/run_evals.py 9.2 KB runs code
- references/examples.md 971 B
- references/output-shape.md 928 B
- references/sdk-snippets.md 1.1 KB
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 14d ago Changed · -51 lines 7ccac054c38d
- 19d ago Changed · +9 lines 6c2dc7409480
- 22d ago Changed 008305d6028f
- 26d ago First seen · 143 lines · 143 tokens per session scan A c5f7241f75fe
opik-optimize is a skill published in the GitHub repository comet-ml/opik-mcp (222 stars, last pushed 6d ago), licensed Apache-2.0. It adds 143 tokens to every session and 2,478 once invoked, about $0.0006 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-18.
Other skills, from other repositories
local-delegation
Regla y catálogo para delegar pasos mecánicos (resumir, clasificar, extraer, boilerplate, mensaje de commit desde un diff, traducir texto o archivo, resumir salida de lint/tests/CI, explicar código, describir una imagen, verificar si el backend local está disponible) a modelos locales vía las tools local del MCP…
add-prompt
Scaffold a new MCP prompt template. Use when the user asks to add a prompt, create a reusable message template, or define a prompt for LLM interactions.
openclaw-prompt-enhancer
Remote prompt engineering MCP server with 6 tools that turn weak prompts into powerful ones. Use when: (1) 'improve this prompt' or 'make my prompt better', (2) 'score this prompt' or 'rate prompt quality', (3) 'convert prompt to Claude format' or 'translate for Gemini', (4) 'generate system prompt' or 'create…
add-prompt
Scaffold a new MCP prompt template. Use when the user asks to add a prompt, create a reusable message template, or define a prompt for LLM interactions.
opik-optimize
Improve a prompt with the Opik Agent Optimizer — resolve the prompt, a dataset, and a metric, pick the algorithm, run a bounded optimization, check the gain on held-out data, and save the winner as a new prompt version with the optimization run link. Runs via the opik-optimizer package; reads prompts and datasets via…
add-prompt
Scaffold a new MCP prompt template. Use when the user asks to add a prompt, create a reusable message template, or define a prompt for LLM interactions.