An assistant for Comet Opik, a system for tracking and evaluating applications that use large language models. It helps manage prompts and projects and inspect records of model activity, measurements, and experiments.

Use it to add Opik tracking to an LLM app, manage prompt versions, organize workspaces and projects, and investigate traces, metrics, and experiments.

It gives teams a way to investigate how an LLM application behaves and keep prompt versions organized. It also covers account, workspace, API-key, and self-hosted setup details.

Comet Opik — Agent for Claude Code by github/awesome-copilot

About the project

Awesome GitHub Copilot is a community collection of custom agents, instructions, skills, hooks, workflows, plugins, and configuration for GitHub Copilot. It helps Copilot users customize coding and development tasks. Catalogue entries are individual Copilot add-ons from this collection.

github/awesome-copilot · 40,052 stars · on GitHub

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Clone the repo

git clone --depth 1 https://github.com/github/awesome-copilot

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

README.md

[![agentmods](https://agentmods.dev/badge/agents/github/awesome-copilot/comet-opik/github.svg)](https://agentmods.dev/agents/github/awesome-copilot/comet-opik)

Your own site

<a href="https://agentmods.dev/agents/github/awesome-copilot/comet-opik"><img src="https://agentmods.dev/badge/agents/github/awesome-copilot/comet-opik/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

Your own site · 80×15

<a href="https://agentmods.dev/agents/github/awesome-copilot/comet-opik"><img src="https://agentmods.dev/badge/agents/github/awesome-copilot/comet-opik.svg" alt="Reviewed on agentmods" width="80" height="20"></a>

Per session 38 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.

When invoked 2,469 The whole file, excluding the scripts and references it only reads on demand.

Security scan A 2 findings. A grade says what 26 rules found in the file — not that it is safe.

Origin original No closer match found in the catalogue.

Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

Model	Per session	Once invoked
Fable 5.1	$0.00038	$0.02469
Opus 5.5	$0.00015	$0.00988
Sonnet 5.5	$0.00008	$0.00494
Haiku 4.5	$0.00004	$0.00247

Measured 1mo ago against content hash 9e94d6ed183c, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

Comet Opik scanned grade A with 2 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 1mo ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Unrestricted tool accesslowExcessive agency

A wildcard tool grant or "run any command" leaves no least-privilege boundary at all.

tools: ['*']

Downgraded: this mod is about security review, or the phrase is quoted, so it is likely naming the pattern rather than instructing it.

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

- For scripted diagnostics, prefer CLI over raw HTTP. When CLI is unavailable (minimal containers/CI), replicate the requests with `curl`:

Origin

Copies of this mod

2 near-identical copies found in the catalogue:

Comet Opik — 100% identical, 0 lines differ
Comet Opik — 100% identical, 0 lines differ

agents/comet-opik.agent.md · 173 lines

How it starts

The opening of the file, as written. The whole thing — 173 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Comet Opik Operations Guide

You are the all-in-one Comet Opik specialist for this repository. Integrate the Opik client, enforce prompt/version governance, manage workspaces and projects, and investigate traces, metrics, and experiments without disrupting existing business logic.

Prerequisites & Account Setup

User account + workspace
- Confirm they have a Comet account with Opik enabled. If not, direct them to https://www.comet.com/site/products/opik/ to sign up.
- Capture the workspace slug (the <workspace> in https://www.comet.com/opik/<workspace>/projects). For OSS installs default to default.
- If they are self-hosting, record the base API URL (default http://localhost:5173/api/) and auth story.
API key creation / retrieval
- Point them to the canonical API key page: https://www.comet.com/opik/<workspace>/get-started (always exposes the most recent key plus docs).
- Remind them to store the key securely (GitHub secrets, 1Password, etc.) and avoid pasting secrets into chat unless absolutely necessary.
- For OSS installs with auth disabled, document that no key is required but confirm they understand the security trade-offs.
Preferred configuration flow (opik configure)
- Ask the user to run:
```
pip install --upgrade opik
opik configure --api-key <key> --workspace <workspace> --url <base_url_if_not_default>
```
- This creates/updates ~/.opik.config. The MCP server (and SDK) automatically read this file via the Opik config loader, so no extra env vars are needed.
- If multiple workspaces are required, they can maintain separate config files and toggle via OPIK_CONFIG_PATH.
Fallback & validation
- If they cannot run opik configure, fall back to setting the COPILOT_MCP_OPIK_* variables listed below or create the INI file manually:
```
[opik]
api_key = <key>
workspace = <workspace>
url_override = https://www.comet.com/opik/api/
```
- Validate setup without leaking secrets:
```
opik config show --mask-api-key
```
  or, if the CLI is unavailable:
```
python - <<'PY'
from opik.config import OpikConfig
print(OpikConfig().as_dict(mask_api_key=True))
PY
```
- Confirm runtime dependencies before running tools: node -v ≥ 20.11, npx available, and either ~/.opik.config exists or the env vars are exported.

Read the full file on GitHub · 173 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

1mo ago First seen · 173 lines · 38 tokens per session scan A 9e94d6ed183c

Subscribe to this mod's changes

Comet Opik is an agent published in the GitHub repository github/awesome-copilot (40,052 stars, last pushed today), licensed MIT. It adds 38 tokens to every session and 2,469 once invoked, about $0.0002 per session on Opus 5.5. A static security scan graded it A with 2 findings (unrestricted tool access, makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Analytics and metrics Data and AI agent-skills agents ai github-copilot hacktoberfest prompt-engineering

Comet Opik

Getting it into your agent

Wrote this? Show the measurements

What it costs to keep this loaded

Grade A, and why

Unrestricted tool accesslowExcessive agency

Makes network callslowCapability

Copies of this mod

How it starts

Comet Opik Operations Guide

Prerequisites & Account Setup

What this file has done since we first saw it

Other agents, from other repositories

data

prompt-pipeline-runner

prompt-ux-designer

ml-analytics-ml-requirements-engineer

data-scientist

Prompt Builder