Actually Useful Agent Observability
Grafana Agent Observability is an SDK and plugin collection that collects telemetry from coding agents and AI agents built into applications, including sessions, tool calls, traces, tokens, costs, generations, and evaluations. Developers use it to monitor coding-agent usage or instrument agents in their own services, with SDKs for several programming languages. The catalogue add-ons help configure and use this observability workflow with coding agents.
This repository also configures its own agents. See what agento11y tells them →
Skill Claude CodeCodex ✓ vendor
Set up Grafana Agent observability for a coding agent (Claude Code, Codex, Copilot CLI, Cursor, OpenCode, pi, Vibe, or experimental Kiro CLI) with the agento11y binary: install it, save credentials, wire the agent, verify a session reaches Grafana Cloud, and diagnose a broken pipeline. Use when the user says "set up…
Skill Claude CodeCodex ✓ vendor
You are running in Opencode with repository files and shell access.
Skill Claude CodeCodex ✓ vendor
Run any Python LLM agent as an Agent Observability experiment using the public agento11y.experiments package: define a test suite, run an existing agent through typed trials, bind or record generation I/O, grade outputs, and publish scores, including from stored Grafana test suites.
Skill Claude CodeCodex needs its repo ✓ vendor
Use early in an AI-agent project — before ship, before real traffic — to decide which evaluations to set up and to scaffold a starter experiment. Reads the agent's own code (system prompt, tools, task), recommends specific evaluators with reasons that cite real lines, and writes a labeled draft test suite as an Agent…
Skill Claude CodeCodex ✓ vendor
Help choose, configure, and test local agento11y guard packs for coding-agent tool calls. Use when the user asks to enable safety packs, protect .env files, block dangerous commands, redact tool arguments, create custom local rules, or diagnose local guards. Covers local packs, not Grafana Cloud rule management or…
Skill Claude CodeCodex ✓ vendor
Optional credential-free Hermes integration checks using an explicit loopback model provider and local telemetry receivers. Inspect the scripts before running them; their defaults are not safe evidence of a local-only run.
At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: