langwatch
01Plugin Claude Code
Bundles 1 skill, 1 hook · 66 tokens together
Records which repository and branch each coding-agent session worked in, and teaches the agent to read its own traces back from LangWatch.
14 tagged Evaluation, measured the same way as everything else here.
Browse within: ai-tools 29browser-automation 29
Plugin Claude Code
Bundles 1 skill, 1 hook · 66 tokens together
Records which repository and branch each coding-agent session worked in, and teaches the agent to read its own traces back from LangWatch.
Plugin Claude Code
Bundles 3 skills · 282 tokens together
Skills for working with Langfuse, the open-source LLM engineering platform for tracing, prompt management, and evaluation.
Plugin Claude Code
Bundles 7 skills, 2 MCP servers · 149 tokens together
Open-source testing and regression detection framework for AI agents. Golden baseline diffing, CI/CD integration, works with LangGraph, CrewAI, OpenAI, Anthropic Claude, HuggingFace, Ollama, and MCP.
Plugin Claude Code
Bundles 2 skills · 75 tokens together
Benchmark, evaluate, and optimize skills to ensure reliable performance across all LLMs.
ContextJet-ai/awesome-llm-observability
Plugin Claude Code
Bundles 26 skills · 2,363 tokens together
26 Agent Skills (several with runnable, unit-tested scripts) for building, evaluating, securing, and monitoring reliable LLM & AI-agent apps.
redhat-community-ai-tools/harness-eval
Plugin Claude Code
Bundles 4 skills, 5 commands · 313 tokens together
Evaluate AI agent setups for best practices, redundancy, security, and cross-component issues.
Plugin Claude Code
Plugin marketplace listing 19 plugins: full-eval, hackathon-jury, vc-evaluator, oss-readiness, architect.
Plugin Claude Code
Bundles 1 skill, 6 commands, 1 agent, 3 hooks · 107 tokens together
The first universal judge for Claude Code & Cowork. Auto-evaluates skill and agent execution quality with 7-dimension scoring, configurable rubrics, and dual-mode operation (auto hooks + manual /judge command).
golemfoundation/octant-council-builder
Plugin Claude Code
Bundles 11 skills, 10 agents · 267 tokens together
Council builder — generates multi-agent evaluation councils, not a council itself.
Plugin Claude Code
Bundles 1 skill, 1 command · 117 tokens together
Evaluate a RAG/LLM app: generate a golden set from your docs, run LLM-as-judge + retrieval metrics, and produce a shareable HTML scorecard with a CI gate.
Plugin Claude Code
AI coding skill evaluator — 11-dimension session scoring, decision tracking, PR reports.
Plugin Claude Code
Bundles 33 skills, 1 MCP server · 2,497 tokens together
Author verifiable eval records through a draft → review → revise → submit loop with server-enforced graders; compile to JSONL/CSV/Inspect/lm-eval via MCP. STDIO or Streamable HTTP.
leonardoeverling-spec/governed-context
Plugin Claude Code
Bundles 1 skill, 1 MCP server · 92 tokens together
Governed memory (explicit states, fail-closed sensitivity gates, quarantine-only writes) as a dependency-free MCP server, plus a blind-evaluation protocol skill for honest A/B comparisons.
Plugin Claude Code
Bundles 24 skills, 3 commands, 1 MCP server · 2,186 tokens together
Cold-run your agent skills to find which ones change nothing, plus 24 skills that survived the same test.
At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: