llm-evaluation skills

52 tagged llm-evaluation, measured the same way as everything else here.

Browse within: evals 49llm-observability 43llm-ops 43sdlc 24benchmark 22game-development 20unreal-engine 20Multi-Agent 9llm-agents 9simulation-environment 9claude-code-plugin 7coding-agents 7agent-evaluation 6benchmarking 6

tracely

01

Jwuthri/Tracely-ai

Skill Claude CodeCodex

Instrument AI agents with Tracely and turn their production traces into CI gates. Use when the user mentions Tracely, tracely-ai, tracelysdk, the tracely CLI, or asks to trace/observe an AI agent, add LLM evaluators or LLM-as-a-judge columns, debug why a trace or conversation isn't showing up, wire agent regression…

not rated 1.5k 9d ago A SkillSpector: warn 120 tokens original MIT

benchmark-radar

02

ktwu01/benchmark-radar

Skill Codex

Find, inspect, and check AI benchmark records with the Benchmark Radar CLI. Use when a request needs benchmark discovery, details, recent Radar evidence, or local data health; do not assume why the user needs the results.

not rated 294 +6 changed 8d ago A SkillSpector: pass 48 tokens original MIT

adaptation-parity

04

benchflow-ai/agents

Skill Claude CodeCodex

Adapt an agent to run on BenchFlow (ACP) and verify it behaves identically inside the eval harness vs standalone — closing the eval↔prod gap. Use when adding a new agent to this repo or checking an existing one for eval/prod behavior parity.

not rated 11 3d ago A SkillSpector: pass 58 tokens original Apache-2.0

hermeneutic-gate

05

hermes-labs-ai/hermeneutic

Skill Claude CodeCodex

Run the hermeneutic deterministic English drift gate on an assistant draft before sending it when the draft contains numeric claims, completion language, universal quantifiers, or a summary of delegated work.

not rated 9 yesterday A 46 tokens original Apache-2.0

prompt_control_lab

06

VeraPyuyi/prompt_control_lab

Skill Claude CodeCodex

Guard and improve prompts before expensive Codex, IDE, or CLI agent work. Use when a prompt is vague, broad, risky, costly, or should be optimized before implementation.

not rated 7 19d ago A 40 tokens

report-repair

07

astandrik/my_instructions

Skill Claude Code

Repair invalid local report.json files by inserting required report fields.

not rated 6 23d ago A 16 tokens original MIT

test-contract

08

nob-git-dev/agent-skills

Skill Codex

A test-planning skill that turns a specification's requirements and acceptance conditions into observable results, test scenarios, evidence, and proof obligations. TDD means writing tests or defining expected behavior before implementation.

not rated 5 2mo ago A 85 tokens

get_board

09

icaro-lab/MASE

Skill Claude CodeCodex

Use this skill to inspect the current whiteboard.

not rated 5 6mo ago A 0 tokens original Apache-2.0

caliper

10

zhengbowenai-cmd/caliper

Skill Claude Code

Statistically test whether a prompt or SKILL.md change is actually better than the old version. Use when the user asks to compare two prompts, A/B test a prompt change, check if a recent edit really improved things, find rule conflicts in a long prompt, or identify which sections of a prompt are pulling weight.…

not rated 2 3mo ago A 93 tokens original MIT

textual

11

vinsonconsulting/califa-cards

Skill Claude CodeCodex

Build, style, and debug terminal user interfaces in Python with Textual. Use when the user mentions Textual, a TUI, App/Widget/Screen subclasses, reactive attributes, TCSS or Textual CSS, textual run, textual console, or compose(). Do NOT use for plain CLI argument parsing (use click-cli), Rich-only static output (use…

not rated 1 2mo ago A 88 tokens original Apache-2.0

vv-gate

12

lm203688/swarmlabs-engine-kit

Skill Claude Code

Use when an agent, harness, or CI pipeline produces a scientific/numeric prediction and you need an INDEPENDENT third-party adjudication of whether that claim is trustworthy before acting on it. Also use when you need to turn "the agent said it validated itself" into a blocking gate with a real exit code. Covers…

not rated 0 29d ago A 107 tokens original MIT

At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: