evaluation-framework skills

14 tagged evaluation-framework, measured the same way as everything else here.

Browse within: agentic-ai 15llms 15vscode 15agent-evaluation 6coding-agents 6

evalbench-review

01

GoogleCloudPlatform/evalbench

Skill Claude Code

Review a change in the EvalBench repo for (a) does it actually work — verified by running the tests and style checks, (b) does it follow EvalBench architecture — base-class contracts, config-key registration, PYTHONPATH-relative imports, sandbox isolation, concurrency safety, docs, (c) does it still build and deploy …

not rated 59 +2 changed today A SkillSpector: warn 170 tokens original Apache-2.0

agentv-eval-writer

02

EntityProcess/agentv

Skill Claude CodeCodex needs its repo

Write, edit, review, and validate AgentV EVAL.yaml / .eval.yaml evaluation files. Use when asked to create new eval files, update or fix existing ones, add or remove test cases, configure graders (llm-rubric, script), review whether an eval is correct or complete, convert between EVAL.yaml and evals.json using agentv…

not rated 15 6d ago A 129 tokens original MIT

gauntlet-loop

03

israeldegasperi/gauntlet-loop

Skill Codex

Run Matt Shumer's Gauntlet Loop methodology to raise the quality of an artifact through cycles of building, independent critique, comparison against real references, and improvement. Use when the user asks for the Gauntlet Loop, a builder-critic process, adversarial critique, iterative refinement, or the creation of…

not rated 2 1mo ago A 95 tokens

At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: