eval skills

76 tagged eval, measured the same way as everything else here.

Browse within: skills 58harness-engineering 55sdd 55spec 55LLM 18AI Safety 8prompt-engineering 8skill 6Evaluation 5agent 5

comet-build

01

rpamis/comet

Skill Codex

A Comet workflow step for turning an approved design into an implementation plan and completed code changes. Comet is the project workflow system described by the add-on.

not rated 3.2k +25 changed 12d ago A Socket: passSnyk: passSkillSpector: pass 36 tokens original MIT

skillgrade-graders

02

mgechev/skillgrade

Skill Claude CodeCodex needs its repo

Authors deterministic, LLM rubric, and human graders for skillgrade evaluations. Use when creating scoring scripts, writing evaluation rubrics, setting up human review workflows, or combining multiple graders with weighted scoring. Don't use for setting up eval pipelines, configuring eval.yaml defaults, or general…

not rated 725 +5 changed 4d ago A SkillSpector: pass 63 tokens original MIT

evalbench-review

03

GoogleCloudPlatform/evalbench

Skill Claude Code

Review a change in the EvalBench repo for (a) does it actually work — verified by running the tests and style checks, (b) does it follow EvalBench architecture — base-class contracts, config-key registration, PYTHONPATH-relative imports, sandbox isolation, concurrency safety, docs, (c) does it still build and deploy …

not rated 59 +2 changed today A SkillSpector: warn 170 tokens original Apache-2.0

NVIDIA/digital-health-skills

Skill Claude CodeCodex ✓ vendor

Stage 3 of Clinical ASR Flywheel. Score a NeMo manifest, produce the five-section KER leaderboard (by-ipasource diagnostic). Not for ASR auth (/riva-asr).

not rated 11 14d ago A 51 tokens

eval-driven-dev

05

yiouli/pixie-qa

Skill Claude CodeCodex

Improve AI application with evaluation-driven development. Define eval criteria, instrument the application, build golden datasets, observe and evaluate application runs, analyze results, and produce a concrete action plan for improvements. ALWAYS USE THIS SKILL when the user asks to set up QA, add tests, add evals…

not rated 9 5mo ago A 89 tokens copy · 100% MIT

commit-writer

06

HystonKayange/skill-probe

Skill Claude Code

Use this skill when the user wants to commit, write a commit message, or save their staged or current changes with a clear message to git history.

not rated 6 3mo ago A 34 tokens original MIT

skillsmith

07

daronthedragon/skillsmith

Skill Claude Code

Build, lint, and evaluate agent skills that demonstrably change behaviour, instead of writing adjectives that change nothing. Use whenever the user asks to create a skill, write a SKILL.md, improve or fix an existing skill, make a skill "actually work", or evaluate whether a skill does anything. Also use when the user…

not rated 2 1mo ago A 116 tokens original MIT

invarianteval

08

AlpharomeroJL/invarianteval

Skill Claude CodeCodex

Before finalizing structured or extracted output in a domain with declared safety invariants, verify the output against your invariant suite and refuse to ship when a locked field was model-auto-filled. Invoke when the user or task involves high-stakes structured extraction, compliance fields, or pass/fail results…

not rated 1 3mo ago A 67 tokens original MIT

At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: