202 tagged evals, measured the same way as everything else here.
Browse within: gemini-cli 55ai-coding 50llm-evaluation 49adr 45agentic-sdlc 45llm-observability 43llm-ops 43hermes 37agentic-ai 34Evaluation 33agent 33cyanheads 33grader 33inspect-ai 33
Skill Claude CodeCodex
Write Harbor task verifiers using Reward Kit. Use when creating or editing a task's tests/ directory, adding grading criteria, setting up LLM/agent judges, or designing verifiers that produce a reward score.
Skill Claude CodeCodex
Research report on companies, competitors, markets or products: research a company, compare competitors, market landscape, funding, pricing, launches. Also to save a brief, summary or snapshot built from search results.
Skill Claude CodeCodex
Instrument AI agents with Tracely and turn their production traces into CI gates. Use when the user mentions Tracely, tracely-ai, tracelysdk, the tracely CLI, or asks to trace/observe an AI agent, add LLM evaluators or LLM-as-a-judge columns, debug why a trace or conversation isn't showing up, wire agent regression…
Skill Claude Code
Use when creating, improving, finding, or auditing agent skills - the user says 'create a skill', 'do I have a skill for X', 'improve the X skill', 'which skill should I use', asks whether a skill exists for a task, or wants to validate, test, evaluate, package, or health-check skills. Also use for skill ecosystem…
Skill Claude CodeCodex
Incorporate feedback from an independent code reviewer to improve your solution. The reviewer is a different agent that analyzed your work.
Skill Codex
Generate new raster assets that must contain native pixel transparency, then verify the untouched PNG or WebP before delivery. Use for transparent stickers, sprites, character cutouts, product assets, and furry or fine-edged subjects where background removal would be unacceptable. Do not use to remove a background…
Skill Claude Code
Run, read, and diagnose a skill's Caliper eval — its success rate over k attempts, whether it fires, and whether it beats the agent without it. Use when the user wants to run, validate, interpret, or compare a skill's eval, or write an .eval.yaml spec whose tasks they have already decided.
Skill Claude CodeCodex
Use this skill whenever asked to write a "status report" file.
Skill Claude CodeCodex
Query .NET APIs across NuGet packages, platform libraries, and local files. Search for types, list API surfaces, compare and diff versions, find extension methods and implementors. Use whenever you need to answer questions about .NET library contents.
Skill Claude Code needs its repo
Use when accepted ADRs exist and AD.md must be produced or updated as unified architecture documentation.
Skill Claude Code
Demo skill for the Skill Eval Harness example. Use it to review a proposed change and label the severity of each finding.
Skill Claude CodeCodex
Run AXIS, read its reports, navigate its project layout, and interpret scores. Use when the user asks to run AXIS, invoke the CLI, run a specific profile or suite, compare runs, explain a score, find a regression, manage baselines, or understand where AXIS writes its files.
Skill Claude CodeCodex
Prepare dynobox packages for release to npm. Use this skill whenever the user asks to release, publish, ship, bump, or cut a version of any dynobox package — including dry runs, version bumps, changelog updates, and git tagging. Also trigger when the user asks about the release process or wants to verify publish…
Skill Claude CodeCodex
Use after meaningful instruction changes; replay behavior, test controls, and independently verify improvement.
Abhillashjadhav/AI-PM-essential-skills
Skill Claude Code
Use this skill when a user wants to compress verbose model output, shorten a draft, reduce token usage, or improve the signal-to-noise ratio of any text. Triggers on phrases like "make this shorter", "compress this", "too verbose", "reduce tokens", "cut this down", "rewrite more concisely", or when a user pastes a…
Skill Claude Code
Publish an already validated report to an external release destination.
chris-short/respect-the-oracle
Skill Claude CodeCodex
Use when working against a test suite, spec, or graded harness you do not own - especially inside an automated loop scored on how many tests pass - and tempted to change the tests, weaken assertions, hardcode expected outputs, special-case inputs, or overfit the visible examples to turn things green.
Skill Claude CodeCodex
Use Stet to measure whether an AI coding change is safe to ship. Trigger on model comparisons, AGENTS.md or CLAUDE.md effectiveness, shared instruction, policy, skill, harness, tool-policy, reasoning, or runtime rollouts, repo eval setup, dataset building, regression detection, benchmarking, promote/rollback…
Skill Claude CodeCodex
Set up the skills-evals library in a repository — discover agent artifacts, interview the user about what to test, scaffold eval cases, and wire CI and local runners. Use when the user wants to set up skills-evals, test their agent skills, add evals for skills or custom agents, check why a skill isn't triggering, or…
Skill Codex
Run a security and dependency audit for agent systems, tool-using AI apps, MCP/A2A integrations, or security-sensitive AI-generated code. Check slopsquatting risk, tool shadowing, rug pulls, memory/context poisoning, secrets, unsafe permissions, and common CWE patterns. Use when asked for security review, dependency…
Skill Claude CodeCodex
Improve and verify agent work after repeated failures, in dependency-heavy tasks, or when optimization claims need baseline and regression evidence. Use for DAGx/Perfectify requests, failed retries, risky multi-step work, or requests to verify an improvement. Exclude routine questions, drafting, one-step edits, and…
Skill Claude CodeCodex needs its repo
Evaluate an existing agent skill with Promptfoo-native behavior, routing, or role-play tests. Use when a skill needs executable evidence that its product promise works. Do not use to author the domain skill itself.
Skill Claude CodeCodex needs its repo
A skill for carrying out useful in-scope work when the user gives broad permission to act independently. It selects work, performs it, verifies the result, records what happened, and stops when no useful work remains.
CarolMonroe22/supabase-db-supervisor
Skill Claude CodeCodex
Fresh-eyes supervision pass for any database work an AI agent just built (schema, RLS policies, migrations, edge functions touching the database, storage policies). The builder never grades its own homework - a separate agent plays the "Investigate" role, proves who-can-see-what with real queries, and gives an…
At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: