evals skills

374 tagged evals, measured the same way as everything else here.

Browse within: gemini-cli 54ci-cd 44agent-observability 43clickhouse 43javascript 42Chatbots 41hermes 36adr 33agentic-sdlc 33benchmark 33Evaluation 32cyanheads 32grader 32inspect-ai 32

e2e-tests-studio

01

mastra-ai/mastra

Skill Claude CodeCodex

REQUIRED when modifying any file in packages/playground-ui or packages/playground. Triggers on: React component creation/modification/refactoring, UI changes, new playground features, bug fixes affecting studio UI. Generates Playwright E2E tests that validate PRODUCT BEHAVIOR, not just UI states.

28k +33 today A 67 tokens

factory-rereview

02

mastra-ai/mastra

Skill Claude CodeCodex

Re-review a pull request after a push — reconcile the previous review against the new commits, look for new defects the push introduced, then a fresh pass over the whole PR, and finish with a verdict on the PR.

28k +33 changed today A 48 tokens

codemod-patterns

03

mastra-ai/mastra

Skill Claude CodeCodex

This guide helps AI agents efficiently create codemods with optimal performance and consistency.

28k +33 today A 0 tokens

create-adapter

04

harbor-framework/harbor

Skill Claude CodeCodex

Scaffold a new Harbor benchmark adapter by running harbor adapter init and then guide implementation using the Adapters Agent Guide as the authoritative spec.

4.9k +72 today A 34 tokens original Apache-2.0

rewardkit

05

harbor-framework/harbor

Skill Claude CodeCodex

Write Harbor task verifiers using Reward Kit. Use when creating or editing a task's tests/ directory, adding grading criteria, setting up LLM/agent judges, or designing verifiers that produce a reward score.

4.9k +72 changed today A 46 tokens original Apache-2.0

harbor-framework/harbor

Skill Claude CodeCodex

Create or reuse Hugging Face dataset PRs for harborframework/parity-experiments and upload Harbor parity/oracle result folders efficiently with sparse checkout, raw git pushes, and Git LFS.

4.9k +72 today A 49 tokens original Apache-2.0

excalidraw

07

ShenSeanChen/waku-agent

Skill Claude CodeCodex

Generate an Excalidraw whiteboard in Sean's hand-drawn video style (Excalifont, roughness 1, green signature, socials + watermark, source labels). Use whenever the user wants a whiteboard, diagram, teaching board, or "chart" for a video or the docs/whiteboards gallery — anything Sean will film with.

1.6k +20 4d ago A 77 tokens original MIT

review-pr

08

ShenSeanChen/waku-agent

Skill Claude CodeCodex

Walk Sean through an incoming waku-agent PR or issue and present it his way — four fixed sections: what this is, why it matters, how HE can test it with you as copilot, and are we ready to merge / reply / close and why. Use whenever Sean asks to look at, test, triage, or decide on a pull request or an issue, and…

1.6k +20 4d ago A 93 tokens original MIT

ship

09

ShenSeanChen/waku-agent

Skill Claude CodeCodex

Commit and push the current work properly — lint, run the release gate, write a detailed commit message, push to GitHub. Use whenever work reaches a milestone or the user says ship it, commit, or push.

1.6k +20 4d ago A 46 tokens original MIT

compose-graphics

10

Jwuthri/Tracely-ai

Skill Claude CodeCodex

Advanced Compose visuals - Material 3 Expressive motion physics, AGSL shaders (Android 13+), Canvas/DrawScope generative, graphicsLayer effects.

1.2k +2 3d ago A 36 tokens original MIT

compose-motion

11

Jwuthri/Tracely-ai

Skill Claude CodeCodex

Jetpack Compose animation foundations - animateAsState, AnimatedVisibility, Crossfade, updateTransition, SharedTransitionLayout, gestures.

1.2k +2 3d ago A 29 tokens original MIT

paint

12

Jwuthri/Tracely-ai

Skill Claude CodeCodex

Paint a complete visual universe with genjutsu - art direction brainstorm, design system, implementation, audit. Anti-AI-slop design pipeline. Adapts to Web, Android (Compose), Apple (SwiftUI).

1.2k +2 3d ago A 46 tokens original MIT

skillforge

13

tripleyak/SkillForge

Skill Claude CodeCodex

Use when creating, improving, finding, or auditing agent skills - the user says 'create a skill', 'do I have a skill for X', 'improve the X skill', 'which skill should I use', asks whether a skill exists for a task, or wants to validate, test, evaluate, package, or health-check skills. Also use for skill ecosystem…

884 1mo ago A 92 tokens original MIT

sample-skill

14

tripleyak/SkillForge

Skill Claude CodeCodex

Use when validating the SkillForge validator itself - exercises every supported frontmatter feature: boolean user-invocable, an allowed-tools block list, and nested metadata with an inline list.

884 1mo ago A 40 tokens original MIT

benchflow-ai/benchflow

Skill Claude CodeCodex

Review Benchflow or SkillsBench task-run trajectories and integration-test Benchflow code changes. Use this skill whenever the user asks to audit traj health, failed or timed-out runs, healthy pass/fail/timeout status, no-skill leakage, skill loading, reward hacking, verifier isolation, metadata completeness, token…

335 2d ago A 99 tokens original Apache-2.0

benchflow-ai/benchflow

Skill Claude CodeCodex

Find a local Claude Code or Codex session, open the BenchFlow trajectory viewer, and submit it after the user reviews it. Use this skill whenever someone pastes a BenchFlow eval prize line, wants to submit / share / contribute / upload a trajectory, set up traj upload, view a session, or pick a session to send. Also…

335 2d ago A 98 tokens original Apache-2.0

benchflow

17

benchflow-ai/benchflow

Skill Claude CodeCodex

Run agent benchmarks, create tasks, analyze results, and manage agents using BenchFlow. Use when asked to benchmark an AI coding agent, run a benchmark suite, create tasks, view trajectories, or compare agent performance.

335 2d ago A 46 tokens original Apache-2.0

ZSeven-W/craft-skills

Skill Claude CodeCodex

Develop and evaluate logo concepts when the explicit design problem is semantic fusion: two or more brand meanings must share a contour, stroke, negative space, glyph skeleton, or shape system. Use for fusion-focused design or redesign, critique, comparison, or prompt-only work on a logo, symbol, app icon, monogram…

142 +4 10d ago A 104 tokens original Apache-2.0

ZSeven-W/craft-skills

Skill Claude CodeCodex

Generate new raster assets that must contain native pixel transparency, then verify the untouched PNG or WebP before delivery. Use for transparent stickers, sprites, character cutouts, product assets, and furry or fine-edged subjects where background removal would be unacceptable. Do not use to remove a background…

142 +4 10d ago A 85 tokens original Apache-2.0

ZSeven-W/craft-skills

Skill Claude CodeCodex

Create, audit, and repair short page-native diary comics around an existing authorized recurring character, with story-directed page rhythm, exact dialogue, directional-surface proof, and original-resolution visual QA. Use when extending an established recurring-character series from an anecdote, conversation, dream…

142 +4 10d ago A 129 tokens original Apache-2.0

effect-v3-to-v4

21

NiceEval/NiceEval

Skill Claude CodeCodex

Use when migrating a codebase from Effect v3 to Effect v4, upgrading effect or any @effect/ package across the v3/v4 boundary.

139 2d ago A 38 tokens

herdr

22

NiceEval/NiceEval

Skill Claude CodeCodex

Control Herdr, a terminal multiplexer for coding agents. Use only when the user explicitly mentions Herdr or asks to use Herdr to inspect or control panes, tabs, workspaces, commands, or another agent. Do not use merely because a task could benefit from a background terminal, delegation, or parallel work. Requires…

139 2d ago A 74 tokens

testing

23

NiceEval/NiceEval

Skill Claude CodeCodex

Inspect, select, author, modify, or review NiceEval E2E and Unit test owners. Use when a change needs a test strategy, an existing test must be traced to its Feature or Use Case, or a bug requires public-entry E2E TDD.

139 2d ago A 56 tokens

dotnet-inspect

24

AgentEvalHQ/AgentEval

Skill Claude CodeCodex

Query .NET APIs across NuGet packages, platform libraries, and local files. Search for types, list API surfaces, compare and diff versions, find extension methods and implementors. Use whenever you need to answer questions about .NET library contents.

138 2d ago A 54 tokens original MIT