evaluation skills

393 tagged evaluation, measured the same way as everything else here.

Browse within: benchmark 60harness 55leaderboard 39datasets 34gpt 33cyanheads 32evals 32grader 32inspect-ai 32lm-eval-harness 32ai-observability 30awesome-list 29awesome 28genai 26

autorag-setup

01

Marker-Inc-Korea/AutoRAG

Skill Claude CodeCodex

Configure AutoRAG for first use or repair its single-agent model, approved document roots, retrieval indexes, datasource skills, and health checks without exposing credentials.

5.1k 3d ago A 36 tokens

autorag

02

Marker-Inc-Korea/AutoRAG

Skill Claude CodeCodex

Use an already configured AutoRAG librarian agent to search, summarize, compare, and answer questions from local document collections. Use autorag-setup for configuration or indexing changes.

5.1k 3d ago A 38 tokens

trulens-diagnosis

03

truera/trulens

Skill Claude CodeCodex

Diagnose low evaluation scores and generate actionable improvement recommendations.

3.5k 4d ago A 17 tokens original MIT

agent-improve

05

langwatch/langwatch

Skill Claude CodeCodex

Turns production evidence into tested improvements for your AI agent. Forms hypotheses from real traces and analytics, explains the reasoning behind each one, then executes with the user: scenario tests that reproduce production failures, prompt and code changes as reviewable PRs, new evaluators and monitors that…

3.5k 2d ago A 85 tokens original Apache-2.0

connect-agent

06

langwatch/langwatch

Skill Claude CodeCodex

Connect the codebase's AI agent to LangWatch agent simulations over HTTP, so test suites run against it from the platform. Finds or adds the agent's chat endpoint, wires authentication for scenario traffic, makes the server adopt the W3C traceparent header so the judge reads the agent's own traces, registers the agent…

3.5k 2d ago A 97 tokens original Apache-2.0

prompt-optimization

07

langwatch/langwatch

Skill Claude CodeCodex

Improve a prompt on the evaluations workbench through a measured loop. Score the baseline first, then duplicate the target column, form a hypothesis from failing rows, edit the copy's prompt draft, run, compare pass rate and cost, and repeat until the numbers hold. Use when the user asks to optimize or improve a…

3.5k 2d ago A 105 tokens original Apache-2.0

evalscope

08

modelscope/evalscope

Skill Claude CodeCodex

LLM evaluation & inference performance testing via the evalscope CLI. Translates natural language requests into evalscope commands for: (1) Model accuracy evaluation — runs 160+ benchmarks against local checkpoints or API endpoints (OpenAI-compatible, Anthropic, LiteLLM); (2) Performance stress testing — TTFT, TPOT…

3.3k 2d ago A 197 tokens original Apache-2.0

yao-meta-skill

09

yaojingang/yao-meta-skill

Skill Claude CodeCodex

Create, improve, or evaluate an existing skill from workflows, prompts, SOPs, scripts. Use for migration/release/package, routing, evals/tests, install/trust checks, 优化已有 skill, 补 trigger 评测. Exclude summary/translation/docs, brainstorming, one-off prompts, copy-only edits, outline-only requests.

2.6k 15d ago A 76 tokens original MIT

ceo-setup

10

suyoumo/ClawProBench

Skill Claude CodeCodex

One-time onboarding for the executive/manager commitment workflow — delegation-heavy, meeting prep, decision capture, morning and evening digests. Creates a commitments project and installs two dashboard widgets. After successful setup this skill is excluded from selection until the marker file is deleted.

823 7d ago A 60 tokens original Apache-2.0

developer-setup

11

suyoumo/ClawProBench

Skill Claude CodeCodex

One-time onboarding for the developer workflow — installs github-workflow missions, creates the commitments workspace, registers per-repo projects, writes calibration memories. After successful setup this skill is excluded from selection until the marker file is deleted.

823 7d ago A 49 tokens original Apache-2.0

portfolio

12

suyoumo/ClawProBench

Skill Claude CodeCodex

Cross-chain DeFi portfolio discovery, rebalancing suggestions, and NEAR Intent construction. Activates when the user pastes a wallet address or asks about yield/positions/rebalancing. Bootstraps a per-user "portfolio" project, aggregates positions across all the user's addresses inside one project, and offers a…

823 7d ago A 69 tokens original Apache-2.0

claude-authenticity

13

agentscope-ai/OpenJudge

Skill Claude CodeCodex

Detect whether an API endpoint is backed by genuine Claude (not a wrapper, proxy, or impersonator) using 9 weighted rule-based checks that mirror the claude-verify project. Also extracts injected system prompts from providers that override Claude's identity. Fully self-contained — copy the code below and run, no extra…

807 29d ago A 121 tokens original Apache-2.0

metric-design

14

agentscope-ai/OpenJudge

Skill Claude CodeCodex

Use when the user has evaluation principles or a dataset but needs help choosing the right graders, designing evaluation metrics, creating LLM-as-judge prompts, combining multiple metrics into a composite score, or building an automated evaluation pipeline. Also use when the user mentions grader selection, metric…

807 29d ago A 88 tokens original Apache-2.0

align-human

15

agentscope-ai/OpenJudge

Skill Claude CodeCodex

Use when the user has a judge/grader and human-labeled data, and wants to measure how well the judge agrees with humans, detect systematic biases, determine whether automatic evaluation can replace human review, or build a human-reduction roadmap. Also use when the user mentions calibration, TPR/TNR, judge validation…

807 29d ago A 100 tokens original Apache-2.0

api-caller

17

NVIDIA/SkillEvaluator

Skill Claude CodeCodex

Call any REST API dynamically. Make GET, POST, PUT, DELETE requests to any endpoint with custom headers and JSON body.

357 2d ago A 29 tokens original Apache-2.0

calculator

18

NVIDIA/SkillEvaluator

Skill Claude CodeCodex

Evaluate mathematical expressions and unit conversions. Handles arithmetic, percentages, exponents, and common unit conversions (temperature, distance, weight). No external dependencies.

357 2d ago A 32 tokens original Apache-2.0

NVIDIA/SkillEvaluator

Skill Claude CodeCodex

Use when converting an existing benchmark, rubric, verifier, task YAML/JSON, or domain check into SkillEvaluator BYOG/BYOT custom evaluation.

357 2d ago A 35 tokens original Apache-2.0

layerlens

20

LayerLens/stratix-python

Skill Claude CodeCodex

Evaluate AI outputs with LayerLens. Upload traces, create judges, run evaluations, and retrieve quality scores -- all from within OpenClaw.

260 4d ago A 31 tokens original Apache-2.0

hegelion

21

Hmbown/Hegelion

Skill Claude CodeCodex

Dialectical reasoning and autocoding via Hegelion MCP tools.

171 5mo ago A 17 tokens original MIT

protein-qc

22

adaptyvbio/protein-design-skills

Skill Claude CodeCodex

Quality control metrics and filtering thresholds for protein design. Use this skill when: (1) Evaluating design quality for binding, expression, or structure, (2) Setting filtering thresholds for pLDDT, ipTM, PAE, (3) Checking sequence liabilities (cysteines, deamidation, polybasic clusters), (4) Creating multi-stage…

157 2mo ago A 140 tokens original MIT

auto-improve

23

crimeacs/auto-improve

Skill Claude CodeCodex

GAN-style iterative improvement loop for any text artifact. Mutates a file, grades each change against a rubric with a SEPARATE model, keeps only verified wins (pairwise-judged), reverts the rest. The git history is the improvement log. Use when the user wants to autonomously improve the quality of a document, email…

132 29d ago A 87 tokens original MIT

code-reviewer

24

hidai25/eval-view

Skill Claude CodeCodex

Performs comprehensive code reviews with security, quality, and best practice checks.

132 9d ago A 18 tokens original Apache-2.0