Calibre-Labs/reforge-ai-evals

Open-source AI evals toolkit: skills that guide AI coding agents to write eval rubrics, eval datasets (User Input Grid), trace codes, code evaluators and LLM-as-a-judge prompts. From the Reforge AI Evals course by Calibre.

74Stars on the repository

17Mods indexed here, across every type

todayLast push, which is what freshness is scored on

MITLicence, which decides whether bodies are shown

Sort Relevance Recently updated Fewest tokens Security grade Repo stars Stars this week Top rated 1 mods

ai-evals

Calibre-Labs/reforge-ai-evals

Plugin Claude Code

Bundles 8 skills, 8 commands · 892 tokens together

Skills for evaluating an AI product: write the eval rubric, build test inputs, turn trace notes into codes, write judges and check them against your labels. You annotate traces and label for calibration. The skills do the rest.

not rated 74 +1 today A tokens not measured original MIT