Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.
NVIDIA/SkillEvaluator is a framework for checking and evaluating AI-agent skills, which are instruction folders that extend an agent's behavior. Skill authors and agent developers use it to validate quality and security, detect overlap, generate evaluation data, and measure skills through live agent tests. The catalogue entries are skills for running these evaluation workflows.
Skill Claude CodeCodex ✓ vendor
Call any REST API dynamically. Make GET, POST, PUT, DELETE requests to any endpoint with custom headers and JSON body.
Skill Claude CodeCodex ✓ vendor
Evaluate mathematical expressions and unit conversions. Handles arithmetic, percentages, exponents, and common unit conversions (temperature, distance, weight). No external dependencies.
Skill Claude CodeCodex ✓ vendor
Use when converting an existing benchmark, rubric, verifier, task YAML/JSON, or domain check into SkillEvaluator BYOG/BYOT custom evaluation.
Skill Claude CodeCodex ✓ vendor
Required for 4+ step requests; add tasks at start and update status after each step.
Skill Claude CodeCodex ✓ vendor
Analyze text content and produce statistics including word count, line count, character count, most frequent words, and readability metrics. Works on any plain text input provided inline or from a file path.
At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: