CLI for benchmarks & evals of AI coding agents — on tasks you already understand, using your Claude / Codex / Gemini individual subscriptions or API keys.
Calibrate assessment rubrics by reviewing agent work in GitHub/GitLab PRs and feeding human comments back into the rubric. Use this skill when the user wants to: Calibrate, tune, or sanity-check assessment criteria / dimensions of a benchmark Review trial diffs alongside the LLM-as-a-Judge scores in a PR/MR…
Create coding agent benchmarks for evaluation with nasde. Use this skill when the user wants to: Create a new benchmark project (set of tasks for evaluating coding agents) Add tasks to an existing benchmark Create or modify agent variants (configurations that control agent behavior) Set up assessment dimensions and…
Generate benchmark tasks from git history of the current or specified repository. Use this skill when the user wants to: Create benchmark tasks based on real problems their team already solved (closed PRs, past commits, resolved issues) Mine git history for good evaluation candidates Turn a commit range or set of PRs…
Build diverse benchmark task suites from public GitHub repositories for testing universal skills. Use this skill when the user wants to: Create a benchmark that spans multiple public repositories and languages Test a universal skill (refactoring, test writing, code review, etc.) across diverse codebases Curate a…
Run coding agent benchmarks and verify results with nasde. Use this skill when the user wants to: Run a benchmark (all tasks, single task, specific variant) Re-run assessment evaluation on existing trial results Check or verify results in Opik (traces, feedback scores, experiments) Troubleshoot a failed benchmark run…
Internal skill for developing and maintaining nasde-toolkit itself. Use this skill when: Making changes to nasde-toolkit source code (CLI, runner, evaluator, config, agents) Refactoring or adding features to the toolkit Fixing bugs in the evaluation pipeline Updating dependencies or integration points (Harbor, Opik…
Provides Python patterns for type-first development with dataclasses, discriminated unions, NewType, and Protocol. Must use when reading or writing Python files.
Skill "refactor" from NoesisVision/nasde-toolkit, covering refactor, when to use, refactoring principles, the golden rules and when not to refactor.
★not rated 12 10d agoA0 tokens
copy · 97%MIT
At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: