nasde-benchmark-from-history

nasde-benchmark-from-history is a skill for Claude Code from NoesisVision/nasde-toolkit. It costs 126 tokens per session (2,902 once invoked), scanned C, original, MIT.

A guide for creating NASDE benchmark tasks from a repository's Git history. A benchmark task is a repeatable coding problem used to evaluate an agent, and Git history records earlier code changes.

In plain words
What is it for?
Use it to inspect commits, diffs, and pull-request descriptions, then create self-contained benchmark tasks after confirming the proposed changes. It requires an existing NASDE benchmark project.
Why use it?
It helps turn real, already-solved engineering problems into realistic evaluation tasks. This avoids inventing benchmark examples unrelated to the team's work.

Skill for Claude Code

Written for Claude Code: installed under .claude/. Also seen: mentions Claude Code.

Needs its repository: it runs a file that does not travel with it, so clone the repository first. The line is bash /solution/solve.sh && mkdir -p /logs/verifier && bash /tests/test.sh.

Good fit Use it to inspect commits, diffs, and pull-request descriptions, then create self-contained benchmark tasks after confirming the proposed changes. It requires an existing NASDE benchmark project.

Compare 6 skills from other repositories ↓
Install

Getting it into your agent

It runs from inside its repository, so the clone comes first — what it calls does not travel with the file alone.

Clone the repo
git clone --depth 1 https://github.com/NoesisVision/nasde-toolkit
agentmods
npx agentmods add skills/noesisvision/nasde-toolkit/nasde-benchmark-from-history

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for nasde-benchmark-from-history

README.md
[![agentmods](https://agentmods.dev/badge/skills/noesisvision/nasde-toolkit/nasde-benchmark-from-history/github.svg)](https://agentmods.dev/skills/noesisvision/nasde-toolkit/nasde-benchmark-from-history)
Your own site
<a href="https://agentmods.dev/skills/noesisvision/nasde-toolkit/nasde-benchmark-from-history"><img src="https://agentmods.dev/badge/skills/noesisvision/nasde-toolkit/nasde-benchmark-from-history/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for nasde-benchmark-from-history

Your own site · 80×15
<a href="https://agentmods.dev/skills/noesisvision/nasde-toolkit/nasde-benchmark-from-history"><img src="https://agentmods.dev/badge/skills/noesisvision/nasde-toolkit/nasde-benchmark-from-history.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 126 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 2,902 The whole file, excluding the scripts and references it only reads on demand.
Security scan C 2 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00126 $0.02902
Opus 5 $0.00063 $0.01451
Sonnet 5 $0.00025 $0.00580
Haiku 4.5 $0.00013 $0.00290

Measured 11d ago against content hash 12de698c6ca6, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-10, from the pricing page.

Security

Grade C, and why

nasde-benchmark-from-history scanned grade C with 2 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 11d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Recursive force deletehighDestructive command

rm -rf with a variable or a broad path is one typo away from removing the wrong tree.

RUN apt-get update && apt-get install -y git curl wget ca-certificates && rm -rf /var/lib/apt/lists/*

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

RUN apt-get update && apt-get install -y git curl wget ca-certificates && rm -rf /var/lib/apt/lists/*
.claude/skills/nasde-benchmark-from-history/SKILL.md · 308 lines

How it starts

The opening of the file, as written. The whole thing — 308 lines — stays where its author put it; the contents beside it link to each section on GitHub.

NASDE Benchmark from Git History

Generate NASDE benchmark tasks by mining git history. You analyze commits, diffs, and PR descriptions to identify self-contained changes that make good evaluation candidates, then generate task files with user approval.

Prerequisites

  • A git repository with meaningful commit history (the repo you're currently in, or a path to another local repo)
  • An existing NASDE benchmark project (run nasde init first, or use the nasde-benchmark-creator skill)
  • If the benchmark project doesn't exist yet, create it first — this skill generates tasks, not the project scaffold

Critical: line endings on Windows (read this first)

When generating tests/test.sh, solution/solve.sh, or environment/Dockerfile on a Windows host, write them with LF line endings or every trial fails with bash: required file not found (the kernel reads #!/bin/bash\r as the shebang). See the full explanation and .gitattributes template in the nasde-benchmark-creator skill.

Quick rules:

  • The benchmark project MUST have a .gitattributes enforcing *.sh text eol=lf and Dockerfile text eol=lf. nasde init creates this. If the existing project lacks it, create .gitattributes before generating any task files.
  • When writing files programmatically, use path.write_text(content, encoding="utf-8", newline="") — never the bare default which translates \n\r\n on Windows.
  • Sanity-check after generation: find tasks/<new-task> -name '*.sh' -o -name 'Dockerfile' | xargs file | grep CRLF should print nothing.

Step 1: Identify the source repository and commit range

Ask the user:

  • Which repository? Default: the current working directory. Can also be a path to another local repo.
  • What commit range? Options:
    • A branch name (analyze all commits on that branch)
    • A commit range (abc123..def456)
    • Last N commits (HEAD~20..HEAD)
    • Specific PR numbers (if the repo has a GitHub remote, use gh pr view)
    • "Just show me good candidates" — scan the last 50 commits and filter

Read the full file on GitHub · 308 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 11d ago First seen · 308 lines · 126 tokens per session scan C 12de698c6ca6

Subscribe to this mod's changes

nasde-benchmark-from-history is a skill published in the GitHub repository NoesisVision/nasde-toolkit (13 stars, last pushed yesterday), licensed MIT. It adds 126 tokens to every session and 2,902 once invoked, about $0.0006 per session on Opus 5. A static security scan graded it C with 2 findings (recursive force delete, makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.