Getting it into your agent
One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.
npx agentmods add instructions/dfieser/hea-bench/claude-mdgit clone --depth 1 https://github.com/dfieser/hea-benchWrote this? Show the measurements
A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.
[](https://agentmods.dev/instructions/dfieser/hea-bench/claude-md)<a href="https://agentmods.dev/instructions/dfieser/hea-bench/claude-md"><img src="https://agentmods.dev/badge/instructions/dfieser/hea-bench/claude-md.svg" alt="Measured on agentmods" height="20"></a>What it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5 | $0.00873 | $0.00873 |
| Opus 5 | $0.00436 | $0.00436 |
| Sonnet 5 | $0.00175 | $0.00175 |
| Haiku 4.5 | $0.00087 | $0.00087 |
Grade A, and why
hea-bench CLAUDE.md scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 4d ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Nothing flagged
None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.
What it actually says
hea-bench — rules that override defaults
-
Agents operate this repo (commits, pushes, releases). Optimize every rule, doc, and process for agents by default: enforce mechanically (hooks, CI) rather than by convention, write mechanical sequences rather than advice, and make error messages name the exact fix. A fresh agent session that has read nothing should still be forced into the right behavior.
-
Shipping = pushing. Any push to
maintouchingsrc/**,web/**,src-tauri/**,server.json, orpyproject.tomlauto-releases all four surfaces (PyPI, MCP registry, desktop exe, web site) via theAuto releaseworkflow. Do not hand-tag or bump versions for routine changes; push, then confirm the run goes green withgh run list. Opt out with[no-release]in the head commit message. -
The pre-push hook runs the release preflight; do not fight it. Pushing a shippable path triggers
python tools/preflight.py(every locally runnable release gate plus the external-registry metadata limits) viatools/git-hooks/pre-push, enabled by the same one-per-clonegit config core.hooksPath tools/git-hooksas the commit-msg hook. Agent push sequence, mechanically: (1)git push— the hook runs the preflight and refuses a failing push; (2) fix whatever it names and push again, NEVER--no-verifyand never delete a check; (3)gh run listand watch theAuto releaserun to green. Green means PyPI, the MCP registry, the GitHub Release and the live site are verified; it does NOT wait for the desktop exe, which is a 15-20 minute Rust build that nobody waits for. Never watch or wait fordesktop-build: if it fails,release.ymlopens an issue labelleddesktop-buildthat mentions and assigns the owner, so the owner is emailed by GitHub; a later session fixes it and re-firesgh workflow run release.yml --ref vX.Y.Z. Heed preflight's "gate NOT pre-verified" warnings before touching benchmark, corpus, split, or web-parity code. If a release ever fails for a reason the preflight did not catch, the fix commit must also add the check and a RELEASING.md catalog row — checks are only added, never removed. -
The one version number lives in
src/hea_bench/__init__.py; the only legal way to change it ispython tools/version.py --set X.Y.Z. -
NEVER touch the GitHub↔Zenodo integration; it can irreversibly fork the concept DOI. See
RELEASING.mdfor everything about releases. -
No AI attribution, anywhere, ever. Never add a
Co-Authored-Bytrailer naming an AI or agent, and never list one as an author, contributor, creator, or reviewer in commit messages,CITATION.cff,.zenodo.json,README.md,CONTRIBUTING.md, release notes, or the web app. Credit named humans only. Acommit-msghook intools/git-hooks/rejects such trailers; enable it once per clone withgit config core.hooksPath tools/git-hooks. The 101 historical commits that carry the old trailer are deliberately left alone, because rewriting them would move every tag and put the Zenodo-linked releases at risk. -
Credit external reporters and reviewers in the CHANGELOG entry, the README acknowledgements, and the GitHub release notes, in the form the person asks for. Ask before publishing a name that arrived by private email.
-
Library usage (API, units, pinned sanity values):
AGENTS.md.
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 4d ago First seen · 56 lines · 873 tokens per session scan A 07f8d3dbc8ac
hea-bench CLAUDE.md is an instructions file published in the GitHub repository dfieser/hea-bench (1 stars, last pushed 10d ago), licensed MIT. It adds 873 tokens to every session, about $0.0044 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.
Other instructions, from other repositories
calc-mcp CLAUDE.md
Claude Code instructions for coo-quack/calc-mcp, covering project rules, tech stack, commands, project structure and tool architecture.
math-mcp-learning-server AGENTS.md
AGENTS.md instructions for clouatre-labs/math-mcp-learning-server, covering math mcp learning server - python mcp server [production], stack, structure, commands and project-specific patterns.
calculator-mcp-server AGENTS.md
AGENTS.md instructions for cyanheads/calculator-mcp-server, covering agent protocol, mcp surface, security model, what's next? and core rules.
calculator-mcp-server CLAUDE.md
Claude Code instructions for cyanheads/calculator-mcp-server, covering agent protocol, mcp surface, security model, what's next? and core rules.
blockrun-mcp AGENTS.md
AGENTS.md instructions for BlockRunAI/blockrun-mcp, covering blockrun mcp, commands, project structure, key dependencies and install in codex.
openrouter-mcp-multimodal AGENTS.md
AGENTS.md instructions for stabgan/openrouter-mcp-multimodal, covering agent instructions, before you ship, releasing (read this before publishing), short version and version files (must all match package.json).