Getting it into your agent
One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.
npx skills add tmuskal/arc-agi-benchmarker --skill setupgit clone --depth 1 https://github.com/tmuskal/arc-agi-benchmarkerWrote this? Show the measurements
A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.
[](https://agentmods.dev/skills/tmuskal/arc-agi-benchmarker/setup)<a href="https://agentmods.dev/skills/tmuskal/arc-agi-benchmarker/setup"><img src="https://agentmods.dev/badge/skills/tmuskal/arc-agi-benchmarker/setup.svg" alt="Measured on agentmods" height="20"></a>What it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5.1 | $0.00023 | $0.04031 |
| Opus 5 | $0.00012 | $0.02015 |
| Sonnet 5 | $0.00005 | $0.00806 |
| Haiku 4.5 | $0.00002 | $0.00403 |
Grade C, and why
setup scanned grade C with 3 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 8d ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Asks for rootmediumPrivilege escalation
A mod that escalates privileges can change anything on the machine, not only the project.
> - Ubuntu/Debian: `sudo apt install python3.12` Reads agent configuration directoriesmediumAgent snooping
.claude/, .codex/, .gemini/ hold keys, settings and other credentials a mod has no legitimate need for.
os.path.expanduser('~/.claude/settings.json'), Runs shell commandslowCapability
Expected in a hook, worth knowing in a rule or an instructions file.
result = subprocess.run(['claude', 'plugins', 'list', '--json'], The source is not reproduced here
No licence file
A repository with no LICENSE is all rights reserved by default, so the body is not copied here. The metadata, the measurements and the link are.
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 8d ago First seen · 474 lines · 23 tokens per session scan C 0ba60a2e527a
setup is a skill published in the GitHub repository tmuskal/arc-agi-benchmarker (3 stars, last pushed 4mo ago), with no licence file. It adds 23 tokens to every session and 4,031 once invoked, about $0.0001 per session on Opus 5. A static security scan graded it C with 3 findings (asks for root, reads agent configuration directories, runs shell commands). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.
Other skills, from other repositories
bim-validation-report
Generate comprehensive BIM model validation reports. Check data quality, completeness, and compliance with standards.
adversarial-empirical-review
N-round adversarial review pipeline for empirical research output — the chain from data to LaTeX tables to a manuscript that cites them. A Claude drafter proposes minimal diffs, a deterministic mechanical battery gates every diff from a clean state with a regression gate, a Codex reviewer files check-backed critiques…
oversee-nca-dual-control-qc
Establishes whether an NCA quality-control pass was structurally sound, rather than assuming it from the words dual control. It classifies independence on an explicit scale - same script rerun through to different software entirely - and records whether the checker saw the primary results first, expresses scope as…
ieee-experiments
Design and audit IEEE communications simulation and numerical-results sections for JSAC, TWC, TCOM, WCL, and CL. Covers benchmark schemes, Monte-Carlo protocol, BER/SER/outage/rate/EE metrics, SNR/antenna/user sweeps, analysis-vs-simulation validation, convergence and complexity, learning-based evaluation, ISAC…
testing-assistant
Design pytest suites for scientific calculations, numerical edge cases, and regression protection.
pkpd-modeling
Pharmacokinetic and pharmacodynamic modelling and simulation - non-compartmental analysis, compartmental and population PK, PK/PD and exposure-response, TMDD, PBPK orientation, bioequivalence, allometric scaling and first-in-human dose, drug interaction prediction, and Bayesian therapeutic drug monitoring. Use when…