benchmark-accuracy

A benchmark-scoring workflow for Bankstatemently, a tool that converts bank statements into structured transaction data.

In plain words
What is it for?
Use it to convert a published benchmark statement, compare the extracted transactions with the expected data, and report extraction, integrity, and overall scores.
Why use it?
It helps measure how accurately a conversion worked instead of relying only on a visual check.

Skill for Claude CodeCodex

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add skills/bankstatemently/plugins/benchmark-accuracy
Any agent
npx skills add bankstatemently/plugins --skill benchmark-accuracy
Clone the repo
git clone --depth 1 https://github.com/bankstatemently/plugins

Made for: Claude Code, Codex.

Per session 37 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 216 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00037 $0.00216
Opus 5 $0.00018 $0.00108
Sonnet 5 $0.00007 $0.00043
Haiku 4.5 $0.00004 $0.00022

Measured yesterday against content hash 695e54431ca3, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

benchmark-accuracy scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured yesterday.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

bankstatemently/skills/benchmark-accuracy/SKILL.md · 22 lines

What it actually says

Benchmark

Input: a benchmark statement id, PDF URL, or free-text benchmark request. Output: extraction accuracy, integrity score, overall score, and major failure categories, citing the benchmark statement id and converted document content_hash.

Treat the input as a benchmark statement id, PDF URL, or free-text benchmark request.

Follow this sequence:

  1. Read the benchmark catalog resource and choose the named published statement.
  2. Convert the benchmark PDF with convert_statement.
  3. Fetch the converted data with get_statement using original data mode.
  4. Pass the benchmark statement id and original parsed transactions to evaluate_benchmark.
  5. Present extraction accuracy, integrity score, overall score, and any major failure categories. Cite the benchmark statement id and converted document content_hash.

Example prompt: Convert and score the published bsb-004 benchmark statement.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. yesterday First seen · 22 lines · 37 tokens per session scan A 695e54431ca3

Subscribe to this mod's changes

benchmark-accuracy is a skill published in the GitHub repository bankstatemently/plugins (1 stars, last pushed 2d ago), licensed MIT. It adds 37 tokens to every session and 216 once invoked, about $0.0002 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

exec

Execute plan tasks sequentially using subagents. Use when user says 'exec', 'execute plan', 'run plan', or wants to implement a plan file task by task with isolated subagents.

umputun/cc-thingz · 41 tokens

pr

Comprehensive PR/issue review - analyzes architecture, tests, identifies unrelated changes mixed in, drafts review comment or issue comment. Use when user asks to review a PR, check a PR, look at PR changes, or comment on an issue.

umputun/cc-thingz · 51 tokens

backlog

Read, work, and maintain a Git repo's deferred-work items in docs/backlog/, one file per item. Use when the user says "backlog", "check backlog", "what's on my backlog", "work the backlog", "address the backlog", "add to backlog", "clean up backlog", or when a review or task produced items that are real but not being…

umputun/cc-thingz · 96 tokens

ask-codex

Consult OpenAI Codex for investigation, debugging, or code review. Use when user explicitly asks to "ask codex", "check with codex", "codex review", or as a last resort when stuck after 4+ failed attempts at debugging, investigation, or bug fix and completely out of ideas. Codex is slow (2-5 min), so only escalate…

umputun/cc-thingz · 103 tokens

clarify

This skill should be used when user appears confused, frustrated, or shows misalignment between expectations and reality. Triggers on phrases like "I don't understand", "this doesn't make sense", "confused", "wait, shouldn't it...", "why is this happening", "I thought X did Y", contradictory statements, or frustration…

umputun/cc-thingz · 91 tokens

brainstorm

Use before any creative work or significant changes. Activates on "brainstorm", "let's brainstorm", "deep analysis", "analyze this feature", "think through", "help me design", "explore options for", or when user asks for thorough analysis of changes, features, or architectural decisions. Guides collaborative dialogue…

umputun/cc-thingz · 87 tokens