speckit-companion: Command for Claude Code

.claude/commands/bench-sync.md

bench-sync is a command for Claude Code from alfredoperez/speckit-companion. It costs 13 tokens per session (546 once invoked), scanned B, original, MIT.

A synchronization command for refreshing two benchmark sandboxes with the latest local companion extension and the checked-in SpecKit templates. It copies the canonical example project into both variant folders and prepares them for testing.

In plain words
What is it for?
Use it after changing the extension, updating the SpecKit command-line tool, or setting up the benchmark on a new machine.
Why use it?
It prevents benchmark runs from using outdated code or templates. This keeps comparisons aligned with the current project version.

Command for Claude Code

Written for Claude Code: allowed-tools in frontmatter.

This is alfredoperez/speckit-companion's own configuration. It tells Claude Code how to work on speckit-companion itself, so it is not a mod to install elsewhere. Copy it as a starting point and replace the rules that are about this project. Everything speckit-companion configures →

Needs its repository: it reads a path above its own folder, which exists only inside the repository. The line is Bash(node ../speckit-bench/sync-templates.mjs:*), Bash(node ../speckit-bench/run-all.mjs:*), Bash(specify:*), Bash(uv tool:*), Bash(npm run compile:*).

Reuse

Borrowing it

Nothing to install: this file belongs to alfredoperez/speckit-companion. Take a copy, put it at the same path in your own repository, and replace the rules that are about this project with yours.

Copy the file
curl -O https://raw.githubusercontent.com/alfredoperez/speckit-companion/main/.claude/commands/bench-sync.md
Clone the repo
git clone --depth 1 https://github.com/alfredoperez/speckit-companion

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for bench-sync

README.md
[![agentmods](https://agentmods.dev/badge/commands/alfredoperez/speckit-companion/bench-sync/github.svg)](https://agentmods.dev/commands/alfredoperez/speckit-companion/bench-sync)
Your own site
<a href="https://agentmods.dev/commands/alfredoperez/speckit-companion/bench-sync"><img src="https://agentmods.dev/badge/commands/alfredoperez/speckit-companion/bench-sync/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for bench-sync

Your own site · 80×15
<a href="https://agentmods.dev/commands/alfredoperez/speckit-companion/bench-sync"><img src="https://agentmods.dev/badge/commands/alfredoperez/speckit-companion/bench-sync.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 13 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.
When invoked 546 The whole file, excluding the scripts and references it only reads on demand.
Security scan B 1 finding. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00013 $0.00546
Opus 5 $0.00006 $0.00273
Sonnet 5 $0.00003 $0.00109
Haiku 4.5 $0.00001 $0.00055

Measured 2d ago against content hash 411fe06f6ec2, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-09, from the pricing page.

Security

Grade B, and why

bench-sync scanned grade B with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Unrestricted tool accessmediumExcessive agency

A wildcard tool grant or "run any command" leaves no least-privilege boundary at all.

allowed-tools: Bash(node ../speckit-bench/sync-templates.mjs:*), Bash(node ../speckit-bench/run-all.mjs:*), Bash(specify:*), Bash(uv tool:*), Bash(npm run compile:*)
.claude/commands/bench-sync.md · 36 lines

What it actually says

Your task

Bake the bench cells so a round measures current tooling. The harness lives in the sibling speckit-bench repo; the app it measures lives in conduit. Nothing it writes lands in this repo.

1. Compile the extension first

The driver dispatches the same per-step preamble the GUI does, imported from dist/ai-providers/promptPreamble.js. Build it:

npm run compile

2. Bake

node ../speckit-bench/sync-templates.mjs --sizes easy,medium,hard,oversized

Defaults are --speckit latest --ext latest, which is what a measured round wants:

  • --speckit latest installs the spec-kit CLI from GitHub source (uv tool install specify-cli --from git+https://github.com/github/spec-kit.git --force) — the only build that carries specify extension. --speckit keep leaves whatever is installed.
  • --ext latest installs the Companion spec-kit extension from the rolling companion-latest release asset. --ext code installs from this checkout's speckit-extension/ with --dev (use it to measure unreleased work). --ext <tag> pins an archived release.

The bake reflinks the app clone per cell (instant, node_modules included — no dependency install), runs specify init, arms each cell for its arm, tags a git baseline, and fails loudly if any cell file mentions the bench. It records the spec-kit CLI version, the spec-kit extension version and the Companion version into cells.json, and every result row carries all three.

If the app clone is missing, the script prints the one-time clone command. Run it once per laptop.

3. Report

Print the three versions the bake recorded and confirm the cell count. Say which arm each letter carries only if the user asks — the letters are opaque on purpose, and node ../speckit-bench/run-all.mjs --dry-run prints the table when it is wanted.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 2d ago Changed · +3 lines · -10 tokens per session scan A → B 411fe06f6ec2
  2. 10d ago First seen · 33 lines · 23 tokens per session scan A 4460d504af85

Subscribe to this mod's changes

bench-sync is a command published in the GitHub repository alfredoperez/speckit-companion (88 stars, last pushed yesterday), licensed MIT. It adds 13 tokens to every session and 546 once invoked, about $0.0001 per session on Opus 5. A static security scan graded it B with 1 finding (unrestricted tool access). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other commands, from other repositories