falsify-spec

falsify-spec is a skill for Claude Code, Codex from tmusser/ai-engineering-skills. It costs 34 tokens per session (1,038 once invoked), scanned A, original, MIT.

An adversarial review of a SPEC.md file, a document that states what software must do and how it will be accepted. It looks for a plausible wrong implementation that could still pass the written checks.

In plain words
What is it for?
It helps pressure-test acceptance criteria, boundaries, data meanings, regression points, and verification demonstrations in a software specification.
Why use it?
It finds ambiguous requirements and weak acceptance checks before coding creates false confidence. It turns those gaps into source-backed checks that distinguish correct from incorrect behavior.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Good fit It helps pressure-test acceptance criteria, boundaries, data meanings, regression points, and verification demonstrations in a software specification.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/tmusser/ai-engineering-skills/falsify-spec
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add tmusser/ai-engineering-skills --skill falsify-spec
Clone the repo
git clone --depth 1 https://github.com/tmusser/ai-engineering-skills

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for falsify-spec

README.md
[![agentmods](https://agentmods.dev/badge/skills/tmusser/ai-engineering-skills/falsify-spec/github.svg)](https://agentmods.dev/skills/tmusser/ai-engineering-skills/falsify-spec)
Your own site
<a href="https://agentmods.dev/skills/tmusser/ai-engineering-skills/falsify-spec"><img src="https://agentmods.dev/badge/skills/tmusser/ai-engineering-skills/falsify-spec/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for falsify-spec

Your own site · 80×15
<a href="https://agentmods.dev/skills/tmusser/ai-engineering-skills/falsify-spec"><img src="https://agentmods.dev/badge/skills/tmusser/ai-engineering-skills/falsify-spec.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 34 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,038 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00034 $0.01038
Opus 5.5 $0.00014 $0.00415
Sonnet 5.5 $0.00007 $0.00208
Haiku 4.5 $0.00003 $0.00104

Measured 5d ago against content hash 49b2ac0ec794, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

falsify-spec scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 5d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

skills/falsify-spec/SKILL.md · 100 lines

How it starts

The opening of the file, as written. The whole thing — 100 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Falsify Spec

Purpose

Find the plausible wrong implementation that still passes the written spec. Pressure-test acceptance criteria before coding, not the code after it ships.

This is an optional adversarial pass between mini-spec and implementation. It does not replace source grooming, the deterministic spec_gate.py auditability check, test-mini, or post-implementation verify-contract.

When to use

Invoke as /falsify-spec or ask "What wrong implementation could pass this spec?" Use selectively when a spec is written but an ambiguous boundary, regression seam, data meaning, or potentially weak acceptance test could produce false confidence. Skip when the slice is trivial and already unambiguous.

Do not activate merely because mini-spec ran or the skill is installed. If a usable spec does not exist yet, write one with mini-spec first.

Inputs

  • Current SPEC.md with acceptance criteria, non-goals, invalid-if constraints, verification demo, and any declared authoritative references
  • Original user request and directly relevant tests, schemas, code, or fixtures
  • Named compatibility seams and any known baseline behavior

Workflow

  1. Read authority narrowly. Inspect SPEC.md, the original request, and only sources that govern the candidate boundary. Record discrepancies; source silence is not evidence of an intended requirement.
  2. Pick at most three high-consequence targets. Prefer criteria that could pass shallow tests while breaking the user's intended outcome, a preserved behavior, or a named non-goal. Do not generate a generic test checklist.
  3. Construct a concrete counterexample. For each target, name a plausible implementation, an input or state, and its observable output. Explain which written acceptance criterion/test it passes and what intended behavior it would violate. If it cannot plausibly pass, discard it.
  4. Classify the basis. A counterexample is SOURCE_BACKED only when the violated expectation has a locator in the request or a governing source. Otherwise label it HYPOTHESIS, not a proven defect or new requirement.
  5. Find the smallest discriminator. Propose one precise acceptance-criterion delta and, when feasible, one focused negative/regression test or manual probe that rejects the counterfeit while allowing valid behavior. Keep original source semantics, scope ceilings, permissions, and existing tests intact.
  6. Resolve ownership correctly. For SOURCE_BACKED gaps, recommend updating the existing SPEC.md and proof target before implementation. For HYPOTHESIS gaps that require a product choice, mark DECISION_REQUIRED; do not silently turn them into acceptance criteria.
  7. Stop. Report at most three counterexamples in a single compact response. If explicitly authorized, amend the existing spec; otherwise propose the exact delta for the operator to accept. Do not create FALSIFICATION.md, a second contract, or a mandatory new workflow stage.

Read the full file on GitHub · 100 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 5d ago First seen · 100 lines · 34 tokens per session scan A 49b2ac0ec794

Subscribe to this mod's changes

falsify-spec is a skill published in the GitHub repository tmusser/ai-engineering-skills (6 stars, last pushed 5d ago), licensed MIT. It adds 34 tokens to every session and 1,038 once invoked, about $0.0001 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-10-21.

Related

Other skills, from other repositories

code-review

Use this skill to systematically review code changes for correctness, security, performance, maintainability, and test coverage. Activates after implementation, before merging, or when asked to review a pull request or code change. Produces a structured review report with findings categorized by severity.

karthikrshet/aiskills · 56 tokens

tdd

Use this skill to practice test-driven development — writing tests before implementation, using tests to drive design, and validating implementation against pre-written tests. Activates when implementing new functionality, refactoring code, or fixing bugs where regression coverage is needed.

karthikrshet/aiskills · 53 tokens

bug-diagnosis

Use this skill to systematically diagnose the root cause of a bug before attempting a fix. Activates when a bug is reported, a test is failing, or unexpected behavior is observed. Prevents guess-and-check debugging that introduces additional bugs while chasing symptoms.

karthikrshet/aiskills · 60 tokens

skill-release-gate

Evaluate an Agent Skill bundle for structural integrity, trigger quality, artifact improvement, script correctness, safety, installed-tree integrity, and target-host portability before release.

rohitg00/ai-engineering-from-scratch · 36 tokens

mcore-testing

Test system for Megatron-LM. Covers test layout, recipe YAML structure, adding and running unit and functional tests, golden values, marker filters, and CI parity.

NVIDIA/skills · 38 tokens

i4h-catheter-navigation-e2e

End-to-end smoke for catheter navigation covering setup, digital twin, DRR, and unit tests. Use when asked to run the full catheter workflow smoke or demo the v0.7 pipeline.

NVIDIA/skills · 49 tokens