mutation-testing

mutation-testing is a skill for Claude Code from nikeyes/stepwise-dev. It costs 97 tokens per session (1,491 once invoked), scanned A, original, Apache-2.0.

A test-strength checker that makes small, bug-like changes to production code and sees whether the test suite detects them. Unlike code coverage, which shows what ran, it checks whether tests would catch changed behaviour.

In plain words
What is it for?
Use it to check a file, a branch's changes, or selected changed files for surviving mutations and weak tests.
Why use it?
It finds tests that execute code but would still miss common mistakes. The identified gaps can be passed to test-driven development (TDD), a practice of writing a failing test before fixing the code.

Skill for Claude Code

Written for Claude Code: shipped in a Claude Code plugin.

Part of the stepwise-core plugin — 14 skills, 10 agents shipped together

Good fit Use it to check a file, a branch's changes, or selected changed files for surviving mutations and weak tests.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/nikeyes/stepwise-dev/mutation-testing
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add nikeyes/stepwise-dev --skill mutation-testing
Clone the repo
git clone --depth 1 https://github.com/nikeyes/stepwise-dev

Made for: Claude Code.

Or install stepwise-core, the plugin that ships this one along with the rest of its 14 skills, 10 agents.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for mutation-testing

README.md
[![agentmods](https://agentmods.dev/badge/skills/nikeyes/stepwise-dev/mutation-testing/github.svg)](https://agentmods.dev/skills/nikeyes/stepwise-dev/mutation-testing)
Your own site
<a href="https://agentmods.dev/skills/nikeyes/stepwise-dev/mutation-testing"><img src="https://agentmods.dev/badge/skills/nikeyes/stepwise-dev/mutation-testing/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for mutation-testing

Your own site · 80×15
<a href="https://agentmods.dev/skills/nikeyes/stepwise-dev/mutation-testing"><img src="https://agentmods.dev/badge/skills/nikeyes/stepwise-dev/mutation-testing.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 97 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,491 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00097 $0.01491
Opus 5.5 $0.00039 $0.00596
Sonnet 5.5 $0.00019 $0.00298
Haiku 4.5 $0.00010 $0.00149

Measured 8d ago against content hash a78d379c8bc0, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

mutation-testing scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 8d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

core/skills/mutation-testing/SKILL.md · 92 lines

How it starts

The opening of the file, as written. The whole thing — 92 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Mutation Testing

Answers one question: "If I introduced a bug here, would a test fail?" Coverage tells you a line was executed; mutation testing tells you a change to that line would be detected.

Attribution: Adapted from eferro's skill-factory (Apache-2.0), itself based on Paul Hammond's mutation-testing skill.

Usage

/mutation-testing <file>                 # whole module
/mutation-testing                        # branch diff: git diff main...HEAD plus uncommitted changes
/mutation-testing --changed <files...>   # only changed hunks: git diff HEAD -- <files>; untracked files whole
/mutation-testing --tool [...]           # force the project's mutation tool (see Modes)

Only production code is mutated. Skip test files, generated code and pure configuration.

Modes

  • Mental (default): you generate mutants by reading the code and reason about whether the tests would fail. Fast, works in any language, leaves the working tree untouched except for the empirical checks below.
  • Tool: run the project's mutation tool restricted to the scope. Use it when --tool is passed or the project already configures one (stryker.config.*/stryker.conf.*, [tool.mutmut] in pyproject.toml/setup.cfg, the pitest plugin in pom.xml/build.gradle*). See the tool reference for the scoped command.

Never install a mutation tool or add its configuration. If --tool is passed and no tool is set up, say so and continue in mental mode.

Workflow

  1. Resolve scope. List the production files and, for diff modes, the changed line ranges.
  2. Check the baseline. Run the tests that cover the scope. If they fail, stop and report: mutation results are meaningless on a red suite.
  3. Generate mutants. For each function in scope, apply the operators in operators.md plus the language reference: python.md, javascript.md (JS/TS), java.md, kotlin.md. Favor the high-yield operators listed there; skip mutants that would not compile. In tool mode, run the tool instead: mutmut.md, stryker.md, pitest.md.
  4. Evaluate each mutant. Find the tests that exercise the line and trace a concrete input: would an assertion produce a different result? Count a mutant as killed only when you can name the test and the input that kills it. When unsure, check empirically (see Applying Mutants).
  5. Classify each survivor:

Read the full file on GitHub · 92 lines

Files

What ships with it

8 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 8d ago First seen · 92 lines · 97 tokens per session scan A a78d379c8bc0

Subscribe to this mod's changes

mutation-testing is a skill published in the GitHub repository nikeyes/stepwise-dev (24 stars, last pushed 6d ago), licensed Apache-2.0. It adds 97 tokens to every session and 1,491 once invoked, about $0.0004 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-10-11.