test-audit

test-audit is a skill for Claude Code, Codex from iliaal/ai-skills. It costs 68 tokens per session (1,693 once invoked), scanned A, original, MIT.

A test audit examines whether tests would actually fail when the behavior they claim to protect breaks. It looks for tests that bypass the real code, make weak checks, hide failures, use poor examples, or are missing from required test gates.

In plain words
What is it for?
Use it to review test quality, separate local collection from continuous-integration enforcement, and report ineffective, partial, redundant, or adequate coverage without changing code by default.
Why use it?
A passing test suite can create false confidence when its tests do not exercise or enforce the important behavior.

Skill for Claude CodeCodex

Which agent this was written for is unclear — built for openclaw. Also seen: built for openclaw.

Good fit Use it to review test quality, separate local collection from continuous-integration enforcement, and report ineffective, partial, redundant, or adequate coverage without changing code by default.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/iliaal/ai-skills/test-audit
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add iliaal/ai-skills --skill test-audit
Clone the repo
git clone --depth 1 https://github.com/iliaal/ai-skills

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for test-audit

README.md
[![agentmods](https://agentmods.dev/badge/skills/iliaal/ai-skills/test-audit/github.svg)](https://agentmods.dev/skills/iliaal/ai-skills/test-audit)
Your own site
<a href="https://agentmods.dev/skills/iliaal/ai-skills/test-audit"><img src="https://agentmods.dev/badge/skills/iliaal/ai-skills/test-audit/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for test-audit

Your own site · 80×15
<a href="https://agentmods.dev/skills/iliaal/ai-skills/test-audit"><img src="https://agentmods.dev/badge/skills/iliaal/ai-skills/test-audit.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 68 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,693 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00068 $0.01693
Opus 5.5 $0.00027 $0.00677
Sonnet 5.5 $0.00014 $0.00339
Haiku 4.5 $0.00007 $0.00169

Measured 8d ago against content hash 87941b4cacec, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

test-audit scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 8d ago.

The scan reads SKILL.md. This mod also ships 5 executable files (scripts/duplicate_tests.py, scripts/guard_pins.py, scripts/junit_census.py, …), listed below but not scanned — reading those needs a real analyzer, not pattern matching.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

Origin

Copies of this mod

1 near-identical copy found in the catalogue:

skills/test-audit/SKILL.md · 144 lines

How it starts

The opening of the file, as written. The whole thing — 144 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Test audit

Find tests that remain green when their claimed behavior breaks. Assess behavior, not apparent authorship, mock count, assertion count, or a target finding percentage. Default to a read-only audit. Change tests or production code only when requested.

Adapted from the OpenClaw test-audit skill (MIT).

What counts as a finding

Evaluate each claimed behavior separately. A test can protect one obligation and miss another. Use these dispositions:

  • Ineffective for the claim: the named behavior is replaced, never reached, or disconnected from a verdict that can fail.
  • Partially effective: real behavior is tested, but a specific promised distinction is absent from the input or assertions. Preserve the protection that exists.
  • Not enforced: the test is uncollected, skipped, or absent from a blocking gate. Report local collection and CI enforcement separately from assertion quality.
  • Redundant: another test protects the same behavior at the same boundary under equivalent inputs and setup. This requires separate evidence; weakness alone is not redundancy.
  • Adequate for its scope: the test detects a credible failure of its actual contract.
  • Unresolved: missing context or execution prevents a defensible decision.

A missing additional edge case is not automatically a defective existing test. Tie each quality finding to an existing claim, documented contract, or misleading assertion. Distinguish an individual test's weakness from a suite-wide coverage gap.

1. Establish scope and execution

Read repository instructions, runner configuration, shared fixtures, test helpers, and CI commands. Record the exact focused command and applicable completion gates. Determine which tests are collected, execute, and block a merge. An advisory job is not a blocking gate. A local green result does not establish CI enforcement.

Build an inventory from the runner's collection output when practical. Otherwise label the source inventory approximate. Count files, test definitions, and parameter cases separately. Do not treat helpers as tests or silently omit unrecognized syntax.

Read the full file on GitHub · 144 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 8d ago Changed 87941b4cacec
  2. 1mo ago First seen · 144 lines · 68 tokens per session scan A 49a186e4cbd9

Subscribe to this mod's changes

test-audit is a skill published in the GitHub repository iliaal/ai-skills (45 stars, last pushed 3d ago), licensed MIT. It adds 68 tokens to every session and 1,693 once invoked, about $0.0003 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-27.

Related

Other skills, from other repositories

pair-programming

AI-assisted pair programming with multiple modes (driver/navigator/switch), real-time verification, quality monitoring, and comprehensive testing. Supports TDD, debugging, refactoring, and learning sessions. Features automatic role switching, continuous code review, security scanning, and performance optimization with…

frankxai/claude-skills-library · 85 tokens

cypress-tap

Drives a running Cypress open-mode session through cypress tap to run and rerun specs, wait for fresh results, inspect reporter and command logs, and query or rewind the app under test through DOM, accessibility, styles, and snapshots. Use when authoring or debugging Cypress e2e or component specs, discovering…

cypress-io/ai-toolkit · 113 tokens

visual-proof

Capture before/after screenshot evidence of a web page at real breakpoints (375, 768, 1440) in both light and dark themes, using Playwright against a local dev server or a deployed URL. Use before starting any visual change to capture the current state, and again after to prove the delta. Also use when asked to "show…

frankxai/claude-skills-library · 116 tokens

neutron-log

Measure whether a token-saving tool actually saves tokens and keeps answers correct. Use before adopting or recommending RTK, headroom, caveman or any compressor, after changing a hook or instruction file, and when someone quotes a savings percentage. Runs a same-task before and after protocol and records only…

frankxai/claude-skills-library · 65 tokens

cypress-cloud-cli

Runs the cy-cloud CLI to inspect Cypress Cloud organizations, projects, runs, specs, tests, failure screenshots, and Test Replay data. Use when the user mentions Cypress Cloud, cy-cloud, cypress-cloud-cli, a Cloud run or test URL, failing or flaky Cypress tests, Test Replay, run triage, Cloud artifacts, or asks why a…

cypress-io/ai-toolkit · 79 tokens

verification-loop

After a feature or refactor on this Windows estate, run six checks in order and write a PASS or FAIL note before a draft pull request. Use when work is about to be committed, pushed, or handed to another harness.

frankxai/claude-skills-library · 49 tokens