test-rigor-audit

test-rigor-audit is a skill for Claude Code from parisgroup-ai/imersao-ia-setup. It costs 152 tokens per session (3,524 once invoked), scanned A, original, MIT.

A review process for finding tests that pass without checking whether the code really works. It examines common problems such as missing checks, swallowed errors, excessive mocking, and skipped tests in several test tools.

In plain words
What is it for?
Use it to inspect tests before a refactor, after a large change, or while learning an older codebase. It reports findings for human decisions rather than fixing them automatically.
Why use it?
A green test suite can still miss serious regressions when its tests do not fail after broken behavior. This audit helps expose those weak tests before they create false confidence.

Skill for Claude Code

Written for Claude Code: shipped in a Claude Code plugin.

Part of the imersao plugin — 74 skills, 7 commands shipped together

Good fit Use it to inspect tests before a refactor, after a large change, or while learning an older codebase. It reports findings for human decisions rather than fixing them automatically.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/parisgroup-ai/imersao-ia-setup/test-rigor-audit
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add parisgroup-ai/imersao-ia-setup --skill test-rigor-audit
Clone the repo
git clone --depth 1 https://github.com/parisgroup-ai/imersao-ia-setup

Made for: Claude Code.

Or install imersao, the plugin that ships this one along with the rest of its 74 skills, 7 commands.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for test-rigor-audit

README.md
[![agentmods](https://agentmods.dev/badge/skills/parisgroup-ai/imersao-ia-setup/test-rigor-audit/github.svg)](https://agentmods.dev/skills/parisgroup-ai/imersao-ia-setup/test-rigor-audit)
Your own site
<a href="https://agentmods.dev/skills/parisgroup-ai/imersao-ia-setup/test-rigor-audit"><img src="https://agentmods.dev/badge/skills/parisgroup-ai/imersao-ia-setup/test-rigor-audit/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for test-rigor-audit

Your own site · 80×15
<a href="https://agentmods.dev/skills/parisgroup-ai/imersao-ia-setup/test-rigor-audit"><img src="https://agentmods.dev/badge/skills/parisgroup-ai/imersao-ia-setup/test-rigor-audit.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 152 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 3,524 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00152 $0.03524
Opus 5.5 $0.00061 $0.01410
Sonnet 5.5 $0.00030 $0.00705
Haiku 4.5 $0.00015 $0.00352

Measured 21d ago against content hash 1430a1b83aff, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

test-rigor-audit scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 21d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

plugins/imersao/skills/test-rigor-audit/SKILL.md · 254 lines

How it starts

The opening of the file, as written. The whole thing — 254 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Test Rigor Audit

Audita uma suite de testes pra encontrar testes que não fazem trabalho real — testes que passam (ou poderiam passar) independentemente do código sob teste estar correto. Cobre vitest/jest, pytest, Playwright e bats.

Core Principle

Um teste faz trabalho real se, e somente se, ele FALHA quando o código sob teste quebra de forma significativa.

Tudo o que esta skill detecta é uma violação dessa regra: assertion tautológica, ausência de assertion, mock que cobre o próprio SUT, exception silenciosamente engolida, skip sem tracker. O sintoma comum é: "o teste estava verde, mas não pegou a regressão". Esta skill encontra esses testes antes da regressão.

A skill é audit-only. Não aplica fix automático — cada anti-pattern tem decisão humana (deletar vs fortalecer vs investigar SUT). Pra os achados graves, gera body de TaskNote pronto pra criar via pnpm task:new.

Quando usar

  • Antes de refatorar um SUT. Os testes precisam pegar regressão pro refactor ser seguro. Audit primeiro, refactor depois.
  • Pós-merge de PR grande. Cluster de testes novos é o momento de pegar weak tests com contexto fresco.
  • Onboarding em codebase legado. Suite verde é informação enganosa se 30% dos testes não asseguram nada.
  • Quando uma regressão escapou. Se o teste devia ter pego e não pegou, a suite tem um padrão sistêmico — audit acha os parentes do teste falho.
  • Periodicamente em projetos com >1k testes. Drift de rigor acumula silenciosamente.

Não é o caso de uso pra Quality Gate diário — isto é uma skill de deep audit, lenta e meticulosa. Pra gates contínuos, use coverage-check + lint rules específicas (ex: eslint-plugin-vitest expect-expect).

Workflow

┌──────────────────────────────────────────────────────────────────────┐
│ 1. ESCOPO   — file/dir/pattern do alvo + framework detection         │
│ 2. GREP     — mechanical sweep (grep recipes por framework)          │
│ 3. READ     — leitura dos arquivos sinalizados pra análise contextual│
│ 4. CLASSIFY — categorize por anti-pattern + severidade               │
│ 5. REPORT   — markdown report agrupado por arquivo                   │
│ 6. TASKNOTE — bodies prontos pros achados HIGH severity              │
└──────────────────────────────────────────────────────────────────────┘

Read the full file on GitHub · 254 lines

Files

What ships with it

5 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 21d ago First seen · 254 lines · 152 tokens per session scan A 1430a1b83aff

Subscribe to this mod's changes

test-rigor-audit is a skill published in the GitHub repository parisgroup-ai/imersao-ia-setup (1 stars, last pushed 20d ago), licensed MIT. It adds 152 tokens to every session and 3,524 once invoked, about $0.0006 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-10-06.

Related

Other skills, from other repositories

improve-code-quality

Guided journey from a working-but-untested vibe-coded prototype to a production-ready product with tests, clean structure, a business-rules boundary, and resilience at scale. Orchestrates nine skills phase by phase - working-with-legacy-code, clean-code, refactoring-patterns, software-design-philosophy…

wondelai/skills · 227 tokens

working-with-legacy-code

Safely change and test untested codebases using Feathers' "Working Effectively with Legacy Code". Use when the user mentions "legacy code", "no tests", "untested codebase", "how do I test this", "seams", "characterization tests", "golden master", "sprout method", "afraid to change this code", "monster method"…

wondelai/skills · 188 tokens

browser-validator

Automatically validate implementations in real browsers after code is written or when user says "test this", "test what you built in the browser", "check it in a real browser", or "validate at the breakpoints". Uses Chrome DevTools MCP to test responsive breakpoints (320px, 768px, 1024px), check accessibility…

kanopi/cms-cultivator · 99 tokens

test-scaffolding

Automatically generate test scaffolding when user writes new code without tests or mentions needing tests. Supports unit, integration, e2e, and data tests for PHP and JavaScript. Invoke when user mentions "tests", "testing", "coverage", "write tests", or shows new untested code.

kanopi/cms-cultivator · 64 tokens

coverage-analyzer

Automatically analyze test coverage when user asks which code is tested, mentions coverage gaps, or shows code asking about testing. Identifies untested code paths and suggests test additions. Invoke when user asks "what's not tested?", "coverage", "untested code", or "which tests are missing?".

kanopi/cms-cultivator · 63 tokens

test-plan-generator

Automatically generate comprehensive QA test plans when user mentions testing requirements, QA needs, or asks what should be tested. Analyzes code changes and features to create structured test scenarios. Invoke when user mentions "test plan", "QA", "what to test", "testing requirements", or "test scenarios".

kanopi/cms-cultivator · 64 tokens