wicked-garden-qe-snapshot-hygiene-auditor

Snapshot Hygiene Auditor

Snapshot tests rot silently. An accepted-but-wrong baseline is worse than a missing test because it pretends to be coverage. You audit the four rot classes — stale, over-broad, rubber-stamped, dead — and produce a ranked top-N list so a reviewer can spend 30 minutes, not 30 hours.

Runtime

Script-backed steps use the wicked-garden launcher: wicked-garden run <plugin-root-relative path, e.g. scripts/…> [args]. It is on PATH after npm i -g wicked-garden; otherwise use npx wicked-garden run …; inside a wicked-crew run it is "$WICKED_GARDEN_ROOT/scripts/wicked-garden". If none of these is available, or Python 3 is missing, skip the script-backed step, say so, and follow the manual alternative where one is given next to it — never invent the script's output. Relative paths in this skill are relative to the directory that contains this SKILL.md.

1. Inputs

• Scenario file path — frontmatter may declare:
  • target_dirs: list of directories to audit; default scan the whole repo for the patterns listed below.
  • age_days: stale threshold; default 90.
  • over_broad_lines: threshold flagging a single snapshot wider than N lines; default 200.
  • rubber_stamp_window: number of commits back to look for baseline- regenerated-same-commit patterns; default 1.
  • top_n: number of items in the remediation list; default 25.
• run_id — UUID of the current runs row; defines EVIDENCE_DIR.
• Git working tree — required; git log -p drives rubber-stamp detection. Refuse if the scenario's target_dirs are not inside a git repo.
• .wicked-qe/evidence/<run_id>/context.md — optional rules like "ignore cassettes/external/ — those are vendor fixtures".

2. Detector invocation

Run all four detectors; each writes its own JSON result to EVIDENCE_DIR/detectors/ for traceability.

Discovery — what snapshot formats are in use

# The canonical snapshot-bearing patterns. Each match is a candidate for
# the four rot checks below.
#   - Jest / vitest: __snapshots__/*.snap
#   - Go / golden: *.golden, testdata/
#   - VCR / pytest-recording: cassettes/
#   - Syrupy (pytest): .syrupy/  or  __snapshots__/*.ambr
find "${TARGET_DIRS}" \
  \( -path '*/__snapshots__/*' -o -name '*.snap' -o -name '*.golden' \
     -o -path '*/cassettes/*' -o -path '*/.syrupy/*' -o -name '*.ambr' \) \
  -type f \
  > "${EVIDENCE_DIR}/snapshot-files.txt"