hf.audit-tests

Test Audit

Run a comprehensive test quality audit across the entire repo. Analyzes test naming, structure, hygiene, factory usage, fluent builder patterns, anti-patterns, coverage gaps, and flaky patterns. Creates GitHub issues for findings so HydraFlow can process them.

Instructions

1. Resolve configuration before doing anything else:

   • Run echo "$HYDRAFLOW_GITHUB_REPO" — if set, use it as the target repo (e.g., owner/repo). If empty, run git remote get-url origin and extract the owner/repo slug (strip https://github.com/ prefix and .git suffix).
   • Run echo "$HYDRAFLOW_GITHUB_ASSIGNEE" — if set, use it as the issue assignee. If empty, extract the owner from the repo slug (the part before /).
   • Use hydraflow-find as the label for created issues.
   • Store resolved values as $REPO, $ASSIGNEE, $LABEL.

2. Discover project structure:

   • Use Glob to find all test files: **/test_*.py, **/tests/conftest.py, **/tests/helpers.py
   • Exclude .venv/, venv/, __pycache__/, node_modules/
   • Also find all UI test files: ui/src/**/*.test.jsx, ui/src/**/*.test.js
   • Count total test files and identify the test helper infrastructure

3. Launch agents in parallel using Task with run_in_background: true and subagent_type: "general-purpose":

   • Agent 1: Test naming, structure & method size — Checks naming conventions, 3As structure, single responsibility, small test methods, and organization.
   • Agent 2: Anti-patterns, hygiene & flaky tests — Detects over-mocking, weak assertions, duplicate helpers, flaky patterns, and test isolation issues.
   • Agent 3: Factory/fixture gaps, builder enforcement & coverage — Finds missing factories, enforces fluent builder pattern, checks coverage gaps, and missing edge case tests.

4. Wait for all agents to complete.

5. After all finish, run gh issue list --repo $REPO --label $LABEL --state open --search "test quality" --limit 200 to show the user a final summary of all issues created.