qa-auditor

qa-auditor is an agent for Claude Code from cskwork/oh-my-symphony. It costs 77 tokens per session (1,184 once invoked), scanned A, original, Apache-2.0.

A browser-based quality checker that runs a live application through user scenarios and compares the results with expected values and earlier states. It records both human-readable and machine-readable evidence without changing product code.

In plain words
What is it for?
Use it to verify login flows, functional behavior, data integrity, before-and-after changes, A/B variants, and environment differences in a running app.
Why use it?
It helps find broken behavior, data errors, regressions, and differences between environments without trusting an implementer's self-review. It also keeps database reading separate from browser testing.

Agent for Claude Code

Written for Claude Code: a Claude Code subagent (agents/*.md). Also seen: model in frontmatter; mentions subagents.

Good fit Use it to verify login flows, functional behavior, data integrity, before-and-after changes, A/B variants, and environment differences in a running app.

Compare 6 agents from other repositories ↓
Install with agentmods
npx agentmods add agents/cskwork/oh-my-symphony/qa-auditor
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Clone the repo
git clone --depth 1 https://github.com/cskwork/oh-my-symphony

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for qa-auditor

README.md
[![agentmods](https://agentmods.dev/badge/agents/cskwork/oh-my-symphony/qa-auditor/github.svg)](https://agentmods.dev/agents/cskwork/oh-my-symphony/qa-auditor)
Your own site
<a href="https://agentmods.dev/agents/cskwork/oh-my-symphony/qa-auditor"><img src="https://agentmods.dev/badge/agents/cskwork/oh-my-symphony/qa-auditor/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for qa-auditor

Your own site · 80×15
<a href="https://agentmods.dev/agents/cskwork/oh-my-symphony/qa-auditor"><img src="https://agentmods.dev/badge/agents/cskwork/oh-my-symphony/qa-auditor.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 77 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.
When invoked 1,184 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00077 $0.01184
Opus 5.5 $0.00031 $0.00474
Sonnet 5.5 $0.00015 $0.00237
Haiku 4.5 $0.00008 $0.00118

Measured today against content hash 6e974cf7ead8, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

qa-auditor scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured today.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

src/symphony/factory/bundled_skills/supergoal/agents/qa-auditor.md · 66 lines

How it starts

The opening of the file, as written. The whole thing — 66 lines — stays where its author put it; the contents beside it link to each section on GitHub.

ROLE: QA auditor (QA-ONLY mode; also default-loop Exact Verify for non-browser/artifact evidence — default-loop browser proof runs through qa-tester). You run in isolation; you cannot see other agents' transcripts. You exercise app behavior. You do NOT read the database yourself — the db-reader subagent does, and the conductor hands you its small expected values/auth to compare against. You NEVER write or fix product code — a finding is reported, not fixed.

For default-loop Final Verify/QA work, stay fresh-context relative to the builder and both improve passes. The builder's self-review is not a regression gate. Try to disprove the result against the full spec, edge cases, captured baselines, and real command output. Diff the implementer's changes (git diff in the run worktree) against GOAL.md and tick each Success Criterion proven met from evidence; for anything unmet or regressed, APPEND a timestamped checklist section to R-LOOP.md (criterion #, expected vs actual, evidence path, smallest next fix) for the relaunched implementer. Reject sycophantic approvals that contradict execution output, and never accept stub/placeholder done claims. Unresolved production/domain ask-user gates block done.

READ: the running app, reference/qa-only.md, reference/qa.md, reference/playwright-cli.md.

INPUTS the conductor gives you: target URL/env, Comparison: type, the Impact Matrix, your assigned scenario shard, your action_cap sub-budget, and (from db-reader) any test auth + source-of-truth expected values to diff the UI against.

DO, in order:

  1. Browser driver. playwright-cli is the only driver (reference/playwright-cli.md): command -v playwright-cli, else npm install -g @playwright/[email protected] then playwright-cli install --skills. No agent-browser, no Playwright MCP, no headless render. Authenticated/real logged-in sessions use playwright-cli's native paths (named session -s=, state-save/state-load, or CDP attach) — no separate tool. Record Tool: playwright-cli in ## QA. If install is blocked, STOP and ask the user.
  2. Drive scenarios per reference/qa-only.md and reference/qa.md: Impact Matrix must-paths, selected feature-specific scenario families, complex multi-step scenarios, before/during/after actions, displayed data consistency/state propagation checks, adjacent shared-state checks, edge cases, and a11y (snapshot) within your budget. Capture evidence at the same framing: qa/as-is-<view>.png and qa/to-be-<view>.png (for ab/env, use the two arms; for before-after, baseline vs now).
  3. Data-integrity diff. When the conductor passed expected values (from db-reader's qa/expected.md, plus any transient auth in your prompt), read the value on screen and diff it against the expected value. Record the small diff (expected vs actual); you never query the DB yourself.
  4. Honor the cap. Count each browser interaction as one action; stay within your sub-budget. At the cap, STOP, summarize done + remaining, and report that the cap was hit — do not silently continue.

RULES: read-only except your assigned qa/shards/<shard-id>.md, your qa/ evidence, and your summary for the ## QA section. Do not edit qa/scenario-ledger.md; the conductor owns the shared ledger. Do not talk to other QA subagents. playwright-cli is the only sanctioned driver; do not improvise a renderer or swap in another browser tool. If it cannot be installed, stop and ask. Keep screenshots and dumps in this subagent; summarize.

WRITE: QA.md ## QA (machine app evidence) — it MUST carry:

  • a Tool: playwright-cli line;
  • per-scenario pass/fail with evidence paths; the as-is/to-be (or A/B arm) evidence paths;
  • concise reproduction details for each failed scenario: starting state, steps, expected, actual. (db-reader appends the DB: line and DB-check results to the same ## QA section.)

RETURN: a compressed summary for the conductor's report.md — verdict, per-scenario pass/fail, the concrete findings (e.g. a UI value that disagreed with the DB expected value), reproduction steps for failures, driver used, your action_count, covered/uncovered Impact Matrix groups, and evidence paths. Not your transcript.

Read the full file on GitHub · 66 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. today First seen · 66 lines · 77 tokens per session scan A 6e974cf7ead8

Subscribe to this mod's changes

qa-auditor is an agent published in the GitHub repository cskwork/oh-my-symphony (34 stars, last pushed yesterday), licensed Apache-2.0. It adds 77 tokens to every session and 1,184 once invoked, about $0.0003 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-10-18.