sumithr

sumithr/sumo-qa

Plugin Claude Code

Plugin marketplace listing 1 plugin: sumo-qa.

sumithr/sumo-qa

Plugin Claude Code

Sumo QA — a senior-QA-shaped MCP server for pre-coding QA planning, TDD scaffolding, mutation-testing follow-up, code review, and test-data discovery.

sumithr/sumo-qa

Agent Claude Code

Diagnoses promptfoo skill-eval failures for sumo-qa. Use after npm run eval or npm run eval:all returns any FAIL. Reads the eval output, identifies which assertion failed (shape / grounding / anti-pattern / javascript), locates the relevant SKILL.md section, and recommends strengthening the skill — never loosening the…

sumithr/sumo-qa

Agent Claude Code

Classifies mutmut survivors and produces a per-file action list. Use after uv run mutmut run when survivors > 0, before invoking sumo-qa-strengthening-tests. Returns a markdown report tagging each survivor as equivalent / tautology-killable / genuine-gap / infrastructure-noise with a recommended action. Does NOT…

sumithr/sumo-qa

Hook Claude Code

Runs before the agent uses a tool for Edit, Write, MultiEdit and NotebookEdit tool calls, executing block-generated-paths.py. From sumithr/sumo-qa.

sumithr/sumo-qa

Hook Claude Code

Runs after a tool call finishes for Edit, Write, MultiEdit and Bash tool calls, executing validate-on-content-edit.py and route-qa-runners-prefilter.cmd (2 commands). From sumithr/sumo-qa.

sumithr/sumo-qa

Settings file Claude Code

Agent settings declaring 2 hook events (PreToolUse, PostToolUse).

sumithr/sumo-qa

Skill Claude CodeCodex

Captures a promptfoo skill-eval baseline JSON for one sumo-qa skill and snapshots it to docs/qa/runs/eval-baselines/, with an automatic delta against the prior snapshot. Use this whenever the user mentions baselining a skill, capturing a before/after eval, running a single-skill eval, or measuring the effect of a…

sumithr/sumo-qa

Skill Claude CodeCodex

Scaffolds a new sumo-qa sub-skill end-to-end — SKILL.md skeleton, matching promptfoo eval YAML, and an approaches.md catalogue entry — through a single bundled script. Use this whenever the user wants to add a new sumo-qa- skill, even if they describe it as "creating a skill", "adding an approach", "starting a new…

sumithr/sumo-qa

Instructions file GitHub Copilot

Instructions for sumithr/sumo-qa: Hard rule: for any QA-shaped request — testing, test plan, test strategy, test approach, regression scope, risk-based testing, exploratory testing, code review for safety-to-merge, scaffolding tests, TDD, mutation testing, finding or validating test data, QA audit, test pyramid design…

sumithr/sumo-qa

MCP server Claude CodeCodexCursor +2

MCP server "sumo-qa" as configured in sumithr/sumo-qa. Runs locally from the ${CLAUDE_PLUGIN_ROOT} Python package. Needs 1 environment variable to run.

sumithr/sumo-qa

Instructions file CodexOpenCode

Instructions for sumithr/sumo-qa, covering agents.md, sumo-qa setup, github issue creation, default: configure every detected host, per-host flags and updating.

sumithr/sumo-qa

Hook

Runs when a session starts on startup, clear and compact, executing run-hook.cmd. From sumithr/sumo-qa.

sumithr/sumo-qa

Skill Claude CodeCodex

Use when the user asks a generic testing question — "how do I test this?", "what should I check for X?" — that doesn't fit a more specific QA skill. Cites a principle or technique from the loaded catalogue rather than producing generic advice.

sumithr/sumo-qa

Skill Claude CodeCodex

Use when a review, mutation run, or graded scenario has already named a concrete uncovered behavior gap and the user wants it closed with evidence — e.g. 'close this gap', 'drive this uncovered risk to a regression test', 'fix this surviving mutant end to end'. Drives ONE closed loop per gap — failing test → red…

sumithr/sumo-qa

Skill Claude CodeCodex

Use when the user asks for a formal test plan, entry/exit criteria, or a phased QA approach for a piece of work. Walk the user through scope → risks → entry criteria → phases → exit criteria → residual risks one section at a time, getting confirmation before each step. Heavier than sumo-qa-preparing-for-work; use when…

sumithr/sumo-qa

Skill Claude CodeCodex

Use as the FIRST step on any QA intent. Loads classifications + approaches (the two needed to route), then reasons over the user's intent to pick the canonical approach and routes to the matching sub-skill (which loads any further catalogues on demand).

sumithr/sumo-qa

Skill Claude CodeCodex

Use after sumo-qa-planning-qa-rollout to dispatch a written QA plan task-by-task. Each task runs in a fresh subagent (parallel where independent); each subagent's output goes through a two-stage review (test-correctness → test-quality) before the task is marked done. Continuous execution — no per-task check-ins.…

sumithr/sumo-qa

Skill Claude CodeCodex

Use when the user asks about test data — what data to test X, find a known-good record, validate an entry, register new known-good data. Routes between sumoqaexplaintestdatarequirements, sumoqafindtestdata, sumoqavalidatetestdata, and sumoqaregisterknowngoodtestdata.

sumithr/sumo-qa

Skill Claude CodeCodex

Use at the end of a QA rollout (after sumo-qa-executing-qa-rollout, or after a manual multi-step QA task) to capture evidence, produce a PR-ready summary, and close the loop. Runs the suite one last time, captures coverage / risk-to-test map / open follow-ups, writes a markdown summary to docs/qa/runs/YYYY-MM-DD- .md…

sumithr/sumo-qa

Skill Claude CodeCodex

Use after sumo-qa-deciding-approach picks tdd-scaffold, regression-first, or coverage-first-then-refactor — e.g. "write a regression test for this bug" or "scaffold the failing tests first". Walks plan → name-the-risk-and-test-idea → confirm → red → hand off → green → review, one section per turn with confirmation…

sumithr/sumo-qa

Skill Claude CodeCodex

Use when the user wants coverage or mutation numbers in the local QA report — "run coverage", "measure coverage", "run mutation testing", "record the survivors". Runs the repo's configured coverage/mutation tool, reads its output (any format), and persists a compact summary into the .sumo-qa artifacts the report loads.

sumithr/sumo-qa

Skill Claude CodeCodex

Use when you have a chunk of QA work (a story, a PR, a strategy phase) that needs to be turned into a written plan of bite-sized, independently-executable tasks before any test code is written. Walks scope → file structure → bite-sized tasks → confirm, one section per turn. Produces docs/qa/plans/YYYY-MM-DD- .md ready…

sumithr/sumo-qa

Skill Claude CodeCodex

Use when the user asks to plan QA for a story, ticket, or piece of work before coding starts. Identifies named risks anchored in the change shape, then proposes a smallest useful test set tied to those risks. Lighter-weight than sumo-qa-creating-test-plan; no formal entry/exit criteria.