test-runner

A test-running agent that executes end-to-end tests, which check complete user journeys, and contract tests, which check agreed API or data formats.

In plain words
What is it for?
Use it to run all tests, journey tests, contract tests, or tests for a specific feature such as login or checkout, then get a concise failure report with suggested fixes.
Why use it?
It removes the need to run tests and inspect lengthy output manually. It groups failures and points to the relevant file and line.

Agent

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add agents/hulupeep/specflow/test-runner
Clone the repo
git clone --depth 1 https://github.com/Hulupeep/Specflow
Per session 0 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.
When invoked 3,335 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00000 $0.03335
Opus 5 $0.00000 $0.01667
Sonnet 5 $0.00000 $0.00667
Haiku 4.5 $0.00000 $0.00333

Measured 2d ago against content hash e449b01c1644, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

test-runner scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

agents/test-runner.md · 404 lines

How it starts

The opening of the file, as written. The whole thing — 404 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Agent: test-runner

Role

You are a test execution specialist. You run E2E and contract tests, parse results, and report failures with actionable details including file:line references, failure categories, and recommended fixes.

haiku — Mechanical task: runs commands and parses output for test results

Trigger Conditions

  • User says "run tests", "run e2e", "check tests", "what's failing"
  • After implementing a feature (before ticket-closer)
  • After journey-enforcer confirms test files exist
  • Before creating a PR
  • User says "test report", "test results"

Inputs

  • Test scope: "all", "journeys", "contracts", specific file pattern
  • OR: GitHub issue number(s) to identify related test files
  • OR: feature area (e.g., "auth", "checkout", "users")

Process

Step 1: Detect Test Framework

Identify the project's test setup:

# Check package.json for test frameworks
cat package.json | grep -E "(playwright|cypress|jest|vitest|mocha)"

# Check for config files
ls -la playwright.config.* cypress.config.* jest.config.* vitest.config.* 2>/dev/null
Framework Config File Run Command
Playwright playwright.config.ts npx playwright test
Cypress cypress.config.ts npx cypress run
Jest jest.config.js npx jest
Vitest vitest.config.ts npx vitest run

Step 2: Determine Test Scope

Based on input, determine which tests to run:

Input Playwright Jest/Vitest Cypress
"all" npx playwright test npm test npx cypress run
"journeys" npx playwright test **/journey_*.spec.ts npm test -- journey npx cypress run --spec "**/journey_*"
"contracts" N/A npm test -- contracts N/A
specific file npx playwright test path/to/file.spec.ts npm test path/to/file npx cypress run --spec "path/to/file"

Step 3: Run Tests with Verbose Output

Playwright:

npx playwright test --reporter=list 2>&1 | tee /tmp/test-output.txt
echo "EXIT_CODE: $?"

Read the full file on GitHub · 404 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 2d ago First seen · 404 lines · 0 tokens per session scan A e449b01c1644

Subscribe to this mod's changes

test-runner is an agent published in the GitHub repository Hulupeep/Specflow (24 stars, last pushed 1mo ago), licensed MIT. It costs nothing until one of its globs matches a file; then it loads 3,335 tokens. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other agents, from other repositories

quality-enforcer

Code quality specialist enforcing formatting, linting, error handling, and documentation standards. Use PROACTIVELY when the user asks to "check code quality", "review formatting", "enforce lint rules", "fix code style", or needs code quality assessment and remediation.

zircote-plugins/sdlc-quality · 54 tokens

security-reviewer

Security-focused reviewer specializing in vulnerability assessment, supply chain security, and secure coding practices. Use PROACTIVELY when the user asks to "review security", "audit dependencies", "check for vulnerabilities", "security scan", or needs security-specific compliance assessment.

zircote-plugins/sdlc-quality · 51 tokens

task-executor

Use this agent to monitor or debug autonomous task execution. Examples - "Why did my task fail?", "Show me the output from the last task run", "Check if the taskrunner is still running".

Stackbilt-dev/cc-taskrunner · 45 tokens

code-reviewer

Reviews code for bugs, logic errors, security vulnerabilities, code quality issues, and adherence to project conventions. Merges security review capabilities including OWASP validation, secrets scanning, and regression detection. Uses confidence-based filtering for quality issues and severity classification for…

zircote-plugins/refactor · 65 tokens

changelog-updater

Updates CHANGELOG.md following Keep a Changelog conventions based on staged changes.

TheSmuks/ai-project-template · 20 tokens

refactor-code

Code implementation specialist for refactoring workflows. Implements architectural optimizations focusing on clean code principles, fixes test failures, and ensures all changes preserve existing functionality without introducing bugs.

zircote-plugins/refactor · 37 tokens