Getting it into your agent
One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.
npx skills add jakesterns/agent-skills --skill test-failure-triagegit clone --depth 1 https://github.com/jakesterns/agent-skillsWrote this? Show the measurements
A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.
[](https://agentmods.dev/skills/jakesterns/agent-skills/test-failure-triage)<a href="https://agentmods.dev/skills/jakesterns/agent-skills/test-failure-triage"><img src="https://agentmods.dev/badge/skills/jakesterns/agent-skills/test-failure-triage/github.svg" alt="Measured on agentmods" height="20"></a>Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.
<a href="https://agentmods.dev/skills/jakesterns/agent-skills/test-failure-triage"><img src="https://agentmods.dev/badge/skills/jakesterns/agent-skills/test-failure-triage.svg" alt="Reviewed on agentmods" width="80" height="20"></a>What it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5.1 | $0.00030 | $0.00302 |
| Opus 5 | $0.00015 | $0.00151 |
| Sonnet 5 | $0.00006 | $0.00060 |
| Haiku 4.5 | $0.00003 | $0.00030 |
Grade A, and why
test-failure-triage scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 9d ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Nothing flagged
None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.
What it actually says
Test Failure Triage
Use this skill when tests fail locally or in CI and the user needs root cause analysis, not just a quick patch.
Inputs
- Test output, stack traces, CI logs, failing test names, and recent changes
- Relevant source files and test files
- Test command and environment details when available
Steps
- Identify the first meaningful failure, ignoring downstream failures caused by setup or earlier errors.
- Classify the failure: product regression, test expectation drift, flaky timing, environment issue, fixture/data issue, dependency issue, or infrastructure failure.
- Trace the failing assertion back to the behavior it protects.
- Compare recent code changes against that behavior.
- Recommend the smallest fix that preserves the intended behavior.
- If the test is stale, explain why and update the expectation only when the new behavior is intentional.
- Provide verification commands and any follow-up tests to prevent recurrence.
Output
Return:
- Root cause summary
- Failure classification
- Minimal fix plan
- Files likely needing changes
- Verification commands
- Flake or environment notes if relevant
Guidelines
- Do not delete or weaken tests just to make CI pass.
- Treat intermittent failures as real until evidence shows otherwise.
- Preserve the diagnostic value of the test suite.
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 9d ago First seen · 42 lines · 30 tokens per session scan A a15f4f30b762
test-failure-triage is a skill published in the GitHub repository jakesterns/agent-skills (2 stars, last pushed 3mo ago), licensed MIT. It adds 30 tokens to every session and 302 once invoked, about $0.0002 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.
Other skills, from other repositories
systematic-debugging
4-phase root cause debugging: understand bugs before fixing.
langsmith-observability
LLM observability platform for tracing, evaluation, and monitoring. Use when debugging LLM applications, evaluating model outputs against datasets, monitoring production systems, or building systematic testing pipelines for AI applications.
experimental-code-coverage-local-debugger
Runs code coverage locally via Universal Test Runner (UTR) or helper scripts, mimicking LUCI trybots. Activate when CQ tryjobs fail or underreport coverage, to test local GN/recipe repairs before uploading, or to debug hermetic crashes.
adversarial-reviewer
Adversarial code review that assumes bugs exist and hunts for them. Use when asked to review code, find bugs, audit for correctness, stress-test a PR, or when someone says "tear this apart" or "what's wrong with this". Give no benefit of the doubt — every line is guilty until proven innocent.
cli-e2e
Write, modify, or debug Docker-based Composio CLI end-to-end tests under ts/e2e-tests/cli, including binary invocation, fixture isolation, output assertions, and package manifests. Use for CLI E2E test suites only; use cli-command for CLI source implementation.
work
Deliver one maintainer-approved EmDash issue, choosing the bug-fix path for a defect and the direct implementation path for an enhancement or task.