vibe-flake-root-cause

vibe-flake-root-cause is a skill for Claude Code from ash1794/vibe-engineering. It costs 96 tokens per session (738 once invoked), scanned A, original, MIT.

A method for investigating tests that fail only sometimes. It finds the environmental condition that changes the result and measures whether controlling it fixes the failure.

In plain words
What is it for?
Use it for intermittent test failures, CI-only failures, and inconsistent performance, visual, or timeout checks. It helps distinguish code defects from overloaded machines, shared resources, or network problems.
Why use it?
Rerunning a failed test until it passes can hide a real defect. This replaces the vague label “flaky” with evidence about the cause.

Skill for Claude Code

Written for Claude Code: user-invocable in frontmatter.

Part of the vibe-engineering plugin — 33 skills shipped together

Good fit Use it for intermittent test failures, CI-only failures, and inconsistent performance, visual, or timeout checks. It helps distinguish code defects from overloaded machines, shared resources, or network problems.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/ash1794/vibe-engineering/vibe-flake-root-cause
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add ash1794/vibe-engineering --skill vibe-flake-root-cause
Clone the repo
git clone --depth 1 https://github.com/ash1794/vibe-engineering

Made for: Claude Code.

Or install vibe-engineering, the plugin that ships this one along with the rest of its 33 skills.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for vibe-flake-root-cause

README.md
[![agentmods](https://agentmods.dev/badge/skills/ash1794/vibe-engineering/vibe-flake-root-cause/github.svg)](https://agentmods.dev/skills/ash1794/vibe-engineering/vibe-flake-root-cause)
Your own site
<a href="https://agentmods.dev/skills/ash1794/vibe-engineering/vibe-flake-root-cause"><img src="https://agentmods.dev/badge/skills/ash1794/vibe-engineering/vibe-flake-root-cause/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for vibe-flake-root-cause

Your own site · 80×15
<a href="https://agentmods.dev/skills/ash1794/vibe-engineering/vibe-flake-root-cause"><img src="https://agentmods.dev/badge/skills/ash1794/vibe-engineering/vibe-flake-root-cause.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 96 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 738 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00096 $0.00738
Opus 5.5 $0.00038 $0.00295
Sonnet 5.5 $0.00019 $0.00148
Haiku 4.5 $0.00010 $0.00074

Measured 17d ago against content hash 93e43f99442c, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

vibe-flake-root-cause scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 17d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

plugins/vibe-engineering/skills/vibe-flake-root-cause/SKILL.md · 57 lines

How it starts

The opening of the file, as written. The whole thing — 57 lines — stays where its author put it; the contents beside it link to each section on GitHub.

vibe-flake-root-cause

"Flaky" ends an investigation without finding anything, and a retry-to-green hides real defects. An intermittent failure is a hypothesis: some variable you haven't controlled decides the outcome. Find it, force it, and prove the fix with counts.

When to Use This Skill

  • "It passed on rerun"
  • A failure that shows up only in CI
  • A threshold (performance, visual diff, timeout) that fails on some runs
  • You're tempted to add a retry, raise a timeout, or loosen a tolerance

When NOT to Use This Skill

  • The failure reproduces every time (debug it directly)
  • Race conditions visible in the test code itself (use vibe-concurrent-test-safety)
  • The job died before any test ran (checkout, install, runner loss); a single re-run is fine there, but say so

Steps

  1. Record the failure exactly. Commit, environment, profile or device, the failing value, and the threshold. Keep the log.

  2. Run it alone, cleanly. If it passes in isolation, treat it as contention until proven otherwise, and name the resource: CPU, a shared port, a shared database, disk, or network. Record machine load alongside every timing measurement.

  3. List candidate variables and force each in turn. Common ones:

    • timing: network latency, font or asset arrival, animation frames
    • environment: CPU load, parallel agents or tests, shared ports and servers
    • data: ordering, time of day, random seeds, page or payload size
    • process mode: a server started in a mode the framework doesn't support in production
  4. Reproduce at a stated rate before changing anything (for example "10 of 15 runs fail with fonts held back 600 ms"). No reproduction means no root cause yet, so keep looking or report it as unresolved.

  5. Fix the cause, not the symptom. Then rerun the forced condition N times and report the new rate (for example "0 of 240 loads across 4 routes").

  6. Disclose any mitigation. If you clip, retry, or quarantine anything, say what, why, and why it doesn't hide a defect. Never widen a threshold or budget to pass (vibe-anti-rationalization-check).

Read the full file on GitHub · 57 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 17d ago First seen · 57 lines · 96 tokens per session scan A 93e43f99442c

Subscribe to this mod's changes

vibe-flake-root-cause is a skill published in the GitHub repository ash1794/vibe-engineering (164 stars, last pushed 9d ago), licensed MIT. It adds 96 tokens to every session and 738 once invoked, about $0.0004 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-29.

Related

Other skills, from other repositories

unica-testing

A testing guide for Unica, covering how to choose, write, run, and review tests in Rust and Python. It also explains test boundaries, test sizes, Rust nextest, Python unittest, and failure analysis.

IngvarConsulting/unica · 73 tokens

generator-apply-fixes

Internal Auto-Harness generator skill for QA fix cycles. Use only inside the Generator subagent when it is addressing named defects from QA or retest.

redker56/auto-harness · 36 tokens

gut

Godot Unit Testing (GUT) framework for GDScript. Covers test structure, assertions, doubles/mocks, async testing, memory management, and CLI execution. Use when writing tests, understanding test patterns, or troubleshooting test failures.

rockerBOO/gut-skill · 50 tokens

health

Audits agent config, instruction drift, hooks or MCP, and AI maintainability. Use when Claude, Codex, or Pi setup looks wrong. Not for application bugs or PR review.

tw93/Waza · 40 tokens

cherry-electron-dev

Develop, fix, profile, and test PRs in a tracked Cherry Studio Electron instance. Use for implementation, UI and interaction work, runtime debugging, DevTools inspection, performance analysis, and interactive PR verification with a test report. Reuse a verified workspace instance and manage its lifetime according to…

CherryHQ/cherry-studio · 68 tokens

cherry-assistant-guide

A guide for looking up Cherry Studio's product details and diagnosing problems such as connection failures, setup errors, and runtime issues.

CherryHQ/cherry-studio · 68 tokens