fix-vi-flaky-test

fix-vi-flaky-test is a skill for Claude Code, Codex from vercel/vercel. It costs 42 tokens per session (1,393 once invoked), scanned D, original, Apache-2.0.

A workflow for reproducing and fixing one flaky test, meaning a test that passes and fails unpredictably, in a specified repository.

In plain words
What is it for?
It helps set up the required build tools, rerun the affected tests, check whether a pull request caused the failure, and make or withhold a code change based on the evidence.
Why use it?
It provides a repeatable way to investigate unreliable tests and add diagnostics when a test shard hangs.

Skill for Claude CodeCodex ✓ vendor

Written for no agent in particular: nothing here depends on one. Also seen: mentions AGENTS.md.

Needs its repository: it reads a path above its own folder, which exists only inside the repository. The line is cd repo/packages/python-analysis && pnpm run build:wasm && cd ../...

Good fit It helps set up the required build tools, rerun the affected tests, check whether a pull request caused the failure, and make or withhold a code change based on the evidence.

Compare 6 skills from other repositories ↓
About the project

Vercel is a platform and command-line tool for developing, previewing, and deploying web applications. Developers and teams use it to publish projects from templates, imported repositories, or local workspaces.

vercel/vercel · 16,534 stars · on GitHub · vercel.com

Install

Getting it into your agent

It runs from inside its repository, so the clone comes first — what it calls does not travel with the file alone.

Clone the repo
git clone --depth 1 https://github.com/vercel/vercel
agentmods
npx agentmods add skills/vercel/vercel/fix-vi-flaky-test

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for fix-vi-flaky-test

README.md
[![agentmods](https://agentmods.dev/badge/skills/vercel/vercel/fix-vi-flaky-test/github.svg)](https://agentmods.dev/skills/vercel/vercel/fix-vi-flaky-test)
Your own site
<a href="https://agentmods.dev/skills/vercel/vercel/fix-vi-flaky-test"><img src="https://agentmods.dev/badge/skills/vercel/vercel/fix-vi-flaky-test/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for fix-vi-flaky-test

Your own site · 80×15
<a href="https://agentmods.dev/skills/vercel/vercel/fix-vi-flaky-test"><img src="https://agentmods.dev/badge/skills/vercel/vercel/fix-vi-flaky-test.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 42 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,393 The whole file, excluding the scripts and references it only reads on demand.
Security scan D 3 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00042 $0.01393
Opus 5.5 $0.00017 $0.00557
Sonnet 5.5 $0.00008 $0.00279
Haiku 4.5 $0.00004 $0.00139

Measured 9d ago against content hash 2b10c47845cb, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade D, and why

fix-vi-flaky-test scanned grade D with 3 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 9d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Asks for rootmediumPrivilege escalation

A mod that escalates privileges can change anything on the machine, not only the project.

if command -v apt-get >/dev/null; then sudo apt-get update -qq && sudo apt-get install -y -qq gcc libc6-dev; else sudo dnf install -y -q gcc; fi

Downloads and executes remote codehighSupply chain

curl | sh runs whatever the server returns today, which is not necessarily what it returned when this was reviewed.

curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh -s -- -y -q --profile minimal --default-toolchain 1.96.1 --target wasm32-wasip2

Makes network callslowCapability

Not a fault in itself. Listed so you know the mod talks to something, and to what.

curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh -s -- -y -q --profile minimal --default-toolchain 1.96.1 --target wasm32-wasip2
.vc/automations/workflows/flaky-tests/skills/fix-vi-flaky-test/SKILL.md · 98 lines

How it starts

The opening of the file, as written. The whole thing — 98 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Fix a flaky test in vercel-internal

You were asked to fix one flaky test from test.yml, or to add diagnostics for a shard hang. Your instructions list the attempts that failed and then passed on rerun, their branches, and log lines. code-change covers publishing; this skill covers this repository's tests.

A test seen on one branch may be that pull request's own problem: check whether the pull request changed the failing test or what it tests (git log on the pinned commit, or the run's PR). If it did, finish without a change and say so.

Set up the sandbox

The sandbox has Node and pnpm but no C compiler or Rust, and part of the build needs both. Its Linux varies (Ubuntu with apt-get, or Amazon Linux with dnf). Run these once, from the workspace root (about four minutes in all):

if command -v apt-get >/dev/null; then sudo apt-get update -qq && sudo apt-get install -y -qq gcc libc6-dev; else sudo dnf install -y -q gcc; fi
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh -s -- -y -q --profile minimal --default-toolchain 1.96.1 --target wasm32-wasip2

Then install dependencies with install_dependencies and filter vercel..., and build what the CLI's tests import:

. "$HOME/.cargo/env"
cd repo/packages/python-analysis && pnpm run build:wasm && cd ../..
pnpm --filter "vercel^..." run build

Use pnpm --filter, not turbo: Turbo also needs Cargo just to read the task graph. For a test in another package, build "<package>^..." instead.

Run the test

  • One CLI unit test file: cd repo/packages/cli && node ./scripts/test.mjs --run --retry=0 <file>.
  • One CLI Unit shard, the same files as CLI Unit / … / 6/7: VITEST_SHARD=6/7 node ./scripts/test.mjs --run --retry=0 test/unit/ (about two minutes).
  • Vitest retries every failed test three times in this repository. Always pass --retry=0 when reproducing, and run the test or shard several times; a flaky test usually passes once.

A hang: [test] chunk timed out after 1200s

Read the full file on GitHub · 98 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 9d ago First seen · 98 lines · 42 tokens per session scan D 2b10c47845cb

Subscribe to this mod's changes

fix-vi-flaky-test is a skill published in the GitHub repository vercel/vercel (16,534 stars, last pushed 3d ago), licensed Apache-2.0. It adds 42 tokens to every session and 1,393 once invoked, about $0.0002 per session on Opus 5.5. A static security scan graded it D with 3 findings (asks for root, downloads and executes remote code, makes network calls). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-10-28.

Related

fix-vi-flaky-test compared with skills from other repositories

fix-vi-flaky-test next to 6 skills from other repositories
ModTypeStarsLast pushLicenceScanTokensWorks with
fix-vi-flaky-testvercel/vercelSkill17k3d agoApache-2.0D42Claude Code, Codex
claw-adminx-cmd/x-cmdSkill4.7k6d agoApache-2.0A48Claude Code, Codex
optimizex-cmd/x-cmdSkill4.7k6d agoApache-2.0A29Claude Code, Codex
atmos-introspectioncloudposse/atmosSkill1.4kyesterdayApache-2.0A44Claude Code
atmos-schemascloudposse/atmosSkill1.4kyesterdayApache-2.0A32Claude Code
atmos-lintcloudposse/atmosSkill1.4kyesterdayApache-2.0A64Claude Code
atmos-diagnosticscloudposse/atmosSkill1.4kyesterdayApache-2.0A33Claude Code