cgs-test-flakiness

cgs-test-flakiness is a skill for Claude Code from merlinhu1/codex-game-studio. It costs 47 tokens per session (584 once invoked), scanned A, original, MIT.

A guide for diagnosing tests that sometimes pass and sometimes fail without code changes.

In plain words
What is it for?
Use it to identify failure patterns, investigate likely causes, stabilize unreliable tests, and document verification evidence.
Why use it?
It helps isolate timing, randomness, test order, environment, and cleanup problems that make results unreliable.

Skill for Claude Code

Written for Claude Code: user-invocable in frontmatter. Also seen: model in frontmatter; reads .claude/ paths; installed under .agents/ (shared by several agents).

Good fit Use it to identify failure patterns, investigate likely causes, stabilize unreliable tests, and document verification evidence.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/merlinhu1/codex-game-studio/cgs-test-flakiness
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add merlinhu1/codex-game-studio --skill cgs-test-flakiness
Clone the repo
git clone --depth 1 https://github.com/merlinhu1/codex-game-studio

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for cgs-test-flakiness

README.md
[![agentmods](https://agentmods.dev/badge/skills/merlinhu1/codex-game-studio/cgs-test-flakiness/github.svg)](https://agentmods.dev/skills/merlinhu1/codex-game-studio/cgs-test-flakiness)
Your own site
<a href="https://agentmods.dev/skills/merlinhu1/codex-game-studio/cgs-test-flakiness"><img src="https://agentmods.dev/badge/skills/merlinhu1/codex-game-studio/cgs-test-flakiness/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for cgs-test-flakiness

Your own site · 80×15
<a href="https://agentmods.dev/skills/merlinhu1/codex-game-studio/cgs-test-flakiness"><img src="https://agentmods.dev/badge/skills/merlinhu1/codex-game-studio/cgs-test-flakiness.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 47 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 584 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00047 $0.00584
Opus 5 $0.00023 $0.00292
Sonnet 5 $0.00009 $0.00117
Haiku 4.5 $0.00005 $0.00058

Measured 7d ago against content hash 4cbdae719faf, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-10, from the pricing page.

Security

Grade A, and why

cgs-test-flakiness scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 7d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

.agents/skills/cgs-test-flakiness/SKILL.md · 81 lines

What it actually says

Codex Game Studio Test Flakiness

Use this skill for test flakiness work in Template Game.

Objective

Diagnose flaky tests by isolating timing, randomness, ordering, environment, and cleanup causes.

Inputs

  • AGENTS.md
  • .codex/studio.json
  • task-relevant files named by the user or task record
  • design/gdd.md
  • production/session-state/active.md
  • tests/

Arguments

  • Objective or user request.
  • Target files, scenes, assets, or docs.
  • Constraints, deadlines, acceptance criteria, and verification command when known.

Procedure

  1. Clarify the requested diagnose flaky tests by isolating timing, randomness, ordering, environment, and cleanup causes. and identify the current project stage.
  2. Collect evidence for Failure Pattern, Isolation, Root Cause.
  3. Run or define the focused validation loop before reporting conclusions.
  4. Produce the requested artifact or review with clear file paths and verification evidence.

Write Targets

  • tests/
  • production/session-state/
  • prototypes/

Output Contract

  • Summary
  • Failure Pattern
  • Isolation
  • Root Cause
  • Stabilization
  • Risks
  • Changed files or proposed files
  • Verification evidence
  • Next owner or decision

Quality Gates

  • Failure Pattern
  • Isolation
  • Root Cause
  • Stabilization
  • Scope remains bounded to the current task and project stage.
  • Report labels unverified assumptions separately from evidence.

Decision Gates

  • Continue only when the expected output can be verified or clearly labeled as a plan.
  • Escalate to producer or qa-playtester when scope, ownership, or acceptance evidence is ambiguous.
  • Stop before broad rewrites, generated prompt mirrors, or hidden lifecycle behavior.

Handoff

Report changed files, verification evidence, remaining risks, and the next owner or decision. Do not imply hidden hooks or autonomous background work.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 7d ago First seen · 81 lines · 47 tokens per session scan A 4cbdae719faf

Subscribe to this mod's changes

cgs-test-flakiness is a skill published in the GitHub repository merlinhu1/codex-game-studio (54 stars, last pushed 1mo ago), licensed MIT. It adds 47 tokens to every session and 584 once invoked, about $0.0002 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-03.

Related

Other skills, from other repositories

smoke-check

Run the critical path smoke test gate before QA hand-off. Executes the automated test suite, verifies core functionality, and produces a PASS/FAIL report. Run after a sprint's stories are implemented and before manual QA begins. A failed smoke check means the build is not ready for QA.

striderZA/OpenCodeGameStudios · 61 tokens

test-fix

Automatically invoke when any test run produces failures. Triggers on: test output showing FAIL, test errors, or assertion failures in unit or E2E suites. Applies a strict 3-attempt limit per failure to avoid debugging spirals — stops and escalates if not resolved. Do NOT wait for user to ask; invoke immediately when…

jerseycheese/agent-skills · 91 tokens

godot-testing-qa

Domain skill — Run a sequence of runtime actions and assertions. Assert runtime node existence and properties. Assert visible runtime text. Compare two PNGs using bounded pixel sampling. Sample runtime performance for a bounded frame count. Return the latest runtime test report.

dcc-mcp/dcc-mcp-godot · 55 tokens

test-master

Generates test files, creates mocking strategies, analyzes code coverage, designs test architectures, and produces test plans and defect reports across functional, performance, and security testing disciplines. Use when writing unit tests, integration tests, or E2E tests; creating test strategies or automation…

eric861129/SKILLS_All-in-one · 104 tokens

javascript-testing-patterns

Implement comprehensive testing strategies using Jest, Vitest, and Testing Library for unit tests, integration tests, and end-to-end testing with mocking, fixtures, and test-driven development. Use when writing JavaScript/TypeScript tests, setting up test infrastructure, or implementing TDD/BDD workflows.

HermeticOrmus/claude-code-game-development · 63 tokens

e2e-testing-patterns

Master end-to-end testing with Playwright and Cypress to build reliable test suites that catch bugs, improve confidence, and enable fast deployment. Use when implementing E2E tests, debugging flaky tests, or establishing testing standards.

HermeticOrmus/claude-code-game-development · 51 tokens