testing-strategy

A method for planning which tests a project needs across different test levels and system boundaries.

In plain words
What is it for?
Use it to choose tests for business rules, permissions, calculations, state changes, bugs, refactors, and other changes that cross several parts of a system.
Why use it?
It helps catch meaningful regressions without repeating the same checks or judging quality by test counts alone.

Skill for Claude CodeCodex

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add skills/catwillgh/mainframe/testing-strategy
Any agent
npx skills add CATWILLgh/MAINFRAME --skill testing-strategy
Clone the repo
git clone --depth 1 https://github.com/CATWILLgh/MAINFRAME

Made for: Claude Code, Codex.

Per session 46 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,540 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00046 $0.01540
Opus 5 $0.00023 $0.00770
Sonnet 5 $0.00009 $0.00308
Haiku 4.5 $0.00005 $0.00154

Measured 2d ago against content hash b286df45ef44, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

testing-strategy scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

adapters/claude-code/plugin/skills/testing-strategy/SKILL.md · 141 lines

How it starts

The opening of the file, as written. The whole thing — 141 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Testing strategy

Build enough evidence to catch a meaningful regression without testing the same guarantee repeatedly. Tests protect observable behaviour; they are not a count, coverage percentage, or architectural ceremony.

Apply the strategy within the role assigned by the immediate caller. An implementation owner may create, change, and run tests as part of delivering the behaviour. An audit-only recipient evaluates the existing evidence and records confirmed gaps through ticket; it does not implement the behaviour or author, rewrite, or suppress tests.

Start from the guarantee

Before choosing a test, name the behaviour that must remain true and the failure the test should catch. If neither can be stated, do not manufacture a test.

  • For a bug, reproduce the reported failure at the smallest surface where it is observable.
  • For business rules, validation, calculations, permissions, lifecycle changes, and state transitions, prepare the failing test before the implementation when the behaviour can be expressed automatically.
  • For a refactor with intentionally unchanged behaviour, use existing tests or a focused characterisation test to hold the affected contract stable.
  • For exploratory work, discover the intended guarantee first, then establish the test before treating the result as complete.
  • For documentation-only, generated, or mechanically verifiable changes, use the relevant deterministic check instead of inventing an application test.

Red evidence is useful only when it proves the missing or broken behaviour. A test that fails because of an unrelated setup error is not red evidence.

Choose the cheapest faithful observation

Test at the lowest-cost surface that can fail for the real defect:

Level Use when Avoid when
Unit A pure rule, calculation, parser, validator, state transition, or other defined contract can be observed without I/O The defect is in wiring or boundary semantics
In-process integration Several owned components must cooperate, but real external infrastructure adds no relevant behaviour Mocks would replace the very contract being tested
Real-boundary integration PostgreSQL queries, migrations, indexes, transactions, locking, filesystem formats, queues, or external contracts are the risk It merely repeats business logic already proven cheaply
End-to-end The complete user journey, deployment wiring, or browser behaviour is itself the contract It is used to enumerate business-rule variations that a lower level can prove faster
Characterisation Legacy behaviour must be held stable before a safe change It becomes a permanent substitute for expressing intended behaviour

Read the full file on GitHub · 141 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 2d ago First seen · 141 lines · 46 tokens per session scan A b286df45ef44

Subscribe to this mod's changes

testing-strategy is a skill published in the GitHub repository CATWILLgh/MAINFRAME (2 stars, last pushed 11d ago), licensed MIT. It adds 46 tokens to every session and 1,540 once invoked, about $0.0002 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

discord-webhook

Send trading alerts, signals, and analysis summaries to Discord via webhook. Integrates with realtime-alert-pipeline, trading-brain, and trade-journal-analytics.

mahmoud20138/Tradecraft · 37 tokens

agentforge-protocol

Use when doing non-trivial coding with Hermes, OpenClaw, Claude Code, Codex CLI, or similar autonomous coding agents. Orchestrates Karpathy-style minimal-change discipline, grill-plan intake, TDD, systematic debugging, subagent-driven implementation, spikes, and pre-commit review into one end-to-end workflow.

Yat-mo/agentforge-protocol · 71 tokens

bigquery-ai-ml

Leverages BigQuery's built-in machine learning and GenAI capabilities for advanced data analytics. Use when you need to write SQL queries that perform time-series forecasting, predict values, detect outliers or anomalies, find key drivers, perform semantic search or vector search, classify text, calculate similarity…

google/skills · 104 tokens

edge-to-edge

Use this skill to migrate your Jetpack Compose app to add adaptive edge-to-edge support and troubleshoot common issues. Use this skill to fix UI components (like buttons or lists) that are obscured by or overlapping with the navigation bar or status bar, fix IME insets, and fix system bar legibility.

android/skills · 67 tokens

twitter-reader

Read Twitter/X for financial research using opencli (read-only). Use this skill whenever the user wants to read their Twitter feed, search for financial tweets, view bookmarks, look up user profiles, or gather market sentiment from Twitter/X. Triggers include: "check my feed", "search Twitter for", "show my…

himself65/finance-skills · 161 tokens

referral-program

When the user wants to design, launch, or optimize an in-app referral / invite / share-to-earn program — including reward structure, mechanics, fraud prevention, deep link setup, and viral coefficient measurement. Use when the user mentions "referral program", "invite a friend", "refer and earn", "share to earn"…

Eronred/aso-skills · 159 tokens