test-skill

test-skill is a skill for Claude Code from digital-stoic-org/agent-skills. It costs 44 tokens per session (580 once invoked), scanned A, original, MIT.

A tool for creating and running behavioural tests for coding-agent skills. It uses pytest, a Python testing framework, and runs the tests in Docker, a way to execute software in an isolated environment.

In plain words
What is it for?
It helps scaffold pytest files from a template, define smoke-test scenarios, and run skill tests in the Docker harness.
Why use it?
It makes it easier to check whether a skill behaves as expected and catch regressions after changes.

Skill for Claude Code

Written for Claude Code: allowed-tools in frontmatter. Also seen: model in frontmatter; names the AskUserQuestion tool; mentions Claude Code.

Part of the experimental plugin — 9 skills, 1 agent shipped together

Good fit It helps scaffold pytest files from a template, define smoke-test scenarios, and run skill tests in the Docker harness.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/digital-stoic-org/agent-skills/test-skill
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add digital-stoic-org/agent-skills --skill test-skill
Clone the repo
git clone --depth 1 https://github.com/digital-stoic-org/agent-skills

Made for: Claude Code.

Or install experimental, the plugin that ships this one along with the rest of its 9 skills, 1 agent.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for test-skill

README.md
[![agentmods](https://agentmods.dev/badge/skills/digital-stoic-org/agent-skills/test-skill/github.svg)](https://agentmods.dev/skills/digital-stoic-org/agent-skills/test-skill)
Your own site
<a href="https://agentmods.dev/skills/digital-stoic-org/agent-skills/test-skill"><img src="https://agentmods.dev/badge/skills/digital-stoic-org/agent-skills/test-skill/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for test-skill

Your own site · 80×15
<a href="https://agentmods.dev/skills/digital-stoic-org/agent-skills/test-skill"><img src="https://agentmods.dev/badge/skills/digital-stoic-org/agent-skills/test-skill.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 44 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 580 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00044 $0.00580
Opus 5.5 $0.00018 $0.00232
Sonnet 5.5 $0.00009 $0.00116
Haiku 4.5 $0.00004 $0.00058

Measured 1mo ago against content hash fe8fe9c54e36, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

test-skill scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 1mo ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

experimental/skills/test-skill/SKILL.md · 47 lines

What it actually says

Test Skill

Scaffold + run behavioral tests for a skill in the Docker test harness.

⚠️ AskUserQuestion Guard

CRITICAL: After EVERY AskUserQuestion call, check if answers are empty/blank. Known Claude Code bug: outside Plan Mode, AskUserQuestion silently returns empty answers without showing UI.

If answers are empty: DO NOT proceed with assumptions. Instead:

  1. Output: "⚠️ Questions didn't display (known Claude Code bug outside Plan Mode)."
  2. Present the options as a numbered text list and ask user to reply with their choice number.
  3. WAIT for user reply before continuing.

Arguments

From $ARGUMENTS: skill_name (positional, kebab-case), --run-only, --scaffold-only.

Derive: snake_name = - → _, test_file = test/tests/test_{snake_name}.py, golden_file = test/fixtures/golden/{skill_name}-smoke.md.

Steps

1. Validate — dstoic/skills/{skill_name}/SKILL.md must exist. Error if not.

2. Scaffold test (skip if --run-only) — If test_file exists → skip to 4. Otherwise AskUserQuestion:

  • "What scenario should the smoke test cover?" (header: Scenario)
  • "What YES/NO question should the LLM judge answer?" (header: Judge Q)

Generate test_file from template in reference.md. Derive prompt from scenario.

3. Scaffold golden (skip if --run-only) — If golden_file exists → skip. Read source SKILL.md → generate simplified version: frontmatter (name+description) + minimal body. Under 250 tokens.

4. Run (skip if --scaffold-only)

docker compose -f test/docker-compose.test.yml run --rm skill-tester pytest tests/test_{snake_name}.py -v -s

5. Report — Parse test/output/{snake_name}_smoke.yaml: status, judge verdict/reason, cost USD. Also show latest trace file test/output/{snake_name}_smoke_trace_*.yaml.

Files

What ships with it

1 file beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 1mo ago First seen · 47 lines · 44 tokens per session scan A fe8fe9c54e36

Subscribe to this mod's changes

test-skill is a skill published in the GitHub repository digital-stoic-org/agent-skills (20 stars, last pushed 12d ago), licensed MIT. It adds 44 tokens to every session and 580 once invoked, about $0.0002 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-04.

Related

Other skills, from other repositories

research-engineer

An uncompromising Academic Research Engineer. Operates with absolute scientific rigor, objective criticism, and zero flair. Focuses on theoretical correctness, formal verification, and optimal implementation across any required technology.

davila7/claude-code-templates · 43 tokens

eval-dataset-design

A guide to creating reliable test sets for AI agents. Each evaluation task includes the request, the simulated user's behaviour, a reset starting state, and a success check that can be independently verified.

bojieli/ai-agent-book · 138 tokens

tika-eval-compare

Compare extracts from two Tika builds over a corpus to detect regressions in content, encoding, exceptions, and embedded-document handling. Use for "compare before/after extracts", "eval this change against the corpus".

apache/tika · 50 tokens

cua-driver

Use Cua Driver for desktop or browser tasks that are awkward or unavailable through Bash/APIs, or when the user explicitly wants GUI interaction: app testing, visual bug reproduction, form filling, calendar entry, screenshots, and demo recording. Also covers Cua setup; not OpenAI Codex Computer Use or web research.

davidondrej/skills · 68 tokens

jetson-validate-image

Use after jetson-flash-image to run static BSP checks, on-target smoke/regression tests on a flashed DUT, or both. Not for build or flash steps. Triggers: validate bsp, on-target validation.

NVIDIA/skills · 50 tokens

atmos-validation

Validate Atmos projects, components, arbitrary JSON Schema inputs, EditorConfig, and GitHub Actions; use affected-file selection and native CI annotations.

cloudposse/atmos · 31 tokens