testing

A testing skill with two modes: checking whether skills follow required conventions, and reporting the health of a project’s test suite. TDD means test-driven development, but this input describes validation and test reporting rather than TDD itself.

In plain words
What is it for?
Useful for validating skills, running tests in stages, classifying failures, and producing regression-aware health reports.
Why use it?
It finds missing skill files, invalid metadata, incomplete trigger coverage, and regressions or failures across unit, evaluation, integration, and system checks.

Skill for Claude CodeCodex

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add skills/timurgaleev/memex/testing
Any agent
npx skills add timurgaleev/memex --skill testing
Clone the repo
git clone --depth 1 https://github.com/timurgaleev/memex

Made for: Claude Code, Codex.

Per session 65 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 2,090 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00065 $0.02090
Opus 5 $0.00032 $0.01045
Sonnet 5 $0.00013 $0.00418
Haiku 4.5 $0.00006 $0.00209

Measured 2d ago against content hash 8a18a101bf72, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

testing scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

deploy/skills/testing/SKILL.md · 265 lines

How it starts

The opening of the file, as written. The whole thing — 265 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Testing Skill — Validation + Daily Health & Regression Intelligence

Convention: see conventions/quality.md (via get_skill conventions/quality) for the test-before-bulk pattern; this skill enforces it across the project's own test suite.

Two modes

This skill has two related but distinct modes:

  1. Skill conformance validation — the skill layer's own conformance bar (the original 1.0 scope). Validates every skill has SKILL.md with frontmatter, every reference exists, and every skill enumerates and routes.

  2. Project test-suite health (the 1.1 extension) — runs the project's tiered test suite and produces a regression-classified report. Used by the daily timer, container-restart bootstrap, and "how are the tests" prompts.

Pick the mode by trigger.

Mode 1: Skill conformance validation

Contract

This mode guarantees:

  • Every skill directory has a SKILL.md file
  • Every SKILL.md has valid YAML frontmatter (name, description)
  • Every SKILL.md has the required sections
  • list_skills returns every skill directory
  • Every listed skill declares frontmatter triggers: that route to it
  • No MECE violations (duplicate triggers across skills)

Phases

  1. Walk skills directory. List all subdirs containing SKILL.md.
  2. Validate frontmatter. Parse YAML, check required fields.
  3. Validate sections. Check for the required headings.
  4. Check enumeration. Every skill dir must come back from list_skills.
  5. Check routing. Every listed skill must declare triggers:.
  6. Check round-trip. get_skill <slug> returns the file on disk.
  7. Report results.

Automation

bun test tests/brain_resident_skillpack.test.ts   # pack enumeration
memex skillpack check                             # frontmatter contract

The CI-gated check is the package.json test script.

Output format

Skill Validation Report
========================
Skills found:        N
Conformance:         N/N pass
Enumeration:         N/N
Trigger coverage:    N/N
Round-trip:          N/N
MECE violations:     N

Issues:
- <skill>: <issue>

Read the full file on GitHub · 265 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 2d ago First seen · 265 lines · 65 tokens per session scan A 8a18a101bf72

Subscribe to this mod's changes

testing is a skill published in the GitHub repository timurgaleev/memex (8 stars, last pushed 8d ago), licensed MIT. It adds 65 tokens to every session and 2,090 once invoked, about $0.0003 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

design-mcp-server

Design the tool surface, resources, and service layer for a new MCP server. Use when starting a new server, planning a major feature expansion, or when the user describes a domain/API they want to expose via MCP. Produces a design doc at docs/design.md that drives implementation.

cyanheads/obsidian-mcp-server · 62 tokens

add-tool

Scaffold a new MCP tool definition. Use when the user asks to add a tool, create a new tool, or implement a new capability for the server.

cyanheads/obsidian-mcp-server · 35 tokens

api-linter

MCP definition linter rules reference. Use when bun run lint:mcp or bun run devcheck reports a lint error or warning (format-parity, schema-is-object, name-format, server-json-, etc.) and you need to understand the rule, its severity, and how to fix it. Every rule ID the linter emits has an entry in this doc.

cyanheads/obsidian-mcp-server · 86 tokens

api-canvas

DataCanvas primitive reference — a Tier 3 SQL/analytical workspace for tabular MCP servers, backed by DuckDB. Use when registering tables from upstream APIs, running ad-hoc SQL across them, and exporting results. Covers the acquire → register → query → export flow, per-table TTL, the token-sharing pattern for…

cyanheads/obsidian-mcp-server · 85 tokens

api-errors

McpError constructor, JsonRpcErrorCode reference, and error handling patterns for @cyanheads/mcp-ts-core. Use when looking up error codes, understanding where errors should be thrown vs. caught, or using ErrorHandler.tryCatch in services.

cyanheads/obsidian-mcp-server · 54 tokens

field-test

Exercise tools, resources, and prompts against a live HTTP server via MCP JSON-RPC over curl. Starts the server, surfaces the catalog, runs real and adversarial inputs, and produces a tight report with concrete findings and numbered follow-up options. Use after adding or modifying definitions, or when the user asks to…

cyanheads/obsidian-mcp-server · 76 tokens