circleci-smarter-testing

circleci-smarter-testing is a skill for Claude Code, Codex from fanfan-de/anybox. It costs 80 tokens per session (1,017 once invoked), scanned A, original, MIT.

A setup and checking guide for CircleCI Smarter Testing, a CircleCI service that selects, splits, and retries tests in continuous integration. It works with a test-suites YAML file and the CircleCI command line.

In plain words
What is it for?
Use it to create or update `.circleci/test-suites.yml`, connect the suite to CI, and check test impact analysis, dynamic test splitting, and automatic retries.
Why use it?
It helps diagnose test-suite configuration, test commands, JUnit results, and related errors before you add more troubleshooting steps.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Good fit Use it to create or update .circleci/test-suites.yml, connect the suite to CI, and check test impact analysis, dynamic test splitting, and automatic retries.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/fanfan-de/anybox/smarter-testing
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add fanfan-de/anybox --skill smarter-testing
Clone the repo
git clone --depth 1 https://github.com/fanfan-de/anybox

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for circleci-smarter-testing

README.md
[![agentmods](https://agentmods.dev/badge/skills/fanfan-de/anybox/smarter-testing/github.svg)](https://agentmods.dev/skills/fanfan-de/anybox/smarter-testing)
Your own site
<a href="https://agentmods.dev/skills/fanfan-de/anybox/smarter-testing"><img src="https://agentmods.dev/badge/skills/fanfan-de/anybox/smarter-testing/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for circleci-smarter-testing

Your own site · 80×15
<a href="https://agentmods.dev/skills/fanfan-de/anybox/smarter-testing"><img src="https://agentmods.dev/badge/skills/fanfan-de/anybox/smarter-testing.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 80 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,017 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • NVIDIA SkillSpector pass 7 Sept 2026
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00080 $0.01017
Opus 5 $0.00040 $0.00508
Sonnet 5 $0.00016 $0.00203
Haiku 4.5 $0.00008 $0.00102

Measured 8d ago against content hash b2f847d0ce4c, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-11, from the pricing page.

Security

Grade A, and why

circleci-smarter-testing scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 8d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

plugins/Anybox-Plugins/circleci/skills/smarter-testing/SKILL.md · 65 lines

How it starts

The opening of the file, as written. The whole thing — 65 lines — stays where its author put it; the contents beside it link to each section on GitHub.

CircleCI Smarter Testing

Overview

Beta (Discuss). Create or adjust .circleci/test-suites.yml, wire it into CI, and validate with --doctor until checks pass. Let doctor diagnose YAML, command, JUnit, and testsuite errors before adding extra guidance.

Doctor command (required)

The testsuite CLI uses Bubble Tea and must run with a TTY. When iterating with --doctor, the agent must always run this exact command (substitute the suite name only):

script -q /dev/null circleci run testsuite "<suite name>" --doctor

Do not modify this command: no pipes, tail, redirects, backgrounding, or truncation.

Scope: testsuite setup and validation. Not legacy circleci tests run / timings-only JUnit tuning → circleci-config (test-results-and-splitting.md). Primary doc: Getting started.

Lazy references: read only what the task needs—do not load every reference file up front.

Inputs To Gather

  • Runner, test root, existing .circleci/config.yml
  • Optional: TIA, dynamic splitting, auto-rerun limits
  • Hand off: circleci-cli (install/auth/plugin) | circleci-config (JUnit/circleci tests run without testsuite) | circleci-builds (CI fails after doctor-clean config)

Workflow

  1. Inspect — runner, layout, existing CI; reuse documented test commands; run testsuite from the test root (no cd in YAML).
  2. Baseline.circleci/test-suites.yml with name, discover, run, outputs.junit (see runners.md).
  3. Doctor — run the exact command above; apply its guidance; repeat until pass.
  4. Local vs CI — Local needs CLI + testsuite plugin (brew install circleci/tap/circleci-testsuite on macOS; binaries on Linux/WSL). CI uses circleci run testsuite on executors + ci-and-junit.md.
  5. Optional features — only if asked; see optional-features.md; doctor after each change.
  6. Verify — full circleci run testsuite "<suite name>"; optional TIA/rerun checks per docs.

Read the full file on GitHub · 65 lines

Files

What ships with it

3 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 8d ago First seen · 65 lines · 80 tokens per session scan A b2f847d0ce4c

Subscribe to this mod's changes

circleci-smarter-testing is a skill published in the GitHub repository fanfan-de/anybox (57 stars, last pushed 28d ago), licensed MIT. It adds 80 tokens to every session and 1,017 once invoked, about $0.0004 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-03.