experiment-suite

experiment-suite is a skill for Claude Code, Codex from ssmurfgg04-gif/context-m. It costs 48 tokens per session (2,769 once invoked), scanned A, a copy of experiment-suite, Apache-2.0.

A complete package for running a research experiment, including its design, runnable code, results, figures, and a structured report. Results can be measured, simulated, or illustrative when clearly labelled.

In plain words
What is it for?
Use it to turn a research question into an experiment package with datasets, baselines, metrics, evaluations, and publication-ready charts.
Why use it?
It keeps the experiment plan, implementation, evidence, and written findings together so the work can be reproduced and reviewed.

Skill for Claude CodeCodex

Which agent this was written for is unclear — built for aider. Also seen: mentions Claude Code; mentions Codex; built for aider.

Good fit Use it to turn a research question into an experiment package with datasets, baselines, metrics, evaluations, and publication-ready charts.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/ssmurfgg04-gif/context-m/experiment-suite
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add ssmurfgg04-gif/context-m --skill experiment-suite
Clone the repo
git clone --depth 1 https://github.com/ssmurfgg04-gif/context-m

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for experiment-suite

README.md
[![agentmods](https://agentmods.dev/badge/skills/ssmurfgg04-gif/context-m/experiment-suite/github.svg)](https://agentmods.dev/skills/ssmurfgg04-gif/context-m/experiment-suite)
Your own site
<a href="https://agentmods.dev/skills/ssmurfgg04-gif/context-m/experiment-suite"><img src="https://agentmods.dev/badge/skills/ssmurfgg04-gif/context-m/experiment-suite/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for experiment-suite

Your own site · 80×15
<a href="https://agentmods.dev/skills/ssmurfgg04-gif/context-m/experiment-suite"><img src="https://agentmods.dev/badge/skills/ssmurfgg04-gif/context-m/experiment-suite.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 48 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 2,769 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin 91% copy Near-identical to another mod in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00048 $0.02769
Opus 5.5 $0.00019 $0.01108
Sonnet 5.5 $0.00010 $0.00554
Haiku 4.5 $0.00005 $0.00277

Measured 1mo ago against content hash 44fffe0dfbfe, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

experiment-suite scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 1mo ago.

The scan reads SKILL.md. This mod also ships 4 executable files (figure_examples/make_fig_02_horizon_sweep.py, figure_examples/make_fig_03_heatmap.py, figure_examples/make_fig_04_ablation.py, …), listed below but not scanned — reading those needs a real analyzer, not pattern matching.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

Origin

This is a copy

91% identical to experiment-suite — 42 lines differ, which has more behind it and is treated as the original. This page carries a canonical link to it rather than competing with it.

skills/experiment-suite/SKILL.md · 201 lines

How it starts

The opening of the file, as written. The whole thing — 201 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Experiment Suite

Overview

End-to-end experiment package builder. Single stage, full quality from the start. The agent (Claude Code / Cursor / Aider / Codex / …) writes everything directly using its own tools (Write, Bash, WebFetch, …). This skill contains procedure + reference playbooks + figure-example scripts — no Python runtime, no LLM SDK.

The substantive work is decomposed into reference playbooks under references/:

Reference Topic
references/00-incremental-execution.md how to do this without losing work: batches, persistence, resume — read first
references/01-design-depth.md what a real experiment design contains (motivation → hypothesis → datasets → baselines → metrics → ablations → budget)
references/01a-data-contract.md runtime dataset binding: source, access route, version, split, and reuse boundary
references/02-code-quality.md code-skeleton standards — runnable model.py, data.py, train.py, evaluate.py
references/03-results-protocol.md results.json schema; measured / simulated / illustrative provenance
references/04-publication-figures.md publication-grade charts, multi-panel layouts, taste rules
references/04a-figure-contract.md figure logic before plotting: conclusion, panel map, reviewer risk
references/04b-figure-qa.md export bundle, editable text, statistics and image-integrity QA
references/05-report-structure.md structured experiment_report.md (problem → design → method → results → analysis → limitations)
references/06-quality-gate.md self-check before delivery

Also: figure_examples/ — publication-style matplotlib scripts plus a shared style kit the agent can use as starting points.

Read the relevant reference before writing, not after. The full pass does not fit in a single turn — references/00-incremental-execution.md is the only execution mode that completes.

When to Use

  • User wants to "design an experiment" for a research question.
  • User needs runnable code for a specific task (classification / forecasting / detection / …).
  • User wants to compare methods and have a structured report at the end.
  • User needs publication-quality figures of experimental results.

Read the full file on GitHub · 201 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 1mo ago First seen · 201 lines · 48 tokens per session scan A 44fffe0dfbfe

Subscribe to this mod's changes

experiment-suite is a skill published in the GitHub repository ssmurfgg04-gif/context-m (2 stars, last pushed today), licensed Apache-2.0. It adds 48 tokens to every session and 2,769 once invoked, about $0.0002 per session on Opus 5.5. A static security scan graded it A with 0 findings. It is 91% identical to experiment-suite, differing in 42 lines, and is treated as a copy.

Related

Other skills, from other repositories

agent-memory-discipline

Rules for when an agent should recall from long-term memory before acting and when it should save decisions, corrections and failures afterwards. Works with any memory backend.

sickn33/agentic-awesome-skills · 36 tokens

reward-design

A guide to defining the scores that an AI agent receives during trial-and-error training. It covers checks based on rules, human preferences, or another model, and distinguishes rewarding the final result from rewarding the steps taken.

bojieli/ai-agent-book · 131 tokens

causal

Analyze cause-and-effect relationships in the Semantica knowledge graph — causal chains, interventions, counterfactuals, and causal influence scores.

semantica-agi/semantica · 31 tokens

post-training-strategy

A guide to choosing and planning ways to improve an AI model after its initial training. It explains when to add knowledge, teach a response format, use trial-and-error training, or use a smaller model to learn from a larger one.

bojieli/ai-agent-book · 159 tokens

ai-style

A Chinese-language writing guide for producing or revising reader-facing text such as product announcements, public-account articles, emails, and README files. It focuses on reducing patterns that make writing sound machine-generated.

bojieli/ai-agent-book · 25 tokens

agent-evolution

A guide to making an AI agent improve from its past runs. It covers how to judge results, extract reusable lessons, and decide whether to store them as knowledge, instructions, code, or model training.

bojieli/ai-agent-book · 126 tokens