experiment-pipeline

experiment-pipeline is a skill for Claude Code from EvoScientist/EvoSkills. It costs 129 tokens per session (3,718 once invoked), scanned A, original, Apache-2.0.

A four-stage process for running research experiments: reproduce a baseline, tune settings, test a proposed method, and study which parts matter through ablation. A baseline is a known implementation used for comparison; an ablation removes one part at a time to measure its effect.

In plain words
What is it for?
Organizing experiments, validating baseline results, controlling attempts during tuning, testing a new method, and running ablation studies.
Why use it?
It reduces misleading results caused by testing a new method before confirming that the basic setup works. Stage limits and gate conditions also help stop unproductive runs.

Skill for Claude Code

Written for Claude Code: allowed-tools in frontmatter.

Good fit Organizing experiments, validating baseline results, controlling attempts during tuning, testing a new method, and running ablation studies.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/evoscientist/evoskills/experiment-pipeline
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add EvoScientist/EvoSkills --skill experiment-pipeline
Clone the repo
git clone --depth 1 https://github.com/EvoScientist/EvoSkills

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for experiment-pipeline

README.md
[![agentmods](https://agentmods.dev/badge/skills/evoscientist/evoskills/experiment-pipeline/github.svg)](https://agentmods.dev/skills/evoscientist/evoskills/experiment-pipeline)
Your own site
<a href="https://agentmods.dev/skills/evoscientist/evoskills/experiment-pipeline"><img src="https://agentmods.dev/badge/skills/evoscientist/evoskills/experiment-pipeline/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for experiment-pipeline

Your own site · 80×15
<a href="https://agentmods.dev/skills/evoscientist/evoskills/experiment-pipeline"><img src="https://agentmods.dev/badge/skills/evoscientist/evoskills/experiment-pipeline.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 129 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 3,718 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • Socket pass 14 Apr 2026
  • Snyk warn 14 Apr 2026
  • NVIDIA SkillSpector pass 7 Sept 2026
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00129 $0.03718
Opus 5 $0.00064 $0.01859
Sonnet 5 $0.00026 $0.00744
Haiku 4.5 $0.00013 $0.00372

Measured 9d ago against content hash 88e68f4c1334, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-08, from the pricing page.

Security

Grade A, and why

experiment-pipeline scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 9d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

skills/experiment-pipeline/SKILL.md · 260 lines

How it starts

The opening of the file, as written. The whole thing — 260 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Experiment Pipeline

A structured 4-stage framework for executing research experiments from initial implementation through ablation study, with attempt budgets and gate conditions that prevent wasted effort. This follows the Experiment Tree Search design from the EvoScientist paper, where the engineer agent iteratively generates executable code, runs experiments, and records structured execution results at each stage.

When to Use This Skill

  • User has a planned experiment and needs to organize the execution workflow
  • User wants to systematically validate a novel method against baselines
  • User asks about experiment stages, attempt budgets, or when to move on
  • User needs to reproduce baseline results before testing their method
  • User mentions "experiment pipeline", "baseline first", "ablation study", "stage budget", "experiment execution"

The Pipeline Mindset

Experiments fail for two reasons: wrong order and no stopping criteria. Most researchers jump straight to testing their novel method without verifying their baseline setup, then wonder why results don't make sense. Others spend weeks tuning hyperparameters without a budget, hoping the next run will work.

The 4-stage pipeline solves both problems. It enforces a strict order (each stage validates assumptions the next stage depends on) and assigns attempt budgets (forcing systematic thinking over brute-force iteration).

Before Starting: Load Prior Knowledge

If coming from research-ideation, your research proposal (Step 7) provides the experiment plan — datasets, baselines, metrics, and ablation design — that maps directly to Stages 1-4 below.

Before entering the pipeline, load Experimentation Memory (M_E) from prior cycles:

  1. Refer to the evo-memory skill → Read M_E at /memory/experiment-memory.md
  2. Select the top-1 entry (k_E=1) most relevant to the current experiment domain by comparing each entry's Context and Category against the current problem
  3. The selected strategy informs hyperparameter ranges (Stage 2), debugging approaches (Stages 1-3), and training configurations across all stages
  4. If M_E doesn't exist yet (first cycle), skip this step and proceed — your results will seed M_E via ESE after pipeline completion

Read the full file on GitHub · 260 lines

Files

What ships with it

5 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 9d ago First seen · 260 lines · 129 tokens per session scan A 88e68f4c1334

Subscribe to this mod's changes

experiment-pipeline is a skill published in the GitHub repository EvoScientist/EvoSkills (436 stars, last pushed 8d ago), licensed Apache-2.0. It adds 129 tokens to every session and 3,718 once invoked, about $0.0006 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

deltasci

Two-perspective co-reasoning for AI4Science hypothesis generation. Runs a structured 4-round dialogue between a domain scientist (parameterized by a domain pack) and an ML engineer, producing a grounded, falsifiable research hypothesis that is honest about the AI's training-distribution edges. Domain-agnostic via…

boheling/deltasci · 117 tokens

skill-creator

Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, update or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.

EvoScientist/EvoScientist · 63 tokens

bio-ortholog-inference

Pull pre-computed ortholog calls from public databases (OrthoDB, Ensembl Compara, OMA browser, eggNOG, PANTHER, KEGG Orthology, HomoloGene) via their REST APIs. Use when orthologs are already curated upstream, when the question is "what is the X ortholog of Y" rather than "how to infer orthology de novo", when…

PKU-YuanGroup/OpenAI4S · 141 tokens

bioprobench

Score an LLM's biological-protocol reasoning on the BioProBench benchmark: protocol QA, step ordering, error detection, protocol generation, and LLM-judged error reasoning; or generate the responses.

PKU-YuanGroup/OpenAI4S · 46 tokens

arxiv-package

Package a TeX/LaTeX project into a clean tarball or zip for arXiv upload: file selection, build-artifact exclusion, 00README.XXX generation, ancillary file organization, archive validation. Triggers on: "package for arXiv", "create arXiv tarball", "bundle submission", "zip for arXiv", "prepare arXiv upload", "arXiv…

Mathews-Tom/armory · 105 tokens

paper2poster

Convert academic papers (PDF) into conference posters (HTML/PNG). You are the conductor: you decide what each section needs — an original paper figure or text — write the outline, hand-author the poster HTML, and iterate on the render using your own visual read and a blind-reader content quiz. Use when the user wants…

QuZhan51496/paper2anything · 76 tokens