ml-experiment

ml-experiment is a skill for Claude Code, Codex from Zaoqu-Liu/ScienceClaw. It costs 27 tokens per session (424 once invoked), scanned A, original, MIT.

A workflow for designing and running machine-learning experiments, including model training, comparisons, and statistical evaluation.

In plain words
What is it for?
It helps build training pipelines, search model settings, compare models against baselines, measure task-specific results, and analyse errors.
Why use it?
It helps make experiments reproducible and reduces misleading conclusions by using proper data splits, baselines, ablation studies, confidence intervals, and error analysis.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Good fit It helps build training pipelines, search model settings, compare models against baselines, measure task-specific results, and analyse errors.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/zaoqu-liu/scienceclaw/prismer-ml-experiment
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add Zaoqu-Liu/ScienceClaw --skill prismer-ml-experiment
Clone the repo
git clone --depth 1 https://github.com/Zaoqu-Liu/ScienceClaw

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for ml-experiment

README.md
[![agentmods](https://agentmods.dev/badge/skills/zaoqu-liu/scienceclaw/prismer-ml-experiment/github.svg)](https://agentmods.dev/skills/zaoqu-liu/scienceclaw/prismer-ml-experiment)
Your own site
<a href="https://agentmods.dev/skills/zaoqu-liu/scienceclaw/prismer-ml-experiment"><img src="https://agentmods.dev/badge/skills/zaoqu-liu/scienceclaw/prismer-ml-experiment/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for ml-experiment

Your own site · 80×15
<a href="https://agentmods.dev/skills/zaoqu-liu/scienceclaw/prismer-ml-experiment"><img src="https://agentmods.dev/badge/skills/zaoqu-liu/scienceclaw/prismer-ml-experiment.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 27 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 424 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00027 $0.00424
Opus 5 $0.00014 $0.00212
Sonnet 5 $0.00005 $0.00085
Haiku 4.5 $0.00003 $0.00042

Measured 7d ago against content hash 957fe1013b89, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-10, from the pricing page.

Security

Grade A, and why

ml-experiment scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 7d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

skills/prismer-ml-experiment/SKILL.md · 58 lines

What it actually says

ML Experiment Skill

Description

Design, implement, and evaluate machine learning experiments with reproducible workflows, proper baselines, and statistical analysis.

Tools Used

  • jupyter_execute - Execute ML code in Python (auto-switches to Jupyter)
  • jupyter_notebook - Manage experiment notebooks
  • update_notebook - Set up experiment cells
  • update_latex - Write experiment results to papers
  • latex_compile - Compile CS conference papers (auto-switches to LaTeX)
  • arxiv_to_prompt - Read related work from arXiv papers
  • update_notes - Write experiment logs and analysis summaries

Capabilities

Experiment Design

  • Proper train/validation/test splits
  • Cross-validation and bootstrap confidence intervals
  • Ablation study design
  • Hyperparameter search (grid, random, Bayesian)

Implementation

  • PyTorch and TensorFlow model building
  • Data loading and augmentation pipelines
  • Training loops with logging and checkpointing
  • Distributed training setup

Evaluation

  • Standard metrics per task (accuracy, F1, BLEU, mAP, etc.)
  • Statistical significance testing (paired t-test, bootstrap)
  • Comparison with baselines
  • Error analysis and visualization

Usage Patterns

Run an Experiment

When user says: "Train a model for [task]"

  1. Clarify dataset, metrics, and baselines
  2. Implement data loading and preprocessing
  3. Build model architecture
  4. Train with proper logging
  5. Evaluate and compare to baselines
  6. Report results with confidence intervals

Reproduce a Paper

When user says: "Reproduce [paper title/arXiv ID]"

  1. Fetch paper using arxiv_to_prompt
  2. Extract key method details
  3. Implement core algorithm
  4. Run experiments matching paper setup
  5. Compare results to reported numbers
Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 7d ago First seen · 58 lines · 27 tokens per session scan A 957fe1013b89

Subscribe to this mod's changes

ml-experiment is a skill published in the GitHub repository Zaoqu-Liu/ScienceClaw (60 stars, last pushed 5mo ago), licensed MIT. It adds 27 tokens to every session and 424 once invoked, about $0.0001 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-03.

Related

Other skills, from other repositories

arboreto

Infer gene regulatory networks (GRNs) from gene expression data using scalable algorithms (GRNBoost2, GENIE3). Use when analyzing transcriptomics data (bulk RNA-seq, single-cell RNA-seq) to identify transcription factor-target gene relationships and regulatory interactions. Supports distributed computation for…

K-Dense-AI/scientific-agent-skills · 66 tokens

pyhealth

Build clinical/healthcare deep-learning pipelines with PyHealth — loading EHR/signal/imaging datasets (MIMIC-III/IV, eICU, OMOP, SleepEDF, ChestXray14, EHRShot), defining tasks (mortality, readmission, length-of-stay, drug recommendation, sleep staging, ICD coding, EEG events), instantiating models (Transformer…

K-Dense-AI/scientific-agent-skills · 216 tokens

torchdrug

Build and troubleshoot TorchDrug 0.2.1 workflows for molecular graphs, property prediction, self-supervised pretraining, molecule generation, retrosynthesis, protein representation learning, and knowledge graph reasoning. Use when code imports torchdrug or needs its datasets, models, tasks, or Engine.

K-Dense-AI/scientific-agent-skills · 61 tokens

deepspot-m

Generate transcriptome-wide virtual spatial transcriptomics from H&E histology with DeepSpot-M. Use when you need spatial gene expression in log1p-CPM for 224x224 tiles at about 20x, want to query protein-coding genes by symbol instead of a fixed panel, or want to run prediction across a whole slide after tiling with…

K-Dense-AI/scientific-agent-skills · 80 tokens

nemo-mbridge-perf-expert-parallel-overlap

Validate and use MoE expert-parallel communication overlap in Megatron-Bridge, including overlapmoeexpertparallelcomm, delaywgradcompute, and flex dispatcher backends such as DeepEP and HybridEP.

NVIDIA/skills · 56 tokens

pick-a-pii-model

Select an on-device OpenMed PII model from the committed registry by language, runtime format, and size budget, then require recall validation before deployment. Use when an agent must choose a local PII detector for CPU, Apple Silicon, or a mobile export without relying on live model discovery.

maziyarpanahi/openmed · 64 tokens