autoresearch

autoresearch is a skill for Claude Code from synthetic-sciences/openscience. It costs 110 tokens per session (1,647 once invoked), scanned A, original, Apache-2.0.

A guide to running a planned series of training or analysis experiments, changing one idea at a time and recording the results. It uses a chosen metric, baseline, budget, and stopping rules to judge each run.

In plain words
What is it for?
Use it for hyperparameter searches, model training studies, and other experiments where you need ranked ideas, run limits, failure rules, measurements, and a final conclusion.
Why use it?
It keeps repeated experiments comparable and prevents wasted compute or losing track of why a result occurred.

Skill for Claude Code

Written for Claude Code: allowed-tools in frontmatter.

Good fit Use it for hyperparameter searches, model training studies, and other experiments where you need ranked ideas, run limits, failure rules, measurements, and a final conclusion.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/synthetic-sciences/openscience/autoresearch
About the project

synthetic-sciences/openscience is an AI workbench that carries out scientific research by reading papers, forming hypotheses, writing and running code, conducting experiments, analyzing results, and preparing reports. Researchers use it for work in machine learning, biology, physics, and chemistry with remote or local models. Catalogue add-ons extend its scientific workflows through skills and instructions.

synthetic-sciences/openscience · 4,025 stars · on GitHub · openscience.sh

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add synthetic-sciences/openscience --skill autoresearch
Clone the repo
git clone --depth 1 https://github.com/synthetic-sciences/openscience

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for autoresearch

README.md
[![agentmods](https://agentmods.dev/badge/skills/synthetic-sciences/openscience/autoresearch/github.svg)](https://agentmods.dev/skills/synthetic-sciences/openscience/autoresearch)
Your own site
<a href="https://agentmods.dev/skills/synthetic-sciences/openscience/autoresearch"><img src="https://agentmods.dev/badge/skills/synthetic-sciences/openscience/autoresearch/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for autoresearch

Your own site · 80×15
<a href="https://agentmods.dev/skills/synthetic-sciences/openscience/autoresearch"><img src="https://agentmods.dev/badge/skills/synthetic-sciences/openscience/autoresearch.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 110 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,647 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00110 $0.01647
Opus 5.5 $0.00044 $0.00659
Sonnet 5.5 $0.00022 $0.00329
Haiku 4.5 $0.00011 $0.00165

Measured 20d ago against content hash 730a7f582683, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

autoresearch scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 20d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

backend/cli/skills/core/autoresearch/SKILL.md · 110 lines

How it starts

The opening of the file, as written. The whole thing — 110 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Autoresearch

A study turns "make this metric better" into a loop that runs for hours or days without losing the thread. You own the science: which ideas to try, how to implement them, what a result means. OpenScience owns the clock: it tracks every metric the script logs, notices when a run ends, kills runs that break the study's criteria, keeps the budget, renders the ledger, and wakes this session with a "Study update" whenever there is news.

Before the study

  1. Agree the objective with the user: one metric, its direction, the budget, the compute target, how many runs may be live at once, and the kill criteria. The budget is a spend decision and belongs to this study alone: never carry one over from an earlier study or an earlier instruction in the session. If the request names no budget, ask once, with a recommendation (a time budget such as 2 hours with a per-run kill rule, or a target value), even under an autonomous setting. Everything else, infer or default.
  2. Read the code and data first. A study needs a training or analysis script the harness can run repeatedly with different configuration, and a fixed evaluation that computes the metric. The evaluation does not change once the baseline has run.
  3. Create the study with study create. Propose the baseline with priority 1000 and at least three first ideas with study propose, of different kinds (a different component, objective, data treatment or search strategy each), not three magnitudes of one knob. An idea has a title, what it changes, why it should help, an expected improvement in metric units times your confidence, and the configuration it needs; a configuration already in the study is rejected. The hypotheses skill is the tool for turning a vague direction into ideas worth queueing.
  4. If the review gate is on (the default), get a read-only critique of the training and evaluation code before the baseline runs: load the peer-review skill and read it yourself, or delegate one read to an explore worker (Task tool, subagent_type: "explore") with the file paths and the angle (leakage, metric definition, split hygiene). Fix anything marked blocking. A baseline built on a leaking split or a misspelled metric wastes every run after it.

Read the full file on GitHub · 110 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 20d ago Changed · +1 lines 730a7f582683
  2. 1mo ago Changed · +4 lines f9220094ebd3
  3. 1mo ago Changed · +5 lines dd482562ce14
  4. 1mo ago Changed · +2 lines 9806468c6c9a
  5. 1mo ago First seen · 98 lines · 110 tokens per session scan A 4682bbb0d6da

Subscribe to this mod's changes

autoresearch is a skill published in the GitHub repository synthetic-sciences/openscience (4,025 stars, last pushed today), licensed Apache-2.0. It adds 110 tokens to every session and 1,647 once invoked, about $0.0004 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-14.