researchforge-baseline

researchforge-baseline is a skill for Claude Code, Codex from forger-labs-hq/researchforge. It costs 38 tokens per session (526 once invoked), scanned A, original, Apache-2.0.

An experiment setup and baseline-measurement process for an existing software repository. A baseline is the starting result used to compare later changes, while an experiment contract records the rules for testing them.

In plain words
What is it for?
Define the benchmark command, primary metric, constraints, resource limits, permissions, and protected files, then validate and approve the contract and measure the starting version.
Why use it?
It makes the evaluation explicit, limits which files experiments may change, and detects rule changes before results are trusted.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Good fit Define the benchmark command, primary metric, constraints, resource limits, permissions, and protected files, then validate and approve the contract and measure the starting version.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/forger-labs-hq/researchforge/researchforge-baseline
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add forger-labs-hq/researchforge --skill researchforge-baseline
Clone the repo
git clone --depth 1 https://github.com/forger-labs-hq/researchforge

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for researchforge-baseline

README.md
[![agentmods](https://agentmods.dev/badge/skills/forger-labs-hq/researchforge/researchforge-baseline/github.svg)](https://agentmods.dev/skills/forger-labs-hq/researchforge/researchforge-baseline)
Your own site
<a href="https://agentmods.dev/skills/forger-labs-hq/researchforge/researchforge-baseline"><img src="https://agentmods.dev/badge/skills/forger-labs-hq/researchforge/researchforge-baseline/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for researchforge-baseline

Your own site · 80×15
<a href="https://agentmods.dev/skills/forger-labs-hq/researchforge/researchforge-baseline"><img src="https://agentmods.dev/badge/skills/forger-labs-hq/researchforge/researchforge-baseline.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 38 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 526 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00038 $0.00526
Opus 5 $0.00019 $0.00263
Sonnet 5 $0.00008 $0.00105
Haiku 4.5 $0.00004 $0.00053

Measured 10d ago against content hash 61030a346be1, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-09, from the pricing page.

Security

Grade A, and why

researchforge-baseline scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 10d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

src/researchforge/claude/skills/researchforge-baseline/SKILL.md · 66 lines

How it starts

The opening of the file, as written. The whole thing — 66 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Contract and baseline

The contract (researchforge.yaml at the repository root) freezes the evaluation: primary metric + direction, hard constraints, editable vs protected paths, commands, resource limits, network mode, shipping flags. Approval hashes it; later edits are detected as drift and refused until re-approved. The contract is the boundary — experiments can only change editable_paths and are judged only by the contracted benchmark.

1. Draft the contract

researchforge contract generate --json

Then edit researchforge.yaml with the user — these are their choices, not yours: the benchmark command (execution.full_command) must print or write a machine-readable result (execution.result_file), the primary metric must match a key in that result, and permissions.editable_paths / protected_paths decide what experiments may touch. Benchmarks and evaluation code belong in protected_paths.

2. Validate and approve

researchforge contract validate --json

Fix any of the semantic errors it reports (they are field-level and actionable). Then show the user a summary of what they are approving — metric, constraints, commands, limits, paths — and ask them to run:

researchforge contract approve

The approval is a typed confirmation. Only run it with --yes yourself if the user has explicitly said in this conversation to approve this contract.

3. Run the baseline

researchforge baseline run --json
researchforge baseline show --json

The baseline runs in an isolated detached worktree; the user's checkout is never touched. Report the recorded baseline metrics from the JSON. All future experiments are compared against this frozen measurement.

Next: the researchforge-plan skill designs experiments against a hypothesis.

Rules

  • The Python engine is the boundary: never work around a validation error, a protected path, or an approval gate — fix the artifact or ask the user.
  • Approvals belong to the user: never pass --yes or type a confirmation unless the user explicitly approved that step in this conversation.
  • Ground every summary in stored data: quote only numbers returned by --json output or files under .researchforge/ — never invent metrics.

Read the full file on GitHub · 66 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 10d ago First seen · 66 lines · 38 tokens per session scan A 61030a346be1

Subscribe to this mod's changes

researchforge-baseline is a skill published in the GitHub repository forger-labs-hq/researchforge (8 stars, last pushed 7d ago), licensed Apache-2.0. It adds 38 tokens to every session and 526 once invoked, about $0.0002 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.