agentmods.dev

skill-optimizer AGENTS.md

Project instructions for skill-optimizer, a Docker workbench that runs and grades coding-agent evaluation cases. It documents the project overview, commands, important files, and installation information.

In plain words
What is it for?
Use it when working on the CLI, workbench runners, graders, Docker setup, plugin manifests, example evaluation suites, or provider-specific installation docs.
Why use it?
It gives an agent the project context needed to run builds, tests, type checks, command-line help, and evaluation suites without searching through the repository first.

Instructions file for CodexOpenCode

77 3mo ago A scan 830 tokens original MIT
View the source file fastxyz/skill-optimizer
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add instructions/fastxyz/skill-optimizer/agents-md
Clone the repo
git clone --depth 1 https://github.com/fastxyz/skill-optimizer

Made for: Codex, OpenCode.

Per session 830 This file is loaded in full into every session.
When invoked 830 The same file — it is already loaded in full.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00830 $0.00830
Opus 5 $0.00415 $0.00415
Sonnet 5 $0.00166 $0.00166
Haiku 4.5 $0.00083 $0.00083

Measured 2d ago against content hash 266b243c4060, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

skill-optimizer AGENTS.md scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

Origin

Copies of this mod

1 near-identical copy found in the catalogue:

AGENTS.md · 62 lines

How it starts

The opening of the file, as written. The whole thing — 62 lines — stays where its author put it; the contents beside it link to each section on GitHub.

AGENTS.md

Project Overview

skill-optimizer is a Docker workbench for running and grading agent skill eval cases. The current public CLI centers on run-case and run-suite.

Key Commands

npm run build
npm run typecheck
npm test
npx tsx src/cli.ts --help
npx tsx src/cli.ts run-case --help
npx tsx src/cli.ts run-suite --help

Important Files

  • src/cli.ts: public CLI entrypoint
  • src/workbench/: workbench case loading, suite loading, Docker runner, Pi agent, graders, and traces
  • docker/workbench-runner.Dockerfile: generic non-root container image for setup, agent, grade, and cleanup phases
  • skills/skill-optimizer/SKILL.md: canonical distributable Agent Skill
  • .claude-plugin/, .codex-plugin/, .cursor-plugin/, .opencode/: cross-agent plugin manifests and install support
  • .agents/plugins/marketplace.json: Codex repo marketplace entry for the root plugin
  • gemini-extension.json, GEMINI.md: Gemini extension metadata and context file
  • examples/workbench/: tracked example eval suites
  • README.md: provider-specific installation instructions for Claude Code, Codex, Cursor, OpenCode, Gemini CLI, and skill-only installs
  • CONTRIBUTING.md: contributor workflow and current workbench invariants

Installation Docs

Keep the README installation section aligned with packaged plugin metadata:

  • Claude Code: .claude-plugin/plugin.json and .claude-plugin/marketplace.json
  • Codex: .agents/plugins/marketplace.json and .codex-plugin/plugin.json
  • Cursor: .cursor-plugin/plugin.json and .cursor/INSTALL.md
  • OpenCode: .opencode/plugins/skill-optimizer.js and .opencode/INSTALL.md
  • Gemini CLI: gemini-extension.json and GEMINI.md
  • Skill-only installs: npx skills add fastxyz/skill-optimizer --skill skill-optimizer ...

Invariants

  • Keep evaluation static: extraction and matching are allowed; do not execute model-produced code outside the Docker workbench as part of evaluation.
  • run-suite uses models from suite.yml; do not add a run-suite --models override.
  • Keep OpenRouter model refs as openrouter/...; real model runs require OPENROUTER_API_KEY.
  • Cases use graders: [{ name, command }]; legacy check: and artifacts: are invalid.
  • Graders are the acceptance contract; evaluate outputs from /work, generated artifacts, answer.json, trace.jsonl, and result state.
  • The agent phase sees only /work, not /case or /results.
  • Keep plugin metadata pointed at the canonical skills/skill-optimizer/SKILL.md; do not create divergent skill copies.
  • Codex plugin metadata lives in .codex-plugin/plugin.json; the repo marketplace lives in .agents/plugins/marketplace.json and points at ./.
  • Provider install docs should link to the same canonical skill/plugin metadata, not separate skill copies.
  • Do not commit .skill-eval/, .results/, .env, or credentials.

Read the full file on GitHub · 62 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 2d ago First seen · 62 lines · 830 tokens per session scan A 266b243c4060

Subscribe to this mod's changes

skill-optimizer AGENTS.md is an instructions file published in the GitHub repository fastxyz/skill-optimizer (77 stars, last pushed 3mo ago), licensed MIT. It adds 830 tokens to every session, about $0.0042 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Data and AIDevOps and cloudEvaluationWriting and docsaiai-agentai-skillbenchmarkcli
Related

Other instructions, from other repositories

ClawBench AGENTS.md

Instructions for TIGER-AI-Lab/ClawBench, covering clawbench -- agent context, what this is, project structure, setup and 2. configure at least one model.

TIGER-AI-Lab/ClawBench · 1,679 tokens

inspect-robots CLAUDE.md

Instructions for robocurve/inspect-robots, covering inspect robots — agent guide, the one big idea, layout, working here and out of scope (separate repos / plugins).

robocurve/inspect-robots · 2,035 tokens

argus-validation-benchmarks CLAUDE.md

Instructions for pensar-x/argus-validation-benchmarks, covering project overview, what you're building, the goal, success criteria and what is apex?.

pensar-x/argus-validation-benchmarks · 8,584 tokens

benchjack CLAUDE.md

Instructions for benchjack/benchjack, covering claude.md, project overview, tech stack, repository layout and common commands.

benchjack/benchjack · 614 tokens

AgentBench-Live CLAUDE.md

Instructions for jackjin1997/AgentBench-Live, covering agentbench-live, project goal, strategy: credibility first, then ride the wave, current sprint scope (accepted from ceo review 2026-03-19) and deferred (todos).

jackjin1997/AgentBench-Live · 536 tokens

agent-bench AGENTS.md

Instructions for cipherfoxie/agent-bench, covering agents, multi-agent contract for agent-bench, project ethos, rules and adding an experiment (the only common task).

cipherfoxie/agent-bench · 784 tokens