SkillsBench is a benchmark for measuring how effectively AI agents use modular skills—folders containing instructions, scripts, and resources—to complete specialized tasks. It helps researchers and developers evaluate both skill quality and agent behavior, including tasks that require combining multiple skills. The catalogue’s skills and instructions are evaluated as part of this workflow.
Getting it into your agent
One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.
npx skills add benchflow-ai/skillsbench --skill scip-optgit clone --depth 1 https://github.com/benchflow-ai/skillsbenchWrote this? Show the measurements
A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.
[](https://agentmods.dev/skills/benchflow-ai/skillsbench/scip-opt)<a href="https://agentmods.dev/skills/benchflow-ai/skillsbench/scip-opt"><img src="https://agentmods.dev/badge/skills/benchflow-ai/skillsbench/scip-opt/github.svg" alt="Measured on agentmods" height="20"></a>Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.
<a href="https://agentmods.dev/skills/benchflow-ai/skillsbench/scip-opt"><img src="https://agentmods.dev/badge/skills/benchflow-ai/skillsbench/scip-opt.svg" alt="Reviewed on agentmods" width="80" height="20"></a>- NVIDIA SkillSpector pass
What it costs to keep this loaded
Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.
| Model | Per session | Once invoked |
|---|---|---|
| Fable 5.1 | $0.00067 | $0.01829 |
| Opus 5 | $0.00034 | $0.00915 |
| Sonnet 5 | $0.00013 | $0.00366 |
| Haiku 4.5 | $0.00007 | $0.00183 |
Grade A, and why
scip-opt scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 9d ago.
A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.
Nothing flagged
None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.
How it starts
The opening of the file, as written. The whole thing — 228 lines — stays where its author put it; the contents beside it link to each section on GitHub.
SCIP Optimization
Use SCIP through pyscipopt when a task asks you to minimize or maximize an objective subject to constraints.
SCIP is a strong open-source optimization solver with a Python API. It is well suited for mixed-integer optimization, routing-style models, assignment models, capacity planning, inventory movement, scheduling, and problems with soft penalties. For benchmark tasks, a SCIP-backed model plus an independent validator is usually safer than a greedy construction.
When To Use
Consider PySCIPOpt when the request includes:
- an objective such as minimizing cost, distance, time, unmet demand, or penalty;
- yes/no choices, route arcs, assignments, selected items, or ordering decisions;
- integer or continuous quantities such as load, inventory, flow, served units, or slack;
- hard rules that every valid answer must satisfy;
- soft rules that can be violated with an explicit penalty.
Do not start by installing another optimization package. First check whether PySCIPOpt is already available:
try:
from pyscipopt import Model, quicksum
except ImportError as exc:
raise RuntimeError("PySCIPOpt is required for this optimization approach") from exc
Modeling Workflow
-
Identify sets and indices.
- Examples: vehicles
K, stationsN, jobsJ, periodsT, arcsA. - Build explicit mappings when input IDs are not contiguous.
- Examples: vehicles
-
Define decision variables.
- Binary variables for choices, visits, assignments, route arcs, or modes.
- Integer variables for counts, loads, inventory moves, or unmet units.
- Continuous variables for flows, costs, times, slacks, or resource levels.
-
Add hard constraints.
- Conservation, capacity, bounds, linking, continuity, inventory limits, and mutual exclusion.
-
Add soft constraints with explicit slack variables.
- Never use Python
abs()on solver expressions. - Linearize absolute deviation with two inequalities.
- Never use Python
-
Set a single objective.
- Keep named objective components such as travel cost and penalty cost.
What this file has done since we first saw it
Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.
- 9d ago First seen · 228 lines · 67 tokens per session scan A 17f98241df70
scip-opt is a skill published in the GitHub repository benchflow-ai/skillsbench (1,754 stars, last pushed 1mo ago), licensed Apache-2.0. It adds 67 tokens to every session and 1,829 once invoked, about $0.0003 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.
Other skills, from other repositories
run-aeon-benchmark
Use when asked to run, benchmark, evaluate, or score an LLM with AEON Bench. You run the AEON Bench Pod on the user's machine, point it at a model, run the benchmark, and submit the signed result to the public leaderboard at aeon-bench.com. All work happens on the pod. The mothership only shows the board and accepts…
data-matching
Matching observation data to simulation output with exact datetime and depth binning.
model-calibration
Calculating RMSE metrics and parameter calibration for lake model validation.
dbscan-custom-metric
Run DBSCAN clustering with a custom distance metric using sklearn, including how to define weighted Euclidean metrics and extract cluster centroids.
greedy-bipartite-matching
Implement greedy bipartite matching for pairing cluster centroids with expert annotations.
plate-tectonics-geospatial
Analyze plate tectonics data using GeoPandas, identify points within plates, and calculate distances to boundaries.