benchflow-ai/skillsbench

SkillsBench evaluates how well skills work and how effective agents are at using them.

About the project

SkillsBench is a benchmark for measuring how effectively AI agents use modular skills—folders containing instructions, scripts, and resources—to complete specialized tasks. It helps researchers and developers evaluate both skill quality and agent behavior, including tasks that require combining multiple skills. The catalogue’s skills and instructions are evaluated as part of this workflow.

This repository also configures its own agents. See what skillsbench tells them →

1.8kStars on the repository
200Mods indexed here, across every type
1mo agoLast push, which is what freshness is scored on
Apache-2.0Licence, which decides whether bodies are shown

azure-bgp

49

benchflow-ai/skillsbench

Skill Claude CodeCodex

Analyze and resolve BGP oscillation and BGP route leaks in Azure Virtual WAN–style hub-and-spoke topologies (and similar cloud-managed BGP environments). Detect preference cycles, identify valley-free violations, and propose allowed policy-level mitigations while rejecting prohibited fixes.

not rated 1.8k +10 1mo ago A SkillSpector: pass 58 tokens original Apache-2.0

benchflow-ai/skillsbench

Skill Claude CodeCodex

Geospatial routing data handling for depot and station coordinates, route node IDs, internal index mappings, great-circle distance matrices, and route-distance reconstruction. Use when optimization or reporting tasks involve latitude/longitude, station IDs, depots, distance metrics, vehicle routes, or validating…

not rated 1.8k +10 1mo ago A SkillSpector: pass 65 tokens original Apache-2.0

benchflow-ai/skillsbench

Skill Claude CodeCodex

Translate logistics and operations rules into optimization variables and constraints. Use when an operations problem describes vehicles, routes, depots, pickups, dropoffs, inventory, capacity, assignments, time windows, service targets, penalties, resource limits, or other business rules that need to become an…

not rated 1.8k +10 1mo ago A SkillSpector: pass 66 tokens original Apache-2.0

benchflow-ai/skillsbench

Skill Claude CodeCodex

Subtour-elimination methods for TSP, VRP, pickup/dropoff routing, and routing MIPs with binary arc variables. Use when route-continuity constraints may permit disconnected cycles and the model needs MTZ constraints, flow-based connectivity constraints, DFJ subset cuts, or lazy/iterative subtour cuts.

not rated 1.8k +10 1mo ago A SkillSpector: pass 70 tokens original Apache-2.0

scip-opt

53

benchflow-ai/skillsbench

Skill Claude CodeCodex

SCIP optimization with PySCIPOpt. Use when facing an optimization problem with an objective, hard constraints, soft penalties, integer decisions, routing, assignment, scheduling, allocation, packing, capacity, inventory, or service-level rules. Prefer modeling and solving the problem with PySCIPOpt when it is…

not rated 1.8k +10 1mo ago A SkillSpector: pass 67 tokens original Apache-2.0

citation-management

54

benchflow-ai/skillsbench

Skill Claude Code needs its repo

Comprehensive citation management for academic research. Search Google Scholar and PubMed for papers, extract accurate metadata, validate citations, and generate properly formatted BibTeX entries. This skill should be used when you need to find papers, verify citation information, convert DOIs to BibTeX, or ensure…

not rated 1.8k +10 1mo ago A 68 tokens copy · 89% Apache-2.0

civ6lib

55

benchflow-ai/skillsbench

Skill Claude CodeCodex

Civilization 6 district mechanics library. Use when working with district placement validation, adjacency bonus calculations, or understanding Civ6 game rules.

not rated 1.8k +10 1mo ago A SkillSpector: pass 32 tokens original Apache-2.0

hex-grid-spatial

56

benchflow-ai/skillsbench

Skill Claude CodeCodex

Hex grid spatial utilities for offset coordinate systems. Use when working with hexagonal grids, calculating distances, finding neighbors, or spatial queries on hex maps.

not rated 1.8k +10 1mo ago A SkillSpector: pass 35 tokens original Apache-2.0

benchflow-ai/skillsbench

Skill Claude CodeCodex

Strategy for solving constraint optimization problems on spatial maps. Use when you need to place items on a grid/map to maximize some objective while satisfying constraints.

not rated 1.8k +10 1mo ago A SkillSpector: pass 35 tokens original Apache-2.0

sqlite-map-parser

58

benchflow-ai/skillsbench

Skill Claude CodeCodex

Parse SQLite databases into structured JSON data. Use when exploring unknown database schemas, understanding table relationships, and extracting map data as JSON.

not rated 1.8k +10 1mo ago A SkillSpector: pass 30 tokens original Apache-2.0

pymatgen

59

benchflow-ai/skillsbench

Skill Claude CodeCodex

Materials science toolkit. Crystal structures (CIF, POSCAR), phase diagrams, band structure, DOS, Materials Project integration, format conversion, for computational materials science.

not rated 1.8k +10 1mo ago A 38 tokens copy · 88% Apache-2.0

sympy

60

benchflow-ai/skillsbench

Skill Claude CodeCodex

Use this skill when working with symbolic mathematics in Python. This skill should be used for symbolic computation tasks including solving equations algebraically, performing calculus operations (derivatives, integrals, limits), manipulating algebraic expressions, working with matrices symbolically, physics…

not rated 1.8k +10 1mo ago A 98 tokens copy · 91% Apache-2.0

pcap-analysis

61

benchflow-ai/skillsbench

Skill Claude CodeCodex

Guidance for analyzing network packet captures (PCAP files) and computing network statistics using Python, with tested utility functions.

not rated 1.8k +10 1mo ago A SkillSpector: pass 28 tokens original Apache-2.0

threat-detection

62

benchflow-ai/skillsbench

Skill Claude CodeCodex

Exact detection thresholds for identifying malicious network patterns including port scans, DoS attacks, and beaconing behavior.

not rated 1.8k +10 1mo ago A SkillSpector: pass 26 tokens original Apache-2.0

d3-visualization

63

benchflow-ai/skillsbench

Skill Claude CodeCodex

Build deterministic, verifiable data visualizations with D3.js (v6). Generate standalone HTML/SVG (and optional PNG) from local data files without external network dependencies. Use when tasks require charts, plots, axes/scales, legends, tooltips, or data-driven SVG output.

not rated 1.8k +10 1mo ago A SkillSpector: pass 64 tokens original Apache-2.0

grpo

64

benchflow-ai/skillsbench

Skill Claude CodeCodex

Reference for the GRPO (Group Relative Policy Optimization) algorithm. Use when implementing, debugging, or verifying a GRPO training pipeline — covers the mathematical formulation (group-relative advantages, clipped surrogate loss, KL penalty), the training loop (generate → score → advantage → loss), log-probability…

not rated 1.8k +10 1mo ago A SkillSpector: warn 77 tokens original Apache-2.0

rl-post-training

65

benchflow-ai/skillsbench

Skill Claude CodeCodex

Diagnostic guide for RL-based post-training of language models (GRPO, PPO, REINFORCE, DPO). Use proactively when debugging a training pipeline that shows no improvement, loss anomalies, reward stagnation, NaN gradients, or other unexpected behavior during reinforcement learning fine-tuning. Work through all pipeline…

not rated 1.8k +10 1mo ago A SkillSpector: pass 126 tokens original Apache-2.0

trl

66

benchflow-ai/skillsbench

Skill Claude CodeCodex

Reference for the TRL (Transformer Reinforcement Learning) library codebase. Use proactively before reading or editing any file under trl/ so you have the intended contracts and invariants in mind, not just what the current code says. Covers trainer hierarchy (SFT, DPO, GRPO, KTO), shared utility functions…

not rated 1.8k +10 1mo ago A SkillSpector: pass 100 tokens original Apache-2.0

dialogue-graph

67

benchflow-ai/skillsbench

Skill Claude CodeCodex

A library for building, validating, visualizing, and serializing dialogue graphs. Use this when parsing scripts or creating branching narrative structures.

not rated 1.8k +10 1mo ago A SkillSpector: pass 32 tokens original Apache-2.0

benchflow-ai/skillsbench

Skill Claude CodeCodex

Use this skill when implementing the inner control loop for a quadrotor — attitude (roll/pitch/yaw) PID control and attitude planning (converting desired acceleration to desired Euler angles). Covers gain layout, integral reset pattern, and the attitude planner inverse kinematics.

not rated 1.8k +10 1mo ago A SkillSpector: warn 60 tokens original Apache-2.0

flight-plan-parser

69

benchflow-ai/skillsbench

Skill Claude CodeCodex

Use this skill when converting natural language flight commands into waypoints and timing for a drone simulator. Covers parsing commands like "Take off to X m height in Y seconds", "Hover at X m height for Y seconds", "Fly from (x,y,z) to (x',y',z') in T seconds", and "Land from X m height in Y seconds" into…

not rated 1.8k +10 1mo ago A SkillSpector: pass 93 tokens original Apache-2.0

benchflow-ai/skillsbench

Skill Claude CodeCodex

Use this skill when simulating quadrotor physical dynamics — mapping desired thrust/moments to individual motor RPMs via a propeller allocation matrix, applying first-order motor lag, and integrating the nonlinear equations of motion (translational and rotational) using RK45.

not rated 1.8k +10 1mo ago A SkillSpector: pass 59 tokens original Apache-2.0

plot-quadrotor

71

benchflow-ai/skillsbench

Skill Claude CodeCodex

Use this skill when visualising drone simulation results. Produces three matplotlib figures — desired vs actual trajectories, instantaneous error, and cumulative absolute error — for all 5 state groups (position, orientation, velocity, angular velocity, acceleration). Saves figures to a plots/ directory automatically.

not rated 1.8k +10 1mo ago A SkillSpector: pass 62 tokens original Apache-2.0

benchflow-ai/skillsbench

Skill Claude CodeCodex

Use this skill when implementing the outer control loop for a quadrotor — position PID control (position/velocity error → thrust and desired acceleration) and trajectory planning from flight-plan waypoints (takeoff, hover, fly, land segments → smooth 15-row state matrix).

not rated 1.8k +10 1mo ago A SkillSpector: pass 62 tokens original Apache-2.0

At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: