model-profiler

model-profiler is a skill for Claude Code, Codex from Heretyc/subagent-mcp. It costs 347 tokens per session (3,866 once invoked), scanned A, original, Apache-2.0.

A skill that evaluates available AI models across 14 fixed types of coding and research work, then records model rankings and supporting benchmark data.

In plain words
What is it for?
Discovering recent models, collecting public benchmark results, ranking model-and-effort combinations, and saving routing and audit files.
Why use it?
It provides a repeatable way to compare models when a new model is released or when profiling is requested.

Skill for Claude CodeCodex

Part of the subagent-mcp plugin — 8 skills, 1 agent, 3 hooks, 1 MCP server shipped together

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add skills/heretyc/subagent-mcp/model-profiler
Any agent
npx skills add Heretyc/subagent-mcp --skill model-profiler
Clone the repo
git clone --depth 1 https://github.com/Heretyc/subagent-mcp

Made for: Claude Code, Codex.

Or install subagent-mcp, the plugin that ships this one along with the rest of its 8 skills, 1 agent, 3 hooks, 1 MCP server.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for model-profiler

README.md
[![agentmods](https://agentmods.dev/badge/skills/heretyc/subagent-mcp/model-profiler.svg)](https://agentmods.dev/skills/heretyc/subagent-mcp/model-profiler)
Your own site
<a href="https://agentmods.dev/skills/heretyc/subagent-mcp/model-profiler"><img src="https://agentmods.dev/badge/skills/heretyc/subagent-mcp/model-profiler.svg" alt="Measured on agentmods" height="20"></a>
Per session 347 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 3,866 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00347 $0.03866
Opus 5 $0.00173 $0.01933
Sonnet 5 $0.00069 $0.00773
Haiku 4.5 $0.00035 $0.00387

Measured 3d ago against content hash b3f57c269821, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

model-profiler scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 3d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

skills/model-profiler/SKILL.md · 178 lines

How it starts

The opening of the file, as written. The whole thing — 178 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Model Profiler

Impartially profile the sub-agent fleet against the FIXED 14 work-categories (directly benchmarked parents + 4 composite-inferred) when a new model ships (or on demand). The skill is the impartial judge of all models: it discovers the models, gathers their public benchmarks, and ranks each model+effort pairing per category : it does not decide what the categories are.

Input = the profiling scope (in-scope provider families + recent window) confirmed in Phase 0 or supplied by the standing repository profile when its exact trigger matches. Output = EXACTLY 3 persisted artifacts (src/routing-table.json, src/routing-table-audit.json, research-seed-sites.json); nothing else persists. See the Output Contract below.

This SKILL.md is the index : load only the current phase's detail leaf, never all of them. Each md file stays <=200 lines (AGENTS.md cap).

Required Runner (read first)

Run ONLY on the highest available flagship model the operating provider offers (whatever that currently is), at its highest OR second-highest effort setting (i.e. a top-tier reasoning model at high effort; the provider-equivalent top model+effort otherwise). Note: binding an explicit runner model/effort for sub-agents is itself gated : see the gating preamble in references/dispatch-mechanics.md (smart mode rejects selector-bearing launches unless the user-approved-overrides window is open). It is orchestrator-only: the runner dispatches every research/judging/validation step via mcp__subagent-mcp__launch_agent and must sustain multi-phase reasoning across the whole run. Never run on Haiku, a non-flagship tier, an effort below second-highest, or any model lacking sub-agent-launch support or long-horizon reasoning : these silently degrade the pipeline. If the runner does not meet this bar, halt and escalate to the owner; do not run it. (Runner requirement only : distinct from invariant #2's ban on the skill naming a preferred model for the JUDGED routing output.)

Read the full file on GitHub · 178 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 3d ago First seen · 178 lines · 0 tokens per session scan A b3f57c269821

Subscribe to this mod's changes

model-profiler is a skill published in the GitHub repository Heretyc/subagent-mcp (3 stars, last pushed 6d ago), licensed Apache-2.0. It adds 347 tokens to every session and 3,866 once invoked, about $0.0017 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

planflow

Draft a plan and get it approved as an editable flowchart in the user's browser before executing. Use when the user asks to plan a task with PlanFlow, or wants to review, edit, or approve a plan before any code changes are made.

davejj1530/planflow-greenlight · 53 tokens

seo-strategy

Audits and improves organic search performance — technical health, site architecture, internal linking, structured data, and the content decisions that determine what can rank. Use this to run an SEO audit, diagnose why pages are not ranking or were deindexed, plan a site's URL and navigation structure, add structured…

cbrock84/headcount · 74 tokens

implement-factory

Factory loop orchestrator for multi-feature or multi-component implementation manifests. Use for high-complexity work with parallel-eligible workstreams and holdout-scenario evaluation.

rsmdt/the-startup · 37 tokens

chief-strategy-officer

Owns where the business plays and how it wins over a multi-year horizon — portfolio choices, corporate development, strategic partnerships, and planning under uncertainty. Use this for a decision about which markets or businesses to be in, whether to build, buy, or partner, how to allocate capital across business…

cbrock84/headcount · 93 tokens

scenario-planning

Plans under genuine uncertainty — building scenarios, identifying which assumptions are load-bearing, setting early-warning indicators, and stress-testing a plan against futures rather than forecasting one. Use this when a decision depends on something unknowable, when a plan assumes conditions that may not hold…

cbrock84/headcount · 78 tokens

ai-ml-governance

Governs models and AI systems in production — intended use, evaluation, monitoring, human oversight, documentation, and the decision to deploy or retire. Use this before deploying a model or AI feature, when defining evaluation criteria, when a model's behavior has drifted, when assessing AI risk or regulatory…

cbrock84/headcount · 83 tokens