10x-eval-model

10x-eval-model is a skill for Claude Code, Codex from przeprogramowani/10x-bench. It costs 106 tokens per session (2,196 once invoked), scanned C, original, MIT.

A workflow for adding and running evaluations of new language models in the 10xBench benchmarking project.

In plain words
What is it for?
Use it when adding a model, updating its benchmark details, preparing evaluation attempts, or launching a benchmark run.
Why use it?
It organizes the setup work needed before a model can be compared in a benchmark, including metadata, pricing checks, directories, and evaluation runs.

Skill for Claude CodeCodex

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add skills/przeprogramowani/10x-bench/10x-eval-model
Any agent
npx skills add przeprogramowani/10x-bench --skill 10x-eval-model
Clone the repo
git clone --depth 1 https://github.com/przeprogramowani/10x-bench

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for 10x-eval-model

README.md
[![agentmods](https://agentmods.dev/badge/skills/przeprogramowani/10x-bench/10x-eval-model.svg)](https://agentmods.dev/skills/przeprogramowani/10x-bench/10x-eval-model)
Your own site
<a href="https://agentmods.dev/skills/przeprogramowani/10x-bench/10x-eval-model"><img src="https://agentmods.dev/badge/skills/przeprogramowani/10x-bench/10x-eval-model.svg" alt="Measured on agentmods" height="20"></a>
Per session 106 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 2,196 The whole file, excluding the scripts and references it only reads on demand.
Security scan C 1 finding. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00106 $0.02196
Opus 5 $0.00053 $0.01098
Sonnet 5 $0.00021 $0.00439
Haiku 4.5 $0.00011 $0.00220

Measured 4d ago against content hash 5496a43ed928, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade C, and why

10x-eval-model scanned grade C with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 4d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Recursive force deletehighDestructive command

rm -rf with a variable or a broad path is one typo away from removing the wrong tree.

If runs fail due to credit limits ("requires more credits"), inform the user with a link to https://openrouter.ai/settings/credits and offer to re-run after they top up. Clean attempt directories before re-running (`rm -
.claude/skills/10x-eval-model/SKILL.md · 189 lines

How it starts

The opening of the file, as written. The whole thing — 189 lines — stays where its author put it; the contents beside it link to each section on GitHub.

10x-eval-model

Orchestrates the full setup and execution pipeline for evaluating a new LLM model in the 10xBench benchmark. This includes updating metadata, verifying pricing, preparing attempt directories, and launching evaluation runs via the appropriate harness.

Inputs

The user provides:

  • Model ID — the short identifier used in directory names (e.g., glm-51, gemini-31-pro)
  • Display name — human-readable name (e.g., GLM-5.1, Gemini 3.1 Pro)
  • Harness — the coding agent environment used to run the model (e.g., opencode, cursor, claude-code, claude-desktop, codex-desktop)
  • Supersedes (optional) — the model ID this new model replaces (e.g., glm-5 is superseded by glm-51)

If the user provides a natural model name like "GLM-5.1 via opencode", derive the model ID yourself (e.g., glm-51) and confirm with the user before proceeding.

Pipeline Steps

Step 1: Check if model already exists in metadata

Read eval-attempts/metadata.ts and check whether the model ID is already present. If it exists but is commented out, offer to uncomment it instead of adding new entries. If it already exists and is active, inform the user and skip to Step 4.

Step 2: Look up pricing

Search the web for current API pricing for the model (per 1M tokens, input and output, USD, no cache). Present findings to the user for confirmation before writing to metadata. Check multiple sources (official docs, OpenRouter, Artificial Analysis) to cross-reference.

Step 3: Update metadata.ts

Add the model to all relevant sections in eval-attempts/metadata.ts:

  1. ModelId type union — add | "model-id" entry
  2. AGENT_NAMES — add "model-id": "Display Name" entry
  3. AGENT_ENV — add "model-id": AGENT_ENVIRONMENT.<harness> entry (see harness mapping below)
  4. MODEL_PRICING — add "model-id": {input: X, output: Y} with confirmed pricing
  5. SUPERSEDED_MODELS (if applicable) — add "old-model-id": "new-model-id" entry

Read the full file on GitHub · 189 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 4d ago First seen · 189 lines · 106 tokens per session scan C 5496a43ed928

Subscribe to this mod's changes

10x-eval-model is a skill published in the GitHub repository przeprogramowani/10x-bench (11 stars, last pushed 17d ago), licensed MIT. It adds 106 tokens to every session and 2,196 once invoked, about $0.0005 per session on Opus 5. A static security scan graded it C with 1 finding (recursive force delete). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

auth-web-cloudbase

CloudBase Web Authentication Quick Guide for frontend integration after auth-tool has already been checked. Provides concise and practical Web authentication solutions with multiple login methods and complete user management.

TencentCloudBase/CloudBase-AI-Toolkit · 38 tokens

browse-and-evaluate

Use when exploring the ai-agent-skills catalog to find, compare, and evaluate skills before installing. Always use --fields to limit output size and --dry-run before committing to an install.

MoizIbnYousaf/Ai-Agent-Skills · 43 tokens

render-airdrop-carousel

Assemble a viral iOS "AirDrop" notification-carousel video ad (≈6–8s, 9:16) from a brand line plus 6–16 real product photos — a native AirDrop share-sheet card ("Brand would like to share a · Decline / Accept") springs up and its preview window CYCLES through the products, landing on a range/lineup payoff with an…

gooseworks-ai/goose-skills · 207 tokens

render-3d-product-showcase

Assemble a premium 3D product-showcase ad from a config — four beat clips (an orbiting hero rotation, a macro push-in, a physics reveal, a typographic close) normalized to the brand-color canvas, hard-concatenated in order, closed on a deterministic Playwright brand end card, and mixed under one instrumental bed at…

gooseworks-ai/goose-skills · 159 tokens

loop-engineering

Shared loop-engineering reference for COG skills - the agent loop, deterministic verifiers, termination conditions, in-loop context management, and named patterns. Invoke when designing or debugging a skill that iterates (search-verify-retry, scan-until-dry, fetch-retry-gate).

huytieu/COG-second-brain · 63 tokens

telnyx-messaging-hosted-curl

Set up hosted SMS numbers, toll-free verification, and RCS messaging. Use when migrating numbers or enabling rich messaging features. This skill provides REST API (curl) examples.

team-telnyx/ai · 45 tokens