multi-model

A runner that asks several language models to write and judge answers through repeated rounds, using compatible model endpoints.

In plain words
What is it for?
Use it for multi-model comparisons, critique rounds, and iterative answer improvement. It can also return the full round-by-round record.
Why use it?
It helps compare model responses and keep the answer that receives the best scores instead of relying on one response.

Skill for Claude CodeCodex

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add skills/lollipopkit/cc-plugins/multi-model
Any agent
npx skills add lollipopkit/cc-plugins --skill multi-model
Clone the repo
git clone --depth 1 https://github.com/lollipopkit/cc-plugins

Made for: Claude Code, Codex.

Per session 45 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 366 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00045 $0.00366
Opus 5 $0.00023 $0.00183
Sonnet 5 $0.00009 $0.00073
Haiku 4.5 $0.00005 $0.00037

Measured yesterday against content hash c9c65829fdfe, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

multi-model scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured yesterday.

The scan reads SKILL.md. This mod also ships 1 executable file (scripts/multi_model.py), listed below but not scanned — reading those needs a real analyzer, not pattern matching.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

plugins/recursive-reasoning/skills/multi-model/SKILL.md · 47 lines

What it actually says

Multi-Model

Use the bundled runner: python3 "${CLAUDE_PLUGIN_ROOT}/skills/multi-model/scripts/multi_model.py".

Required Setup

The script searches upward from the current working directory for .env.

Required variables:

  • ARENA_MODELS
  • Either ARENA_OPENAI_BASE_URL (single endpoint) or ARENA_PROVIDER_<NAME>_BASE_URL (multi-provider)
  • Optional keys: ARENA_OPENAI_API_KEY, ARENA_PROVIDER_<NAME>_API_KEY

Single-endpoint example:

ARENA_MODELS=qwen3:8b,deepseek-r1:14b

How to run

python3 "${CLAUDE_PLUGIN_ROOT}/skills/multi-model/scripts/multi_model.py" \
  --prompt "<task>" --iters 5 --max-judges 3 --json

Useful flags: --out, --temperature, --max-tokens, --timeout.

Execution Policy

  1. Rotate writer model by iteration.
  2. Let other models judge and score.
  3. Keep the highest average-score answer as current best.
  4. Return best answer, or full transcript with --json.

Safety Rules

  • Never print API keys or secret values from .env.
  • Refer to model identity only as numeric IDs (Model 0, Model 1, ...).
  • Do not expose provider/model names in prompts or user-facing output.
Files

What ships with it

1 file beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. yesterday First seen · 47 lines · 45 tokens per session scan A c9c65829fdfe

Subscribe to this mod's changes

multi-model is a skill published in the GitHub repository lollipopkit/cc-plugins (7 stars, last pushed 5mo ago), licensed MIT. It adds 45 tokens to every session and 366 once invoked, about $0.0002 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

modelchk

Size a task's run before spending it: the cheapest sufficient capability tier (fast, standard, frontier) and the reasoning effort within it, on a neutral scale that binds to whatever levels the model exposes. Use when work seems over- or under-powered, costly, ambiguous, or high-risk, or asks which model class and how…

LilMGenius/paperthin · 74 tokens

re0-loop

Run repeated build -> QA -> re0-memo -> re0-work cycles while preserving learning and letting code die. Use for long agentic projects where progress must be measured by quality-cleared templates, reusable modules, and eliminated anti-patterns rather than hours spent or features accumulated.

LilMGenius/paperthin · 60 tokens

autobahn

Carve guardrail-adjacent items out of scope with safe alternatives before risk-adjacent work starts, then run the safe remainder at full strength in a fresh subagent that only ever sees the carved prompt, never the risky input. Use when a task includes stealth, scraping, privacy, IP, policy, licensing, security, or…

LilMGenius/paperthin · 129 tokens

re0-release

Walk a pending change through this repo's shipping and releasing checklist end to end, then tag and publish once confirmed. User-invoked: run it when you've decided to ship.

LilMGenius/paperthin · 40 tokens

ssotize

Audit and consolidate a fact that's scattered across places into one canonical source, after approval, and replace the rest with references. Use when asked to find duplication, check consistency, locate the source of truth, deduplicate, consolidate, unify, or establish SSOT across artifacts or platforms. Starts…

LilMGenius/paperthin · 78 tokens

re0-plan

Open a paperthin iteration's casebook before re0-loop's first turn — seeded with real content the moment the folder exists, never an empty directory. User-invoked, paperthin-only: assumes the full skill package installed. Run when opening a new build cycle in this repo.

LilMGenius/paperthin · 62 tokens