compare

compare is a skill for Claude Code, Codex from Lykhoyda/ask-llm. It costs 93 tokens per session (1,906 once invoked), scanned C, original, MIT.

A skill for sending the same question to two to five large language model providers and showing their answers side by side without combining or judging them.

In plain words
What is it for?
Comparing how different AI providers answer the same bounded question and reviewing their raw responses.
Why use it?
It lets you compare wording and results directly, while keeping provider failures visible instead of hiding them.

Skill for Claude CodeCodex

Installs and runs on its own, but its text points at files inside its plugin — anything it tells you to read at a ${CLAUDE_PLUGIN_ROOT} path is only there once the plugin is installed. Installing the plugin gets both.

Part of the ask-llm plugin — 18 skills, 9 agents, 5 hooks, 1 MCP server shipped together

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add skills/lykhoyda/ask-llm/compare
Any agent
npx skills add Lykhoyda/ask-llm --skill compare
Clone the repo
git clone --depth 1 https://github.com/Lykhoyda/ask-llm

Made for: Claude Code, Codex.

Or install ask-llm, the plugin that ships this one along with the rest of its 18 skills, 9 agents, 5 hooks, 1 MCP server.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for compare

README.md
[![agentmods](https://agentmods.dev/badge/skills/lykhoyda/ask-llm/compare.svg)](https://agentmods.dev/skills/lykhoyda/ask-llm/compare)
Your own site
<a href="https://agentmods.dev/skills/lykhoyda/ask-llm/compare"><img src="https://agentmods.dev/badge/skills/lykhoyda/ask-llm/compare.svg" alt="Measured on agentmods" height="20"></a>
Per session 93 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,906 The whole file, excluding the scripts and references it only reads on demand.
Security scan C 1 finding. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00093 $0.01906
Opus 5 $0.00046 $0.00953
Sonnet 5 $0.00019 $0.00381
Haiku 4.5 $0.00009 $0.00191

Measured 5d ago against content hash f590e99ae162, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade C, and why

compare scanned grade C with 1 finding against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 5d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Recursive force deletehighDestructive command

rm -rf with a variable or a broad path is one typo away from removing the wrong tree.

trap 'rm -rf "$workdir"' EXIT
packages/claude-plugin/skills/compare/SKILL.md · 160 lines

How it starts

The opening of the file, as written. The whole thing — 160 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Portable contract

Send the exact same bounded prompt to two to five selected providers concurrently. Preserve input order in the result, show each response verbatim without synthesis or adjudication, and show every provider failure instead of silently dropping it. Never invoke raw provider CLIs when a canonical Ask LLM bridge is available.

Host adapters

Pi adapter

Use one native ask-multi call. Put the common prompt in prompt and two to five unique names in providers; its implementation, not model-emitted sibling calls, guarantees concurrent bounded dispatch and stable ordering.

Claude Code adapter

The existing detailed workflow below is the Claude Code adapter. Its Agent, MCP, hook, CLAUDE_PLUGIN_ROOT, and AskUserQuestion mechanics apply only on Claude Code; they do not override the Pi adapter above.

Compare Provider Responses Side-by-Side

Send the same question to multiple LLM providers and present their responses verbatim, side-by-side. No synthesis, no consensus highlighting, no validation pipeline — just raw outputs so the user can compare directly.

This is the right tool when:

  • You want to see how each provider phrases the same answer (style, depth, confidence)
  • You want a sanity check before picking one provider's recommendation
  • You want to evaluate which provider best fits a specific kind of question
  • You explicitly want to AVOID Claude synthesizing or weighting the responses

If you want consensus extraction → use /brainstorm instead. If you're reviewing a code diff → use /multi-review instead.

Instructions

Phase 1: Parse the request

Extract from the user's message:

  1. The question/prompt to send to all providers (the meaningful payload)
  2. Optional provider filter — if the user says "compare gemini and codex", only those two; otherwise default to all five (gemini, codex, grok, ollama, antigravity)
  3. Optional context files — if the user references files (@path/to/file), Read each referenced file and inline its contents into the shared provider prompt under a clearly labeled <context_file path="..."> block. @file expansion is Gemini-only; passing the literal path to Codex, Ollama, Grok, or Antigravity silently drops the context. For a file too large to inline safely, include the relevant excerpts and state what was omitted.

Read the full file on GitHub · 160 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 5d ago First seen · 160 lines · 93 tokens per session scan C f590e99ae162

Subscribe to this mod's changes

compare is a skill published in the GitHub repository Lykhoyda/ask-llm (17 stars, last pushed 2d ago), licensed MIT. It adds 93 tokens to every session and 1,906 once invoked, about $0.0005 per session on Opus 5. A static security scan graded it C with 1 finding (recursive force delete). No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

opik

This skill should be used when the user needs to add Opik tracing or integrations to their code, instrument an LLM application, or needs reference for Opik SDK usage (Python, TypeScript, REST API). Use for tasks like "add tracing", "instrument my code", "use trackopenai", "add OpikTracer", "what span types are…

comet-ml/opik-claude-code-plugin · 84 tokens

AgentDB Learning Plugins

Create and train AI learning plugins with AgentDB's 9 reinforcement learning algorithms. Includes Decision Transformer, Q-Learning, SARSA, Actor-Critic, and more. Use when building self-learning agents, implementing RL, or optimizing agent behavior through experience.

spencermarx/open-code-review · 56 tokens

AgentDB Performance Optimization

Optimize AgentDB performance with quantization (4-32x memory reduction), HNSW indexing (150x faster search), caching, and batch operations. Use when optimizing memory usage, improving search speed, or scaling to millions of vectors.

spencermarx/open-code-review · 53 tokens

AgentDB Memory Patterns

Implement persistent memory patterns for AI agents using AgentDB. Includes session memory, long-term storage, pattern learning, and context management. Use when building stateful agents, chat systems, or intelligent assistants.

spencermarx/open-code-review · 45 tokens

AgentDB Vector Search

Implement semantic vector search with AgentDB for intelligent document retrieval, similarity matching, and context-aware querying. Use when building RAG systems, semantic search engines, or intelligent knowledge bases.

spencermarx/open-code-review · 41 tokens

V3 Memory Unification

Unify 6+ memory systems into AgentDB with HNSW indexing for 150x-12,500x search improvements. Implements ADR-006 (Unified Memory Service) and ADR-009 (Hybrid Memory Backend).

spencermarx/open-code-review · 51 tokens