cost-quality-tradeoff

cost-quality-tradeoff is a skill for Claude Code from latestaiagents/agent-skills. It costs 98 tokens per session (1,448 once invoked), scanned A, original, MIT.

A guide to comparing model quality with the money and response time each setup uses. It covers models, prompts, settings, quality scores, request cost, and the point where spending more is worthwhile.

In plain words
What is it for?
Use it when selecting a default model, reducing AI spending, evaluating a premium model, or comparing prompt and reasoning settings.
Why use it?
It helps avoid choosing a model based on quality alone when a cheaper setup may meet the same requirement.

Skill for Claude Code

Written for Claude Code: shipped in a Claude Code plugin. Also seen: positional $N argument.

Part of the evals plugin — 5 skills shipped together , and of latestaiagents

Good fit Use it when selecting a default model, reducing AI spending, evaluating a premium model, or comparing prompt and reasoning settings.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/latestaiagents/agent-skills/cost-quality-tradeoff
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add latestaiagents/agent-skills --skill cost-quality-tradeoff
Clone the repo
git clone --depth 1 https://github.com/latestaiagents/agent-skills

Made for: Claude Code.

Or install evals, the plugin that ships this one along with the rest of its 5 skills.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for cost-quality-tradeoff

README.md
[![agentmods](https://agentmods.dev/badge/skills/latestaiagents/agent-skills/cost-quality-tradeoff/github.svg)](https://agentmods.dev/skills/latestaiagents/agent-skills/cost-quality-tradeoff)
Your own site
<a href="https://agentmods.dev/skills/latestaiagents/agent-skills/cost-quality-tradeoff"><img src="https://agentmods.dev/badge/skills/latestaiagents/agent-skills/cost-quality-tradeoff/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for cost-quality-tradeoff

Your own site · 80×15
<a href="https://agentmods.dev/skills/latestaiagents/agent-skills/cost-quality-tradeoff"><img src="https://agentmods.dev/badge/skills/latestaiagents/agent-skills/cost-quality-tradeoff.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 98 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,448 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00098 $0.01448
Opus 5 $0.00049 $0.00724
Sonnet 5 $0.00020 $0.00290
Haiku 4.5 $0.00010 $0.00145

Measured 8d ago against content hash 4f784c70630c, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-11, from the pricing page.

Security

Grade A, and why

cost-quality-tradeoff scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 8d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

skills/evals/cost-quality-tradeoff/SKILL.md · 165 lines

How it starts

The opening of the file, as written. The whole thing — 165 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Cost vs Quality Tradeoff

Quality without cost context is half a decision. You need the Pareto frontier — for each quality bar, what's the cheapest config that hits it?

When to Use

  • Choosing a default model for a new feature
  • Reducing LLM spend on an existing feature
  • Justifying (or not) an upgrade to a premium model
  • Trading off prompt complexity, model size, and thinking budget

The Pareto Frontier

Plot each candidate config (model × prompt × settings) on quality (y-axis) vs cost per request (x-axis). The frontier is the set of configs where no other config is both cheaper AND better.

Any config NOT on the frontier is dominated — always strictly worse than another option. Drop it.

  quality
   ↑
 1 |    *A (opus + thinking)
   |    *B (opus)
   |*G *D (sonnet + few-shot)
   |*F *C (sonnet)
 0 |*E (haiku)
   +---------------→ cost

Pareto: A, B, D, C, E. Dominated: F (worse than E at same cost), G (worse than D at same cost).

Measurement

For each candidate, measure:

Metric Example
Input tokens / request 2,500
Output tokens / request 400
$ / request $0.012
Quality score 0.87
p95 latency 1.8s
const costPerRequest = (usage.input_tokens / 1e6) * inputRate +
                       (usage.output_tokens / 1e6) * outputRate +
                       (usage.cache_creation_input_tokens / 1e6) * cacheWriteRate +
                       (usage.cache_read_input_tokens / 1e6) * cacheReadRate;

Always include cache costs — they dominate on cached workloads.

Common Configs to Compare

For any feature, try at least:

  1. Haiku with concise prompt
  2. Haiku with longer / few-shot prompt
  3. Sonnet with concise prompt
  4. Sonnet with few-shot + structured output
  5. Sonnet with extended thinking
  6. Opus with concise prompt
  7. Opus with extended thinking

One of these usually sits on the frontier for your workload. Don't assume — measure.

Prompt as a Lever

Before jumping to a bigger model, try prompt levers:

Read the full file on GitHub · 165 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 8d ago First seen · 165 lines · 98 tokens per session scan A 4f784c70630c

Subscribe to this mod's changes

cost-quality-tradeoff is a skill published in the GitHub repository latestaiagents/agent-skills (5 stars, last pushed 4mo ago), licensed MIT. It adds 98 tokens to every session and 1,448 once invoked, about $0.0005 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-03.