benchmark

benchmark is a skill for Claude Code from lisihao/Solar. It costs 7 tokens per session (258 once invoked), scanned A, original, MIT.

A performance benchmark workflow that runs repeated tests and summarizes timing data against a baseline.

In plain words
What is it for?
Use it to measure a target, remove outliers with the interquartile-range method, report median and standard deviation, and compare results with a baseline.
Why use it?
It makes performance comparisons less dependent on one unusual run by using repeated measurements and statistical summaries.

Skill for Claude Code

Written for Claude Code: user-invocable in frontmatter. Also seen: agent in frontmatter.

Good fit Use it to measure a target, remove outliers with the interquartile-range method, report median and standard deviation, and compare results with a baseline.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/lisihao/solar/benchmark
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add lisihao/Solar --skill benchmark
Clone the repo
git clone --depth 1 https://github.com/lisihao/Solar

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for benchmark

README.md
[![agentmods](https://agentmods.dev/badge/skills/lisihao/solar/benchmark/github.svg)](https://agentmods.dev/skills/lisihao/solar/benchmark)
Your own site
<a href="https://agentmods.dev/skills/lisihao/solar/benchmark"><img src="https://agentmods.dev/badge/skills/lisihao/solar/benchmark/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for benchmark

Your own site · 80×15
<a href="https://agentmods.dev/skills/lisihao/solar/benchmark"><img src="https://agentmods.dev/badge/skills/lisihao/solar/benchmark.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 7 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 258 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00007 $0.00258
Opus 5.5 $0.00003 $0.00103
Sonnet 5.5 $0.00001 $0.00052
Haiku 4.5 $0.00001 $0.00026

Measured 1mo ago against content hash e2426a779d64, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

benchmark scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 1mo ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

skills/benchmark/SKILL.md · 47 lines

What it actually says

性能基准测试

使用 Ops Agent 运行基准测试。

测试要求

  • 最少 10 次迭代
  • 使用中位数报告
  • 剔除异常值 (IQR 方法)
  • 报告标准差

步骤

  1. 识别基准测试目标
  2. 运行多次迭代
  3. 收集性能数据
  4. 统计分析
  5. 与基线对比

输出格式

基准测试结果:
├── 测试: <name>
├── 迭代: <n> 次
├── 中位数: <value> ms
├── 标准差: <value> ms
├── 最小值: <value> ms
├── 最大值: <value> ms
└── vs 基线: <ratio>x

注意事项

  • 使用中位数而非平均值
  • 剔除明显异常值
  • 保持测试环境一致
Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 1mo ago First seen · 47 lines · 7 tokens per session scan A e2426a779d64

Subscribe to this mod's changes

benchmark is a skill published in the GitHub repository lisihao/Solar (3 stars, last pushed 2mo ago), licensed MIT. It adds 7 tokens to every session and 258 once invoked, about $0.0000 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-03.

Related

Other skills, from other repositories

research-engineer

An uncompromising Academic Research Engineer. Operates with absolute scientific rigor, objective criticism, and zero flair. Focuses on theoretical correctness, formal verification, and optimal implementation across any required technology.

davila7/claude-code-templates · 43 tokens

tika-eval-compare

Compare extracts from two Tika builds over a corpus to detect regressions in content, encoding, exceptions, and embedded-document handling. Use for "compare before/after extracts", "eval this change against the corpus".

apache/tika · 50 tokens

cua-driver

Use Cua Driver for desktop or browser tasks that are awkward or unavailable through Bash/APIs, or when the user explicitly wants GUI interaction: app testing, visual bug reproduction, form filling, calendar entry, screenshots, and demo recording. Also covers Cua setup; not OpenAI Codex Computer Use or web research.

davidondrej/skills · 68 tokens

jetson-validate-image

Use after jetson-flash-image to run static BSP checks, on-target smoke/regression tests on a flashed DUT, or both. Not for build or flash steps. Triggers: validate bsp, on-target validation.

NVIDIA/skills · 50 tokens

atmos-validation

Validate Atmos projects, components, arbitrary JSON Schema inputs, EditorConfig, and GitHub Actions; use affected-file selection and native CI annotations.

cloudposse/atmos · 31 tokens

skill-benchmark

Benchmark AI skill effectiveness by measuring implementation quality against legacy constraints.

HoangNguyen0403/agent-skills-standard · 16 tokens