benchmarks: Skill for Claude Code

.agents/skills/benchsdk-cli/SKILL.md

benchsdk-cli is a skill for Claude Code, Codex from computesdk/benchmarks. It costs 42 tokens per session (2,082 once invoked), scanned A, original, MIT.

A command-line tool for accessing the ComputeSDK benchmarks platform. It can run benchmark files and query benchmark data, using browser login, API keys, or environment-based credentials.

In plain words
What is it for?
Use it to install the benchmark runner, sign in, run benchmark files, query platform information, or authenticate non-interactive jobs with an API key or token.
Why use it?
It gives developers one way to run and inspect benchmarks from a terminal or automated build system. Stored login credentials support interactive use, while keys and tokens support scripts and continuous integration.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one. Also seen: installed under .agents/ (shared by several agents).

This is computesdk/benchmarks's own configuration. It tells Claude Code and Codex how to work on benchmarks itself, so it is not a mod to install elsewhere. Copy it as a starting point and replace the rules that are about this project. Everything benchmarks configures →

Needs its repository: it runs a file that does not travel with it, so clone the repository first. The line is node packages/benchsdk-runner/dist/bin.cjs --version.

Reuse

Borrowing it

Nothing to install: this file belongs to computesdk/benchmarks. Take a copy, put it at the same path in your own repository, and replace the rules that are about this project with yours.

Copy the file
curl -O https://raw.githubusercontent.com/computesdk/benchmarks/master/.agents/skills/benchsdk-cli/SKILL.md
Clone the repo
git clone --depth 1 https://github.com/computesdk/benchmarks

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for benchsdk-cli

README.md
[![agentmods](https://agentmods.dev/badge/skills/computesdk/benchmarks/benchsdk-cli/github.svg)](https://agentmods.dev/skills/computesdk/benchmarks/benchsdk-cli)
Your own site
<a href="https://agentmods.dev/skills/computesdk/benchmarks/benchsdk-cli"><img src="https://agentmods.dev/badge/skills/computesdk/benchmarks/benchsdk-cli/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for benchsdk-cli

Your own site · 80×15
<a href="https://agentmods.dev/skills/computesdk/benchmarks/benchsdk-cli"><img src="https://agentmods.dev/badge/skills/computesdk/benchmarks/benchsdk-cli.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 42 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 2,082 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • NVIDIA SkillSpector warn 7 Sept 2026
SkillSpector: 6 findings, up to high

These are SkillSpector’s own severities. On a checked sample its high-severity flags on skills were ~96% false positives — a documented command, a public API, a “never do X” rule — so we show them as a caution to read, not a verdict. Why →

  • high Privilege Escalation · line 35
    Code accesses credential files (SSH keys, AWS credentials, etc.). This could indicate credential theft attempts.
    Fix: Remove references to credential paths. Use environment variables or secrets managers. For docs, use placeholder paths (e.g., /path/to/config). Never load .env or token files in production code paths.
  • high Privilege Escalation · line 64
    Code accesses credential files (SSH keys, AWS credentials, etc.). This could indicate credential theft attempts.
    Fix: Remove references to credential paths. Use environment variables or secrets managers. For docs, use placeholder paths (e.g., /path/to/config). Never load .env or token files in production code paths.
  • high Privilege Escalation · line 79
    Code accesses credential files (SSH keys, AWS credentials, etc.). This could indicate credential theft attempts.
    Fix: Remove references to credential paths. Use environment variables or secrets managers. For docs, use placeholder paths (e.g., /path/to/config). Never load .env or token files in production code paths.
  • high Privilege Escalation · line 48
    Code accesses credential files (SSH keys, AWS credentials, etc.). This could indicate credential theft attempts.
    Fix: Remove references to credential paths. Use environment variables or secrets managers. For docs, use placeholder paths (e.g., /path/to/config). Never load .env or token files in production code paths.
  • high Privilege Escalation · line 90
    Code accesses credential files (SSH keys, AWS credentials, etc.). This could indicate credential theft attempts.
    Fix: Remove references to credential paths. Use environment variables or secrets managers. For docs, use placeholder paths (e.g., /path/to/config). Never load .env or token files in production code paths.
  • high Privilege Escalation · line 191
    Code accesses credential files (SSH keys, AWS credentials, etc.). This could indicate credential theft attempts.
    Fix: Remove references to credential paths. Use environment variables or secrets managers. For docs, use placeholder paths (e.g., /path/to/config). Never load .env or token files in production code paths.
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00042 $0.02082
Opus 5.5 $0.00017 $0.00833
Sonnet 5.5 $0.00008 $0.00416
Haiku 4.5 $0.00004 $0.00208

Measured yesterday against content hash 819c56ce296d, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

benchsdk-cli scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured yesterday.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

.agents/skills/benchsdk-cli/SKILL.md · 236 lines

How it starts

The opening of the file, as written. The whole thing — 236 lines — stays where its author put it; the contents beside it link to each section on GitHub.

bench CLI

The bench binary is the unified CLI for the ComputeSDK benchmarks platform. bench run executes benchmark files; all other commands query platform data.

Installation

The CLI ships with @benchsdk/runner. From the benchmarks repo root:

pnpm install
pnpm -r --filter "./packages/**" build

Run via the built binary:

node packages/benchsdk-runner/dist/bin.cjs --version

Or add packages/benchsdk-runner to your PATH so bench --version works.

Authentication

The CLI tries credentials in this order:

  1. --api-key <key>
  2. BENCHMARKS_PLATFORM_TOKEN (a better-auth session token — does not refresh)
  3. BENCHMARKS_PLATFORM_API_KEY (an org-scoped bp_... key)
  4. OAuth tokens from ~/.benchsdk/credentials.json (from bench auth login)

API keys and tokens are useful for non-interactive environments. OAuth is interactive and stores a refresh token under ~/.benchsdk. At least one credential is required for any command that touches the platform.

Device-code login

bench auth login --base-url https://platform.computesdk.com

This prints a URL and a user code. Approve the device in the browser; the CLI polls and stores the access/refresh token pair. Access tokens last 1 hour; refresh tokens are 30-day sliding windows and rotate on every refresh.

Check status

bench auth status
bench auth status --json

Log out

bench auth logout

This removes ~/.benchsdk/credentials.json.

Configuration file

~/.benchsdk/config.json stores non-secret defaults:

{
  "baseUrl": "https://platform.computesdk.com",
  "org": "computesdk",
  "format": "table"
}

--base-url, --org, and --format override this file. Credentials live in ~/.benchsdk/credentials.json and are created with 0600 file permissions.

Common commands

Organizations

bench org list
bench org use computesdk

bench org use switches the active organization and rewrites the stored access token with the new organization claim.

Read the full file on GitHub · 236 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. yesterday Changed · +16 lines 819c56ce296d
  2. 6d ago Changed · +21 lines 05a4a8e474ac
  3. 1mo ago Changed 5e2221343c48
  4. 2mo ago First seen · 199 lines · 42 tokens per session scan A 96d7c9ceac24

Subscribe to this mod's changes

benchsdk-cli is a skill published in the GitHub repository computesdk/benchmarks (131 stars, last pushed yesterday), licensed MIT. It adds 42 tokens to every session and 2,082 once invoked, about $0.0002 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

local-ai-agents

Build local-first AI agents that run entirely on a developer workstation with Microsoft Foundry Local and Qwen function-calling models. Covers Small Language Models (SLMs), the OpenAI-compatible local endpoint, sandboxed local tools, local RAG with Chroma, local MCP servers, hybrid cloud/local routing, and the…

microsoft/ai-agents-for-beginners · 200 tokens

systematic-debugging

Use when encountering any bug, test failure, or unexpected behavior, before proposing fixes.

obra/superpowers · 21 tokens

next-cache-components-adoption

Turn on Cache Components in a Next.js app and resolve the blocking routes it surfaces. Use when the user wants to enable, adopt, or migrate to Cache Components, flip the cacheComponents flag, work through a flood of blocking-prerender / instant validation errors, run the cache-components-instant-false codemod, or…

vercel/next.js · 95 tokens

chat-pet-sprite-creation

Use when creating or changing VS Code chat pet sprite art, sprite sheets, state animations, eye treatments, Stable/Insiders variants, or pet transitions under src/vs/workbench/contrib/chat/browser/widget/media/chatPet.

microsoft/vscode · 53 tokens

cpu-profile-analysis

Analyze V8/Chrome CPU profiles (.cpuprofile) and DevTools trace files (Trace-.json). Use when: profiling performance, investigating slow functions, comparing code paths, finding bottlenecks, analyzing timeToRequest, understanding call trees from sampling profiler data, analyzing layout/paint/rendering, investigating…

microsoft/vscode · 71 tokens

insight-error-page

Write or audit an insight-kind error page for the Next.js dev overlay. Use when creating a new errors/ .mdx page, auditing an existing one, or checking that a page matches the framework fix cards. Covers page structure, title alignment, FixCard cards with Copy prompt button, code snippets, terminology verification…

vercel/next.js · 83 tokens