orchestrator: Skill for Claude Code

.claude/skills/performance-testing/SKILL.md

performance-testing is a skill for Claude Code from c9r-io/orchestrator. It costs 41 tokens per session (438 once invoked), scanned A, original, MIT.

A workflow for measuring latency and throughput on real repository surfaces. Latency is how long an operation takes, while throughput is how much work it handles over time.

In plain words
What is it for?
Use it to benchmark CLI or daemon commands, scheduler behavior, an explicitly running Slack gateway, or frontend performance after a production build.
Why use it?
It provides repeatable before-and-after measurements without comparing different builds, settings, or data.

Skill for Claude Code

Written for Claude Code: installed under .claude/.

This is c9r-io/orchestrator's own configuration. It tells Claude Code how to work on orchestrator itself, so it is not a mod to install elsewhere. Copy it as a starting point and replace the rules that are about this project. Everything orchestrator configures →

Reuse

Borrowing it

Nothing to install: this file belongs to c9r-io/orchestrator. Take a copy, put it at the same path in your own repository, and replace the rules that are about this project with yours.

Copy the file
curl -O https://raw.githubusercontent.com/c9r-io/orchestrator/main/.claude/skills/performance-testing/SKILL.md
Clone the repo
git clone --depth 1 https://github.com/c9r-io/orchestrator

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for performance-testing

README.md
[![agentmods](https://agentmods.dev/badge/skills/c9r-io/orchestrator/performance-testing/github.svg)](https://agentmods.dev/skills/c9r-io/orchestrator/performance-testing)
Your own site
<a href="https://agentmods.dev/skills/c9r-io/orchestrator/performance-testing"><img src="https://agentmods.dev/badge/skills/c9r-io/orchestrator/performance-testing/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for performance-testing

Your own site · 80×15
<a href="https://agentmods.dev/skills/c9r-io/orchestrator/performance-testing"><img src="https://agentmods.dev/badge/skills/c9r-io/orchestrator/performance-testing.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 41 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 438 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00041 $0.00438
Opus 5.5 $0.00016 $0.00175
Sonnet 5.5 $0.00008 $0.00088
Haiku 4.5 $0.00004 $0.00044

Measured 2mo ago against content hash f6064dd5fe49, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

performance-testing scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2mo ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

.claude/skills/performance-testing/SKILL.md · 42 lines

What it actually says

Performance Testing

Benchmark the same revision, configuration, data shape, command, and transport before and after a change. Do not compare debug and release builds.

Choose a Real Surface

For this repository:

  • CLI/daemon latency: time a read-only command such as orchestrator task list -o json against the same daemon and data set.
  • Scheduler behavior: use deterministic mock agents under fixtures/manifests/bundles/; do not use live AI benchmark manifests without explicit approval because they consume external credits.
  • Slack gateway HTTP baseline: when orchestrator-slack-gateway is explicitly running, its health endpoint is /healthz.
  • Web UI performance: use the tooling declared by gui/package.json and a production build when rendering cost is the target.

Use hyperfine for command latency when installed. Otherwise run a bounded shell loop with /usr/bin/time and preserve raw samples.

HTTP Load Checks

Use hey only after the user identifies a reachable, non-production target and safe endpoint. Start with a cheap health endpoint and a low request/concurrency bound, then increase deliberately:

hey -n 200 -c 10 http://127.0.0.1:8080/healthz

Never guess API routes, credentials, or a Docker Compose environment. A generated project may carry docker/docker-compose.yml; a benchmark script is usable only when the target repository actually owns one.

Evidence

Record:

  • pinned git revision and release/debug build mode
  • target command or URL, payload, data size, and transport
  • sample count and concurrency
  • throughput, p50/p90/p99 latency, and error rate
  • warm-up policy and machine/load caveats

Treat a regression as actionable only after repeating both baseline and candidate under comparable conditions. Report raw evidence and avoid universal QPS ratings detached from the tested workload.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 2mo ago First seen · 42 lines · 41 tokens per session scan A f6064dd5fe49

Subscribe to this mod's changes

performance-testing is a skill published in the GitHub repository c9r-io/orchestrator (21 stars, last pushed 1mo ago), licensed MIT. It adds 41 tokens to every session and 438 once invoked, about $0.0002 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.