belt

belt is a skill for Claude Code, Codex from jfrog/agent-belt. It costs 116 tokens per session (4,086 once invoked), scanned A, original, Apache-2.0.

A command-line tool for testing coding-agent programs by running scenarios and scoring their results. A headless agent is one that runs through a command line without its usual user interface.

In plain words
What is it for?
Use it to run evaluations, compare agents, score outputs with rules or language-model judges, and set up continuous-integration checks.
Why use it?
It provides repeatable checks for whether different agents complete coding tasks correctly.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one. Also seen: mentions Claude Code; installed under .agents/ (shared by several agents); mentions Codex.

Needs its repository: it reads a path above its own folder, which exists only inside the repository. The line is {"kind": "file", "source": "../../skills/security-review", "dest": ".skills/security-review", "version": "0.3.1"}.

Good fit Use it to run evaluations, compare agents, score outputs with rules or language-model judges, and set up continuous-integration checks.

Compare 6 skills from other repositories ↓
Install

Getting it into your agent

It runs from inside its repository, so the clone comes first — what it calls does not travel with the file alone.

Clone the repo
git clone --depth 1 https://github.com/jfrog/agent-belt
agentmods
npx agentmods add skills/jfrog/agent-belt/belt

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for belt

README.md
[![agentmods](https://agentmods.dev/badge/skills/jfrog/agent-belt/belt.svg)](https://agentmods.dev/skills/jfrog/agent-belt/belt)
Your own site
<a href="https://agentmods.dev/skills/jfrog/agent-belt/belt"><img src="https://agentmods.dev/badge/skills/jfrog/agent-belt/belt.svg" alt="Measured on agentmods" height="20"></a>
Per session 116 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 4,086 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe. Third-party audits
  • NVIDIA SkillSpector pass 7 Sept 2026
How audits are shown
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00116 $0.04086
Opus 5 $0.00058 $0.02043
Sonnet 5 $0.00023 $0.00817
Haiku 4.5 $0.00012 $0.00409

Measured 7d ago against content hash 2046876b4744, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-07, from the pricing page.

Security

Grade A, and why

belt scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 7d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

src/belt/.agents/skills/belt/SKILL.md · 327 lines

How it starts

The opening of the file, as written. The whole thing — 327 lines — stays where its author put it; the contents beside it link to each section on GitHub.

agent-belt

belt is a CLI that evaluates headless coding-agent CLIs by running multi-turn scenarios against them and scoring the results with rule-based checks plus optional LLM judges. The belt console script is the only public surface - never import internals.

1. Verify install before doing anything

belt doctor

Checks Python, registered agents (auth + reachability), LLM scoring providers (cloud keys + Ollama), and which belt clone the command resolves to. If doctor is unhappy, fix what it reports before attempting anything else - most user-reported problems are solved by reading its output.

belt agent list           # registered agents (entry-point discovered)
belt agent info <name>    # capabilities of one agent (cli_options, env vars, fields it supports)

2. Run an evaluation

belt eval chains run → score → aggregate in one command. Start here.

belt quickstart                                                              # auto-detect, single rules-only
belt eval examples/scenarios/showcase --modes rules --tags real-runnable     # whole runnable showcase
belt eval my-scenarios/ --modes rules,llm --workers 3                        # rules + LLM judge, parallel
belt eval my-scenarios/ --dry-run                                            # list matched scenarios, no run
belt eval my-scenarios/ --modes rules --export junit:report.xml              # JUnit report for CI test reporters

--modes rules runs without any judge or API key - use it for fast feedback and CI smoke tests. --modes llm (or rules,llm) requires an LLM judge configured (see §5).

Scenario filtering is path-relative to the directory passed as <path>; if the path itself is a group (contains _config.json), --scenarios takes the bare scenario name. Tag filters use AND semantics across the listed tags.

Subcommand index, common workflows, and progress modes: docs/glossary/CLI.md. The canonical per-flag reference is belt <subcommand> --help.

Read the full file on GitHub · 327 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 7d ago First seen · 327 lines · 116 tokens per session scan A 2046876b4744

Subscribe to this mod's changes

belt is a skill published in the GitHub repository jfrog/agent-belt (18 stars, last pushed 5d ago), licensed Apache-2.0. It adds 116 tokens to every session and 4,086 once invoked, about $0.0006 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

agent-browser

Use the host-side agent-browser CLI for local browser smoke tests, screenshots, snapshots, and simple UI validation against forwarded localhost URLs.

superagent-ai/grok-cli · 31 tokens

meter-benchmark

Measure per-stage success probability before iterating on CocoFlow templates. Supports $meter benchmark --flow .

Snowflake-Labs/cocoplus · 27 tokens

agent-eval

Use when measuring whether an LLM or agent system actually got better and gating merges on it: golden sets, fixing an inflated LLM-as-judge, scoring RAG (faithfulness, contextual recall) or agent trajectories (tool correctness, completion), or picking an eval framework. NOT building the agent loop, tools or RAG…

ericrisco/rsc-harness · 79 tokens

hatch3r-browser-verify

Opt-in browser verification skill — spec-run-first Playwright verification (assertions execute in the runner, agent reads only failures), axe-core a11y audits, toHaveScreenshot() regression diffs, E2E test scaffolds, and snapshot-mode exploratory driving. Default ON for UI-affecting agent invocations; disable globally…

hatch3r/hatch3r · 83 tokens

hatch3r-feature

End-to-end feature implementation workflow. Covers data model, domain logic, API, and UI as a vertical slice. Use when implementing new features or working on feature request issues.

hatch3r/hatch3r · 41 tokens

hatch3r-qa-path

Produces a human-run manual QA test path from a PR, branch diff, or uncommitted working tree — a risk-ordered table of steps, expected results, and automated-coverage references plus a shippability sign-off. Rows are auto-proven via delegated verification sub-agents before emission, so the human walks only what…

hatch3r/hatch3r · 100 tokens