xete-mcp: Skill for Claude Code

.claude/skills/gate-backtest/SKILL.md

gate-backtest is a skill for Claude Code from xetenet/xete-mcp. It costs 87 tokens per session (870 once invoked), scanned A, original, MIT.

A skill that tests code-review gates against a repository’s real Git history. It replays past fixes in a safe, temporary copy to see which defects the gates would have caught.

In plain words
What is it for?
Backtesting, calibrating, or training gate systems; measuring recall and friction; and proposing new review patterns from missed defects.
Why use it?
It shows whether review rules detect real bugs and identifies rules that create friction without finding known defects.

Skill for Claude Code

Written for Claude Code: installed under .claude/.

This is xetenet/xete-mcp's own configuration. It tells Claude Code how to work on xete-mcp itself, so it is not a mod to install elsewhere. Copy it as a starting point and replace the rules that are about this project. Everything xete-mcp configures →

Reuse

Borrowing it

Nothing to install: this file belongs to xetenet/xete-mcp. Take a copy, put it at the same path in your own repository, and replace the rules that are about this project with yours.

Copy the file
curl -O https://raw.githubusercontent.com/xetenet/xete-mcp/main/.claude/skills/gate-backtest/SKILL.md
Clone the repo
git clone --depth 1 https://github.com/xetenet/xete-mcp

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for gate-backtest

README.md
[![agentmods](https://agentmods.dev/badge/skills/xetenet/xete-mcp/gate-backtest/github.svg)](https://agentmods.dev/skills/xetenet/xete-mcp/gate-backtest)
Your own site
<a href="https://agentmods.dev/skills/xetenet/xete-mcp/gate-backtest"><img src="https://agentmods.dev/badge/skills/xetenet/xete-mcp/gate-backtest/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for gate-backtest

Your own site · 80×15
<a href="https://agentmods.dev/skills/xetenet/xete-mcp/gate-backtest"><img src="https://agentmods.dev/badge/skills/xetenet/xete-mcp/gate-backtest.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 87 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 870 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00087 $0.00870
Opus 5.5 $0.00035 $0.00348
Sonnet 5.5 $0.00017 $0.00174
Haiku 4.5 $0.00009 $0.00087

Measured 1mo ago against content hash 34413bd8cf72, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

gate-backtest scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 1mo ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

.claude/skills/gate-backtest/SKILL.md · 59 lines

How it starts

The opening of the file, as written. The whole thing — 59 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Gate Backtest

The repo's own history is a labeled dataset: every fix commit marks an earlier commit that introduced a real defect. This skill replays that history against the gates and converts each real defect into a permanent benchmark.

Safety invariant

All work happens in the throwaway clone that scripts/backtest.sh creates — remotes stripped, nothing writable pointing at the real repo. Never run analysis inside an active working copy. Outputs (benchmarks, pattern proposals) land only in the xete-agent-skills repo via PR.

Step 1: Mechanical replay

scripts/backtest.sh <path-or-url-to-repo>

Produces: recall (fraction of real defect-introducing commits the gate would have caught), friction (gated commits with no known defect), missed culprits with files, and suggested pattern additions.

Step 2: Qualitative pass on every culprit (caught AND missed)

For each culprit commit in the report, answer three questions by reading the actual diff of the culprit and its fix:

  1. Which gate would have caught it? Map the defect to a specific line of the solana-security-hardening checklist, or to a doubt class in doubt-driven-review. If NO existing gate item maps to it, that is a checklist gap — the fix becomes a new checklist line.
  2. Was it catchable at commit time? Some defects are only visible with later context (spec changed, dependency behavior). Mark honestly: catchable or hindsight-only. Hindsight-only cases must not inflate the gate's claimed value.
  3. What is the doubt prompt? Write the one question a fresh-context reviewer would have needed to ask to find it. Concrete, not generic: "what happens when the same commitment is submitted to two tabs?" not "is this secure?"

Step 3: Author benchmark cases

One file per real defect: benchmarks/BM-<short-name>.md

# BM: <defect in one line>
Source: <repo> culprit <hash> fixed by <hash>
Paths: <files/dirs involved>
Class: <overflow | replay | validation-gap | key-leak | logic | ...>
Catchable at commit time: yes | hindsight-only
Gate mapping: <checklist item or doubt class; NEW if it was a gap>
Doubt prompt: <the question that finds this bug>
Real solution: <what the actual fix did, 1-2 lines>

Read the full file on GitHub · 59 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 1mo ago First seen · 59 lines · 87 tokens per session scan A 34413bd8cf72

Subscribe to this mod's changes

gate-backtest is a skill published in the GitHub repository xetenet/xete-mcp (0 stars, last pushed 1mo ago), licensed MIT. It adds 87 tokens to every session and 870 once invoked, about $0.0003 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

git-workflow

Branching and review conventions.

modelcontextprotocol/typescript-sdk · 10 tokens

zen-comprehensive-review

Orchestrate a multi-model code review: spawn 3 review subagents, merge findings. In PR mode, posts GitHub PR comments with reactions. In local mode, outputs findings directly. CRITICAL: this skill is costly, don't use it unless user explicitly requested to use it.

EliasOulkadi/shokunin · 63 tokens

git-workflow

Follow this team's Git conventions for branching, commit messages, and pull requests.

modelcontextprotocol/csharp-sdk · 19 tokens

gitlab-merge-request-review

Review and merge GitLab merge requests via the gitlab-api MCP server — by default the MRs assigned to you or where you are a reviewer, optionally scoped to a project, group, or the whole instance. Read an MR, gate it on a green pipeline (pipeline → jobs → job log), then approve, accept/merge, or set…

Knuckles-Team/gitlab-api · 158 tokens

repository-manager-candidate-certification

Understand and verify a branch candidate's and a sealed generation's certification state — the Candidate/Generation lifecycle vocabulary, the validation-stage/evidence model, and the rmconceptsverifycandidate / verifygeneration marker-collision checks — before trusting a merge-queue outcome as landable. This is the…

Knuckles-Team/repository-manager · 187 tokens

pr-hygiene

Check a pull request is small, described, tested, and free of secrets before opening or reviewing it. Use when drafting a PR, reviewing a diff, or verifying a change is ready to share.

matebenyovszky/agentplaybooks · 45 tokens