xete-mcp: Skill for Claude Code

.claude/skills/gate-backtest/SKILL.md

gate-backtest is a skill for Claude Code from xetenet/xete-mcp. It costs 87 tokens per session (870 once invoked), scanned A, original, MIT.

A skill that tests code-review gates against a repository’s real Git history. It replays past fixes in a safe, temporary copy to see which defects the gates would have caught.

In plain words
What is it for?
Backtesting, calibrating, or training gate systems; measuring recall and friction; and proposing new review patterns from missed defects.
Why use it?
It shows whether review rules detect real bugs and identifies rules that create friction without finding known defects.

Skill for Claude Code

Written for Claude Code: installed under .claude/.

This is xetenet/xete-mcp's own configuration. It tells Claude Code how to work on xete-mcp itself, so it is not a mod to install elsewhere. Copy it as a starting point and replace the rules that are about this project. Everything xete-mcp configures →

Reuse

Borrowing it

Nothing to install: this file belongs to xetenet/xete-mcp. Take a copy, put it at the same path in your own repository, and replace the rules that are about this project with yours.

Copy the file
curl -O https://raw.githubusercontent.com/xetenet/xete-mcp/main/.claude/skills/gate-backtest/SKILL.md
Clone the repo
git clone --depth 1 https://github.com/xetenet/xete-mcp

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for gate-backtest

README.md
[![agentmods](https://agentmods.dev/badge/skills/xetenet/xete-mcp/gate-backtest/github.svg)](https://agentmods.dev/skills/xetenet/xete-mcp/gate-backtest)
Your own site
<a href="https://agentmods.dev/skills/xetenet/xete-mcp/gate-backtest"><img src="https://agentmods.dev/badge/skills/xetenet/xete-mcp/gate-backtest/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for gate-backtest

Your own site · 80×15
<a href="https://agentmods.dev/skills/xetenet/xete-mcp/gate-backtest"><img src="https://agentmods.dev/badge/skills/xetenet/xete-mcp/gate-backtest.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 87 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 870 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00087 $0.00870
Opus 5 $0.00044 $0.00435
Sonnet 5 $0.00017 $0.00174
Haiku 4.5 $0.00009 $0.00087

Measured 10d ago against content hash 34413bd8cf72, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-10, from the pricing page.

Security

Grade A, and why

gate-backtest scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 10d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

.claude/skills/gate-backtest/SKILL.md · 59 lines

How it starts

The opening of the file, as written. The whole thing — 59 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Gate Backtest

The repo's own history is a labeled dataset: every fix commit marks an earlier commit that introduced a real defect. This skill replays that history against the gates and converts each real defect into a permanent benchmark.

Safety invariant

All work happens in the throwaway clone that scripts/backtest.sh creates — remotes stripped, nothing writable pointing at the real repo. Never run analysis inside an active working copy. Outputs (benchmarks, pattern proposals) land only in the xete-agent-skills repo via PR.

Step 1: Mechanical replay

scripts/backtest.sh <path-or-url-to-repo>

Produces: recall (fraction of real defect-introducing commits the gate would have caught), friction (gated commits with no known defect), missed culprits with files, and suggested pattern additions.

Step 2: Qualitative pass on every culprit (caught AND missed)

For each culprit commit in the report, answer three questions by reading the actual diff of the culprit and its fix:

  1. Which gate would have caught it? Map the defect to a specific line of the solana-security-hardening checklist, or to a doubt class in doubt-driven-review. If NO existing gate item maps to it, that is a checklist gap — the fix becomes a new checklist line.
  2. Was it catchable at commit time? Some defects are only visible with later context (spec changed, dependency behavior). Mark honestly: catchable or hindsight-only. Hindsight-only cases must not inflate the gate's claimed value.
  3. What is the doubt prompt? Write the one question a fresh-context reviewer would have needed to ask to find it. Concrete, not generic: "what happens when the same commitment is submitted to two tabs?" not "is this secure?"

Step 3: Author benchmark cases

One file per real defect: benchmarks/BM-<short-name>.md

# BM: <defect in one line>
Source: <repo> culprit <hash> fixed by <hash>
Paths: <files/dirs involved>
Class: <overflow | replay | validation-gap | key-leak | logic | ...>
Catchable at commit time: yes | hindsight-only
Gate mapping: <checklist item or doubt class; NEW if it was a gap>
Doubt prompt: <the question that finds this bug>
Real solution: <what the actual fix did, 1-2 lines>

Read the full file on GitHub · 59 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 10d ago First seen · 59 lines · 87 tokens per session scan A 34413bd8cf72

Subscribe to this mod's changes

gate-backtest is a skill published in the GitHub repository xetenet/xete-mcp (0 stars, last pushed 23d ago), licensed MIT. It adds 87 tokens to every session and 870 once invoked, about $0.0004 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other skills, from other repositories

gitlab-merge-request-review

Review and merge GitLab merge requests via the gitlab-api MCP server — by default the MRs assigned to you or where you are a reviewer, optionally scoped to a project, group, or the whole instance. Read an MR, gate it on a green pipeline (pipeline → jobs → job log), then approve, accept/merge, or set…

Knuckles-Team/gitlab-api · 158 tokens

review-changes

Review current staged, unstaged, and untracked Git changes for correctness and regression risk, grounded in changed paths, diffs, focused file reads, and nearby test discovery. Use when the user asks to review local changes or a working-tree diff; do not use for broad repository audits.

caiowilson/MCP-memento · 62 tokens

pr-analysis

Analyse a GitHub pull request by fetching its metadata, diff, linked issues and CI status.

saidsef/mcp-github-pr-issue-analyser · 18 tokens

address-pr-review-locally

Evaluate and address a GitHub pull request review locally. Use when a PR review contains inline comments, suggestions, or requested changes that need to be implemented in the local workspace. Covers fetching review threads, triaging by severity, applying code fixes, running tests, and optionally replying to or…

Anselmoo/mcp-ai-agent-guidelines · 68 tokens

commit-suggest

Conventional Commits message generator from current staged + unstaged changes. Read-only — runs only allowlisted git commands, never commits, never pushes, never adds AI co-author trailers. Output is plain text the user pastes. Triggers: "suggest a commit", "commit message", "commit msg", "write a commit", "gen…

ggemba/squad-mcp · 0 tokens

enable-journaling

Opt-in setup for auto-journaling capture plumbing. Copies bundled PostToolUse hook scripts into .squad/hooks/ and prints the .claude/settings.json snippet to wire them up. Capture-only — squad behaviour does NOT change until a follow-up release adds distillation + retrieval. Triggers: "enable journaling", "turn on…

ggemba/squad-mcp · 0 tokens