rag-learning-academy: Skill for Claude Code

.claude/skills/break-it/SKILL.md

break-it is a skill for Claude Code from TakaGoto/rag-learning-academy. It costs 15 tokens per session (811 once invoked), scanned A, original, MIT.

A debugging guide for learning retrieval-augmented generation by investigating deliberately broken document-search and answer pipelines.

In plain words
What is it for?
Use it for guided debugging exercises involving chunking, embeddings, retrieval, and other common RAG pipeline failures.
Why use it?
It teaches the causes of incorrect results by making learners identify problems such as faulty document splitting or mismatched search models.

Skill for Claude Code

Written for Claude Code: installed under .claude/.

This is TakaGoto/rag-learning-academy's own configuration. It tells Claude Code how to work on rag-learning-academy itself, so it is not a mod to install elsewhere. Copy it as a starting point and replace the rules that are about this project. Everything rag-learning-academy configures →

Reuse

Borrowing it

Nothing to install: this file belongs to TakaGoto/rag-learning-academy. Take a copy, put it at the same path in your own repository, and replace the rules that are about this project with yours.

Copy the file
curl -O https://raw.githubusercontent.com/TakaGoto/rag-learning-academy/main/.claude/skills/break-it/SKILL.md
Clone the repo
git clone --depth 1 https://github.com/TakaGoto/rag-learning-academy

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for break-it

README.md
[![agentmods](https://agentmods.dev/badge/skills/takagoto/rag-learning-academy/break-it/github.svg)](https://agentmods.dev/skills/takagoto/rag-learning-academy/break-it)
Your own site
<a href="https://agentmods.dev/skills/takagoto/rag-learning-academy/break-it"><img src="https://agentmods.dev/badge/skills/takagoto/rag-learning-academy/break-it/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for break-it

Your own site · 80×15
<a href="https://agentmods.dev/skills/takagoto/rag-learning-academy/break-it"><img src="https://agentmods.dev/badge/skills/takagoto/rag-learning-academy/break-it.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 15 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 811 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00015 $0.00811
Opus 5 $0.00008 $0.00405
Sonnet 5 $0.00003 $0.00162
Haiku 4.5 $0.00002 $0.00081

Measured 9d ago against content hash 42ed5ddf9f42, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-09, from the pricing page.

Security

Grade A, and why

break-it scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 9d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

.claude/skills/break-it/SKILL.md · 85 lines

How it starts

The opening of the file, as written. The whole thing — 85 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Break It: Learn by Debugging

Introduce a realistic bug into a RAG pipeline and challenge the learner to find and fix it. Debugging teaches more than building because you have to understand why things work to figure out why they don't.

Language awareness: See .claude/LANGUAGE_AWARENESS.md.

Step 1: Choose a Difficulty

If the learner specifies a difficulty (e.g., /break-it hard), use that. Otherwise, calibrate based on their progress:

  • Easy — One obvious bug. The pipeline runs but gives clearly wrong results.
  • Medium — One subtle bug. The pipeline runs and results look plausible but are wrong.
  • Hard — Two bugs that interact. Fixing one makes the other more visible.

Step 2: Select a Bug Category

Pick from these common RAG failure modes. Rotate through categories so the learner sees variety:

Chunking Bugs

  • Chunk size set way too small (10 tokens) — fragments lose all context
  • Zero overlap — information at boundaries is lost
  • Wrong separator for the document type (splitting code on paragraphs)

Embedding Bugs

  • Mismatched embedding models between indexing and querying
  • Missing query prefix for asymmetric models (e.g., no "query: " prefix for E5)
  • Embeddings not normalized, breaking cosine similarity

Retrieval Bugs

  • Top-k set to 1 — missing relevant context spread across chunks
  • Wrong distance metric (L2 instead of cosine)
  • Metadata filter too restrictive — filtering out relevant results

Generation Bugs

  • Context placed after the question (lost-in-the-middle effect)
  • No grounding instruction — model ignores context and hallucinates
  • Context window exceeded — retrieved chunks silently truncated

Pipeline Bugs

  • Stale index — new documents added but not re-embedded
  • Document not chunked before embedding (entire doc as one vector)
  • Query embedded with a different model than the corpus

Step 3: Present the Broken Pipeline

Show the learner a complete, runnable pipeline with the bug(s) already in place. Include:

Read the full file on GitHub · 85 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 9d ago First seen · 85 lines · 15 tokens per session scan A 42ed5ddf9f42

Subscribe to this mod's changes

break-it is a skill published in the GitHub repository TakaGoto/rag-learning-academy (18 stars, last pushed 5mo ago), licensed MIT. It adds 15 tokens to every session and 811 once invoked, about $0.0001 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

browserwing-admin

Manage and operate BrowserWing — an intelligent browser automation platform. Install dependencies, configure LLM, create/manage/execute automation scripts, use AI-driven exploration to generate scripts, browse the script marketplace, and troubleshoot issues.

MemTensor/MemOS · 47 tokens

rag-blueprint

NVIDIA RAG Blueprint — deploy, configure, troubleshoot, and manage. Handles any RAG action: deploy, install, start, enable, disable, toggle, change, configure, troubleshoot, debug, fix, shutdown, stop, or tear down any RAG feature or service (Agentic RAG, VLM, guardrails, query rewriting, models, search, ingestion…

NVIDIA-AI-Blueprints/rag · 92 tokens

rag-index-decisions

After making a non-obvious architectural decision, solving a novel bug, agreeing on a coding standard, or reaching a conclusion worth remembering, index it back into the knowledge base so the next occurrence is one search away. Uses adddocument or addfromurl. Closes the feedback loop that makes a RAG-backed team…

lyonzin/knowledge-rag · 72 tokens

x-bug2rag

A knowledge-capture tool that turns reusable bug explanations into a local RAG collection, meaning a searchable store of text that an agent can retrieve later. It records the trigger, incorrect implementation, correct implementation, and observable difference.

KtKID/x-dev-pipeline · 255 tokens

rag-troubleshoot

When the user reports a bug, error message, stack trace, unexpected behavior, or "why is this broken" question, search the corpus first for prior occurrences, known fixes, or related runbooks. Prevents re-solving problems the team already solved. Trigger on any error signature, exception name, stack trace snippet, or…

lyonzin/knowledge-rag · 78 tokens

mistake-analyzer

Analyze incorrect answers from text, documents, or images; identify root causes of mistakes; classify error types; explain correct reasoning; and generate targeted improvement suggestions, wrong-question notebook entries, or similar practice questions. Use when the user provides a wrong answer, asks why they were…

mingchen666/Reviva · 72 tokens