rag-implementation-reviewer

rag-implementation-reviewer is an agent for Claude Code from kumaran-is/claude-code-onboarding. It costs 74 tokens per session (1,594 once invoked), scanned A, original, MIT.

A code-review agent for retrieval-augmented generation (RAG), a system that retrieves documents before asking a language model to answer. It checks the parts that collect, search, filter, rank, and present that information.

In plain words
What is it for?
Use it to review document ingestion, chunking, embeddings, vector or keyword search, filtering, reranking, prompts, logging, and evaluation code.
Why use it?
It helps reveal why a document-search assistant may return irrelevant, incomplete, or unauthorized information. It also checks whether the system can recognize when it lacks enough evidence to answer.

Agent for Claude Code

Written for Claude Code: installed under .claude/.

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add agents/kumaran-is/claude-code-onboarding/rag-implementation-reviewer
Clone the repo
git clone --depth 1 https://github.com/kumaran-is/claude-code-onboarding

Made for: Claude Code.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for rag-implementation-reviewer

README.md
[![agentmods](https://agentmods.dev/badge/agents/kumaran-is/claude-code-onboarding/rag-implementation-reviewer.svg)](https://agentmods.dev/agents/kumaran-is/claude-code-onboarding/rag-implementation-reviewer)
Your own site
<a href="https://agentmods.dev/agents/kumaran-is/claude-code-onboarding/rag-implementation-reviewer"><img src="https://agentmods.dev/badge/agents/kumaran-is/claude-code-onboarding/rag-implementation-reviewer.svg" alt="Measured on agentmods" height="20"></a>
Per session 74 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.
When invoked 1,594 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00074 $0.01594
Opus 5 $0.00037 $0.00797
Sonnet 5 $0.00015 $0.00319
Haiku 4.5 $0.00007 $0.00159

Measured 6d ago against content hash 3a4c2e628c2f, method: parsed. Prices are Anthropic first-party input rates as of 2026-09-06, from the pricing page.

Security

Grade A, and why

rag-implementation-reviewer scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 6d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

.claude/agents/rag-implementation-reviewer.md · 189 lines

How it starts

The opening of the file, as written. The whole thing — 189 lines — stays where its author put it; the contents beside it link to each section on GitHub.

RAG Implementation Reviewer

You are a specialist reviewer for RAG implementation code. Your job: read the user's RAG pipeline code and produce a structured review against the production RAG playbook (docs/production-rag-playbook.md if present).

You run in a separate context. Be thorough but focused — the user wants actionable findings, not a generic survey.

Scope

Review code related to:

  • Document ingestion and parsing
  • Chunking
  • Embedding generation
  • Vector / sparse / metadata indexing
  • Query understanding and routing
  • Retrieval (dense, sparse, hybrid)
  • Filtering (especially pre/post-filter, security chokepoints)
  • Fusion (RRF or alternatives)
  • Reranking
  • Context packing
  • Generation prompts and answer contracts
  • Abstention logic
  • Audit logging
  • Eval setup

Out of scope:

  • General code quality unrelated to RAG
  • Front-end / UI code
  • Non-RAG infrastructure

Process

  1. Map the pipeline. Use Glob/Grep to find the main RAG files. Look for typical paths: rag/, retrieval/, pipeline/, agents/, app/rag/. Identify the retrieval entry point(s) and the generation entry point(s).

  2. Identify the stack. Vector DB (look for imports), embedding model, reranker if any, LLM provider. This informs which checks apply.

  3. Run the review. For each section below, find concrete evidence in code (with file:line citations) and classify findings by severity:

    • 🔴 Critical — security incident or data integrity (post-filter on tenant, missing ACL, LLM-trusts-retrieved-content, broken deletion)
    • 🟠 High — production correctness or recall (dense-only retrieval for text corpus, no abstention, no audit log)
    • 🟡 Medium — quality and operations (no eval, no caching, hand-tuned RRF weights without measurement)
    • 🟢 Low — hygiene (missing docstrings, magic numbers)
  4. Produce the report. Output the structured findings in the format below.

Review checklist

Filtering and security (most common failure surface)

Read the full file on GitHub · 189 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 6d ago First seen · 189 lines · 74 tokens per session scan A 3a4c2e628c2f

Subscribe to this mod's changes

rag-implementation-reviewer is an agent published in the GitHub repository kumaran-is/claude-code-onboarding (35 stars, last pushed 2mo ago), licensed MIT. It adds 74 tokens to every session and 1,594 once invoked, about $0.0004 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other agents, from other repositories

AGENTS

In-depth tutorials on LLMs, RAGs and real-world AI agent applications.

patchy631/ai-engineering-hub · 0 tokens

query_optimizer_agent_plan

Query Optimizer Agent 是一个专门用于在 RAG (Retrieval-Augmented Generation) 流程中优化用户查询的智能体。它的核心目标是将原始的、可能模糊或不完整的用户输入,转化为结构化、清晰且更适合向量检索的查询,从而显著提升知识库召回的准确性和相关性。.

DemonDamon/AgenticX · 0 tokens

wiki-qa-probe

A single retrieval probe — explores ONE facet of a question deep through the knowledge graph, embeddings, and source files, and returns grounded findings with exact citations for the hypervisor to fuse.

bearlike/Assistant · 43 tokens

qdrant-expert

Configure and operate the vector store in production. TRIGGER WHEN: creating Qdrant collections, tuning HNSW, quantization, dense plus sparse hybrid search, payload indexing, multi-tenancy, or Qdrant performance troubleshooting. DO NOT TRIGGER WHEN: end-to-end RAG design, or another vector database such as Pinecone…

acaprino/daodan · 91 tokens

FAI LangChain Expert

LangChain framework specialist — LCEL expression language, chains, agents with tool use, retrievers, memory, callbacks, LangSmith tracing, and production RAG pipeline patterns.

frootai/frootai · 41 tokens

senior-llm-engineer-planner

OPUS planner for foundation-model systems. Use BEFORE senior-llm-engineer whenever the task settles a chunking strategy, an embedding model, a retrieval topology, or an eval design - decisions that require re-indexing or re-labelling to reverse. Produces a plan with the mechanism, retrieval shape, output schema, and…

Jm-Paunlagui/CATHERINE · 86 tokens