What is evaluate-retrieval?

A measured test of document search for a named collection using example questions with known correct sources. Retrieval means finding the most relevant stored documents for a query.

Use it to record returned sources, correct-source rank, citations, and response time, then calculate Hit@1, Hit@3, MRR, and citation matches.

It shows how often the search returns the right source and where it ranks, instead of relying on a subjective assessment of answer quality.

evaluate-retrieval — Skill for Claude Code and Codex by hyh0620

Install

Getting it into your agent

It runs from inside its repository, so the clone comes first — what it calls does not travel with the file alone.

Clone the repo

git clone --depth 1 https://github.com/hyh0620/mcp-knowledge-service

agentmods

npx agentmods add skills/hyh0620/mcp-knowledge-service/evaluate-retrieval

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

README.md

[![agentmods](https://agentmods.dev/badge/skills/hyh0620/mcp-knowledge-service/evaluate-retrieval/github.svg)](https://agentmods.dev/skills/hyh0620/mcp-knowledge-service/evaluate-retrieval)

Your own site

<a href="https://agentmods.dev/skills/hyh0620/mcp-knowledge-service/evaluate-retrieval"><img src="https://agentmods.dev/badge/skills/hyh0620/mcp-knowledge-service/evaluate-retrieval/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

Your own site · 80×15

<a href="https://agentmods.dev/skills/hyh0620/mcp-knowledge-service/evaluate-retrieval"><img src="https://agentmods.dev/badge/skills/hyh0620/mcp-knowledge-service/evaluate-retrieval.svg" alt="Reviewed on agentmods" width="80" height="20"></a>

Per session 18 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.

When invoked 175 The whole file, excluding the scripts and references it only reads on demand.

Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.

Origin original No closer match found in the catalogue.

Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

Model	Per session	Once invoked
Fable 5.1	$0.00018	$0.00175
Opus 5.5	$0.00007	$0.00070
Sonnet 5.5	$0.00004	$0.00035
Haiku 4.5	$0.00002	$0.00017

Measured 2mo ago against content hash 0f92a54f51e7, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

evaluate-retrieval scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2mo ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

.github/skills/evaluate-retrieval/SKILL.md · 35 lines

What it actually says