audit-data-contamination

audit-data-contamination is a skill for Claude Code, Codex from yogsoth-ai/de-anthropocentric-research-engine. It costs 25 tokens per session (291 once invoked), scanned A, original, Apache-2.0.

A data-contamination audit that checks whether evaluation data has leaked from training data, public sources, earlier releases, or other disclosure routes. Data contamination can make a system appear better because it has already seen the answers or close copies.

In plain words
What is it for?
Use it to compare dataset partitions with training and public-source records, investigate possible leakage, and report affected cases and its likely impact.
Why use it?
It helps distinguish genuine performance from memorisation, train/test leakage, and time-related leakage. Suspected contamination is tied to records and a specific path by which it could have occurred.

Skill for Claude CodeCodex

Written for no agent in particular: nothing here depends on one.

Good fit Use it to compare dataset partitions with training and public-source records, investigate possible leakage, and report affected cases and its likely impact.

Compare 6 skills from other repositories ↓
Install with agentmods
npx agentmods add skills/yogsoth-ai/de-anthropocentric-research-engine/audit-data-contamination
Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

Any agent
npx skills add yogsoth-ai/de-anthropocentric-research-engine --skill audit-data-contamination
Clone the repo
git clone --depth 1 https://github.com/yogsoth-ai/de-anthropocentric-research-engine

Made for: Claude Code, Codex.

Wrote this? Show the measurements

A badge with what this costs and how it scanned, read live from this page, so it follows the numbers instead of freezing them. Markdown for a README, HTML for a documentation site or a project page.

agentmods badge for audit-data-contamination

README.md
[![agentmods](https://agentmods.dev/badge/skills/yogsoth-ai/de-anthropocentric-research-engine/audit-data-contamination/github.svg)](https://agentmods.dev/skills/yogsoth-ai/de-anthropocentric-research-engine/audit-data-contamination)
Your own site
<a href="https://agentmods.dev/skills/yogsoth-ai/de-anthropocentric-research-engine/audit-data-contamination"><img src="https://agentmods.dev/badge/skills/yogsoth-ai/de-anthropocentric-research-engine/audit-data-contamination/github.svg" alt="Measured on agentmods" height="20"></a>

Or the 80×15 button, for a site that already has a row of RSS and ATOM ones. Only the verdict fits; the numbers stay here.

agentmods 80×15 button for audit-data-contamination

Your own site · 80×15
<a href="https://agentmods.dev/skills/yogsoth-ai/de-anthropocentric-research-engine/audit-data-contamination"><img src="https://agentmods.dev/badge/skills/yogsoth-ai/de-anthropocentric-research-engine/audit-data-contamination.svg" alt="Reviewed on agentmods" width="80" height="20"></a>
Per session 25 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 291 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. A grade says what 26 rules found in the file — not that it is safe.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5.1 $0.00025 $0.00291
Opus 5.5 $0.00010 $0.00116
Sonnet 5.5 $0.00005 $0.00058
Haiku 4.5 $0.00003 $0.00029

Measured 1mo ago against content hash 5f6a3c2149cb, method: parsed. Prices are Anthropic first-party input rates as of 2026-10-07, from the pricing page.

Security

Grade A, and why

audit-data-contamination scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 1mo ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

skills/audit-data-contamination/SKILL.md · 47 lines

What it actually says

audit-data-contamination

Purpose

Audit train/test leakage, memorization artifacts, temporal leakage, and disclosure pathways that can invalidate evaluation.

Input contract

required: [dataset_partitions, training_sources, evaluation_records]
optional: [release_history, deduplication_keys, access_logs]
constraints: [each contamination claim requires a matched record, pathway, and comparison basis]

Procedure

  1. Define partition, temporal, entity, and disclosure boundaries.
  2. Match evaluation items against training and public-source records using declared keys.
  3. Test suspected leakage pathways and compare affected with unaffected cases.
  4. Classify confirmed, plausible, and unassessed contamination with impact notes.

Output contract

produces: [contamination_matches, pathway_map, affected_case_set, impact_assessment, audit_uncertainties]
delta_fields: [findings, evidence_updates, uncertainties, decisions, open_questions]

Quality gates

  • Matching keys and time boundaries are recorded.
  • False-positive matches are sampled and documented.

Failure and counterexamples

Do not call lexical overlap contamination without a disclosure pathway, and do not infer clean separation from missing metadata.

Provenance map

  • resolved: knowledge-acquisition-contamination-audit
Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 1mo ago First seen · 47 lines · 25 tokens per session scan A 5f6a3c2149cb

Subscribe to this mod's changes

audit-data-contamination is a skill published in the GitHub repository yogsoth-ai/de-anthropocentric-research-engine (505 stars, last pushed 4d ago), licensed Apache-2.0. It adds 25 tokens to every session and 291 once invoked, about $0.0001 per session on Opus 5.5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-09-24.

Related

Other skills, from other repositories

local-ai-agents

Build local-first AI agents that run entirely on a developer workstation with Microsoft Foundry Local and Qwen function-calling models. Covers Small Language Models (SLMs), the OpenAI-compatible local endpoint, sandboxed local tools, local RAG with Chroma, local MCP servers, hybrid cloud/local routing, and the…

microsoft/ai-agents-for-beginners · 200 tokens

systematic-debugging

Use when encountering any bug, test failure, or unexpected behavior, before proposing fixes.

obra/superpowers · 21 tokens

next-cache-components-adoption

Turn on Cache Components in a Next.js app and resolve the blocking routes it surfaces. Use when the user wants to enable, adopt, or migrate to Cache Components, flip the cacheComponents flag, work through a flood of blocking-prerender / instant validation errors, run the cache-components-instant-false codemod, or…

vercel/next.js · 95 tokens

chat-pet-sprite-creation

Use when creating or changing VS Code chat pet sprite art, sprite sheets, state animations, eye treatments, Stable/Insiders variants, or pet transitions under src/vs/workbench/contrib/chat/browser/widget/media/chatPet.

microsoft/vscode · 53 tokens

cpu-profile-analysis

Analyze V8/Chrome CPU profiles (.cpuprofile) and DevTools trace files (Trace-.json). Use when: profiling performance, investigating slow functions, comparing code paths, finding bottlenecks, analyzing timeToRequest, understanding call trees from sampling profiler data, analyzing layout/paint/rendering, investigating…

microsoft/vscode · 71 tokens

insight-error-page

Write or audit an insight-kind error page for the Next.js dev overlay. Use when creating a new errors/ .mdx page, auditing an existing one, or checking that a page matches the framework fix cards. Covers page structure, title alignment, FixCard cards with Copy prompt button, code snippets, terminology verification…

vercel/next.js · 83 tokens