leakage-detection skills

StamKavid/last-ds-mile

Skill Claude CodeCodex

Part of last-ds-mile

Holds the shared discipline every stage of this pipeline cites — the Red Flags, the Common Rationalizations, and the Hard Gates. Use when someone pushes back on a gate, asks why a baseline is needed, or wants to peek at the test set just once. Use when deciding whether a stage should stop and ask or produce the…

StamKavid/last-ds-mile

Skill Claude CodeCodex

Part of last-ds-mile

Chooses a leakage-safe way to split data — temporal, grouped, stratified, or nested cross-validation — matched to how the rows are actually structured, and decided before any model is trained. Use when someone asks how to split into train and test, set up cross-validation, or pick between KFold, GroupKFold…

StamKavid/last-ds-mile

Skill Claude CodeCodex

Part of last-ds-mile

Handles targets where the interesting class is rare — resampling, class weights, threshold tuning, and the metric consequences. Use when only a tiny fraction of rows are positive, or when a model never predicts the rare class at all. Use when someone mentions SMOTE, oversampling, undersampling, or classweight. Use…

alex-jb/shadow-perception-mcp

Skill Claude CodeCodex

Pre-submit council for Kaggle notebooks. Five voices review the notebook for train/test leakage, protected-class proxy features, seed pinning, competition rule compliance, and submission artifact presence. Returns SHIP / REWORK / BLOCK verdict with per-voice rationale and Ed25519 attestation. Use before hitting Submit…