Runs after a tool call finishes for mcp__snowflake__run_snowflake_query, Bash, Edit, Write, Read, NotebookEdit, MultiEdit, Glob, Grep, WebFetch and mcp__.* tool calls, executing log-snowflake-query.sh and log-action.sh (2 commands). From ai-analyst-lab/ai-analyst-plus.
Independently validate the current analysis with a second model (OpenAI Codex). Codex re-derives the same answer from the same data — blind to Claude's SQL and numbers — and the skill reports AGREE / DISAGREE / PARTIAL per finding. Use when the user types "/codex-review", or says "validate with codex", "codex review"…
Run a comparison: ask one analytics question two ways, with a piece of context and without it, and measure what changed. Use when the user says "/compare", "run it with and without ", "does adding change the answer", "is this context worth it", or wants to see whether a metric definition (or any context) moves the…
Run the held-out gold suite live against the analyst and score it. Use when the user types "/eval", or asks to "run the eval suite", "score the system", "run the train split", "check the test split", "what's our accuracy on the gold cases", or wants the system-level eval number (accuracy + query-similarity + cost).…
Check whether an AI analysis answer is STABLE by running the same question several independent times and measuring what holds versus what drifts. Use when the user types "/reliability", or asks to "run this a few times", "is this answer stable / reliable", "check reliability of ", "does it give the same answer again"…
Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.
Show the provenance trace — every reported number linked to the SQL that produced it, with a confidence badge. Use after an analysis when someone asks "where did that number come from?".
Every agent .md file MUST begin with a CONTRACT block -- a YAML declaration inside an HTML comment that describes the agent's interface. The OR-3 DAG walker reads these contracts to build the execution graph.
Agent "causal-interpreter" from ai-analyst-lab/ai-analyst-plus, covering agent: causal interpreter, purpose, inputs, interpretation framework and step 1: place on confidence ladder.
Agent "causal-method-selector" from ai-analyst-lab/ai-analyst-plus, covering agent: causal method selector, purpose, inputs, decision tree and q1: can you randomize?.
Agent "causal-sensitivity" from ai-analyst-lab/ai-analyst-plus, covering agent: causal sensitivity analysis, purpose, inputs, sensitivity tests by method and for psm: rosenbaum bounds.