51 tagged ai evals, measured the same way as everything else here.
Browse within: ai-tool 41
Skill Claude CodeCodex
Use when asked to review a pull request, branch, or diff — before approving, as a self-review before opening a PR, to judge whether a PR is ready — 'is PR 123 mergeable?', 'anything blocking here?' — or to answer 'does this change need an E2E flow'. Applies the FutureAGI coding standards and, in repos with an e2e/…
Skill Claude CodeCodex
Use when a feature or fix in future-agi needs an end-to-end Playwright flow under e2e/ — a new flow for user-visible behaviour, an update to a flow whose pinned endpoint, route, table or selector changed, or when a review flagged missing E2E coverage. Also use to check whether an existing flow already pins an…
Skill Claude CodeCodex
Multi-agent code review with deep analysis. Orchestrates codebase research, optional web research, parallel Rust engineers, codex second opinion, and general-purpose reviewers into a synthesized report. Use when the user asks to review code, review a PR, review changes, audit code quality, or says "review", "/review"…
Skill Claude CodeCodex
Universal first-hop for any tool-backed request that may execute, inspect, mutate, automate, browse, call, fetch, generate, install, test, run, or create artifacts through CLI, shell, API, adapter, browser, provider, local process, or external tool, with trace, alignment, evidence capture, and future recall. Use for…
Skill Claude CodeCodex
Generic example for creating or updating a Codex skill with appropriate resources, metadata, validation, and forward-testing. Use for generic skill creator, create a skill, update a skill, skill creator, skill authoring, SKILL.md, agents/openai.yaml, initskill.py, quickvalidate.py, forward-test a skill, progressive…
Skill Claude CodeCodex
Improve AI application with evaluation-driven development. Define eval criteria, instrument the application, build golden datasets, observe and evaluate application runs, analyze results, and produce a concrete action plan for improvements. ALWAYS USE THIS SKILL when the user asks to set up QA, add tests, add evals…
selectess/fde-consultants-protocoles
Skill Claude CodeCodex
Forward Deployed Engineering co-pilot for coding agents, personal agents, software engineering, AI/agent systems, SaaS architecture, and business AI upgrades. Use when scoping, building, prototyping, or shipping AI products, SaaS features, or business transformations. Produces scoping reports, prototype specs…
selectess/fde-consultants-protocoles
Skill Claude CodeCodex
Cinematic 3D / scroll-driven / motion design skill for landing pages in 2026. Use when building marketing pages, SaaS sites, or product showcases that need scroll storytelling, 3D elements, micro-interactions, kinetic typography, or glassmorphism. Encodes modern best practices from Figma, Anthropic, Apple, Vercel.…
selectess/fde-consultants-protocoles
Skill Claude CodeCodex
A minimal template for creating a new FDE Consultant Skill (Apache-2.0). Use as starting point for any new skill.
Skill Claude CodeCodex
Detects and quantifies confidently-wrong behavior: where a model, classifier, agent, or LLM judge is highly confident and incorrect, and where the coupling between confidence and correctness breaks down under distribution shift. Measures calibration on the in-distribution set and again on the production distribution…
Skill Claude CodeCodex
Start here. Audits a deployed ML or LLM or agent system that scores well on evaluation but fails, regresses, or behaves unexpectedly in production. Runs a reproducible root-cause "autopsy": frames the eval-to-deployment gap, reproduces the production failure, quantifies it by slice, tests confidence calibration under…
Skill Claude CodeCodex
Verifies the tools an agent or orchestrator depends on, by re-deriving a tool evaluation's real accuracy instead of trusting a single pass/fail score. Separates a formatting miss (a correct value scored wrong) from a real failure (a wrong value scored right), recomputes the expected answer from the raw inputs rather…