271 tagged Evaluation, measured the same way as everything else here.
Browse within: LLM 205datasets 106gpt 103agent 68benchmark 63cli 43harness 42benchmarking 38leaderboard 38agentic-ai 36awesome-list 34ai-coding 33cyanheads 33evals 33
Skill Claude CodeCodex
Connect the codebase's AI agent to LangWatch agent simulations, so test suites run against the real agent process. Adds a small connect function beside the service startup that calls the agent already in the codebase, which opens an outbound connection and registers the agent with its environment and its run…
Skill Claude CodeCodex
Configure feedback functions and selectors for TruLens evaluations.
Skill Claude CodeCodex
LLM evaluation & inference performance testing via the evalscope CLI. Translates natural language requests into evalscope commands for: (1) Model accuracy evaluation — runs registered benchmarks against local checkpoints or API endpoints (OpenAI-compatible, Anthropic, LiteLLM); (2) Performance stress testing — TTFT…
Skill Claude CodeCodex
A workflow for creating, improving, or evaluating reusable coding-agent skills from repeatable procedures, prompts, scripts, or standard operating instructions.
Skill Claude CodeCodex
Detect whether an API endpoint is backed by genuine Claude (not a wrapper, proxy, or impersonator) using 9 weighted rule-based checks that mirror the claude-verify project. Also extracts injected system prompts from providers that override Claude's identity. Fully self-contained — copy the code below and run, no extra…
Skill Claude CodeCodex
One-time onboarding for the executive/manager commitment workflow — delegation-heavy, meeting prep, decision capture, morning and evening digests. Creates a commitments project and installs two dashboard widgets. After successful setup this skill is excluded from selection until the marker file is deleted.
Skill Claude CodeCodex ✓ vendor
Use when converting an existing benchmark, rubric, verifier, task YAML/JSON, or domain check into SkillEvaluator BYOG/BYOT custom evaluation.
Skill Codex
Find, inspect, and check AI benchmark records with the Benchmark Radar CLI. Use when a request needs benchmark discovery, details, recent Radar evidence, or local data health; do not assume why the user needs the results.
Skill Claude CodeCodex
Dialectical reasoning and autocoding via Hegelion MCP tools.
adaptyvbio/protein-design-skills
Skill Claude CodeCodex
Quality control metrics and filtering thresholds for protein design. Use this skill when: (1) Evaluating design quality for binding, expression, or structure, (2) Setting filtering thresholds for pLDDT, ipTM, PAE, (3) Checking sequence liabilities (cysteines, deamidation, polybasic clusters), (4) Creating multi-stage…
Skill Claude Code
GAN-style iterative improvement loop for any text artifact. Mutates a file, grades each change against a rubric with a SEPARATE model, keeps only verified wins (pairwise-judged), reverts the rest. The git history is the improvement log. Use when the user wants to autonomously improve the quality of a document, email…
Skill Claude CodeCodex
Writes the scenarios an AI agent is tested with, each a whole task made hard in one real way and proved against the world before it is kept. Use whenever scenarios, test cases or a suite are wanted for an agent whose contract and world have already been built, and before every scenario is submitted.
Dicklesworthstone/jeffreysprompts.com
Skill Claude CodeCodex
Generate 30 improvement ideas, rigorously evaluate each, distill to the very best 5.
Skill Claude CodeCodex
Evaluate AI outputs with LayerLens. Upload traces, create judges, run evaluations, and retrieve quality scores -- all from within OpenClaw.
diegosouzapw/awesome-omni-skill
Skill Claude CodeCodex
LLM prompt management and evaluation platform. Version prompts, run A/B tests, evaluate with metrics, and deploy with confidence using Agenta's self-hosted solution.
gmaxxxie/ai-native-product-agent-skills
Skill Claude CodeCodex
A workflow for testing an AI product direction through capability, product, and business experiments.
Skill Claude Code
A comprehensive skill to understanding how Langium-based projects work — from grammar definition through code generation, runtime parsing, linking, validation, and LSP integration.
zongtingwei/Bioclaw_Skills_Hub
Skill Claude CodeCodex
Protein design quality control, filtering thresholds, and ranking guidance. Use this skill when: (1) Evaluating design quality for binding, expression, or structure, (2) Setting filtering thresholds for pLDDT, ipTM, PAE, (3) Checking sequence liabilities (cysteines, deamidation, polybasic clusters), (4) Creating…
Skill Claude CodeCodex
Use when asked to run, benchmark, evaluate, or score an LLM with AEON Bench. You run the AEON Bench Pod on the user's machine, point it at a model, run the benchmark, and submit the signed result to the public leaderboard at aeon-bench.com. All work happens on the pod. The mothership only shows the board and accepts…
Accelerated-Innovation/governed-ai-delivery
Skill Claude Code
Zero-One-Many Representation Evolution — use this skill whenever working with existing code that needs to change, grow, or be refactored. Triggers include: "refactor this", "add a new X to this", "this is getting messy", "how should I represent this", "there's a lot of duplication here", or any time numbered…
Skill Claude CodeCodex
Fetches current weather data for any city using OpenWeatherMap API.
Skill Claude CodeCodex
A tool for evaluating and improving other coding-agent skills through benchmarks, adversarial tests, and repeated improvement cycles.
Skill Claude Code
Drive AI application evaluations using the EvalSurfer skill-first workflow. Use when creating AI eval rubrics, reviewing RAG outputs, checking agent tool use, assessing safety, or calculating operational metrics like latency, TTFT, inter-token latency, throughput (tokens per second), P99 tail latency, cost, cost per…
Skill Codex
A writing guide for giving practical advice when the situation is unclear, trade-offs matter, or information is incomplete.
At most 3 mods per repository are shown here, and a mod shipped inside a plugin is left to that plugin's page — the rest are on their repository pages: