agentv
01Plugin Claude Code
Evaluate and optimize AI agents.
Plugin Claude Code
Evaluate and optimize AI agents.
Instructions file CodexOpenCode
Instructions for EntityProcess/agentv, covering agentv agent guide, product direction, always-read rules, repo map and routing.
Instructions file
Instructions for EntityProcess/agentv, a project described as: Light-weight AI agent evaluation and optimization framework.
Command
Run the full deployment pipeline: plan, execute, and verify.
Skill Claude CodeCodex
This skill should be used when asked to "execute a deployment", "run the deploy plan", or "deploy services". Reads deploy-plan.md and executes each step with health checks.
Skill Claude CodeCodex
This skill should be used when asked to "plan a deployment", "create a deploy plan", or "prepare release steps". Produces a deployment plan with rollback strategy.
Skill Claude CodeCodex
This skill should be used when asked to "rollback a deployment", "revert services", or "undo deploy". Reads deploy-plan.md and reverses completed steps.
Skill Claude CodeCodex
Use when the user asks about deploying services, checking deployment status, rollback procedures, or release management at Acme Corp.
Skill Claude CodeCodex
Use when the user asks to analyze CSV data. MUST use the weighted revenue formula defined below.
Settings file Claude Code
Agent settings configuring permissions, plugins.
Plugin Claude Code
Design and review AI agent systems: architecture patterns, workflow design, and plugin quality review.
Skill Claude CodeCodex
Use when designing an AI agent system, selecting agentic design patterns, planning multi-phase workflows, choosing between single-agent and multi-agent architectures, or when asked "what kind of agent should I build", "how should I structure this automation", "design an agent for X", or "which agentic pattern fits…
Skill Claude CodeCodex
Use when reviewing an AI plugin pull request, auditing plugin quality before release, or when asked to "review a plugin PR", "review skills in this PR", "check plugin quality", or "review workflow architecture". Covers skill quality, structural linting, and workflow architecture review.
Plugin Claude Code
AgentV CLI skills for evaluating, optimizing, and governing AI agents.
Skill Claude CodeCodex
AgentV CLI skills for evaluating, optimizing, and governing AI agents. Triggers: run evals, benchmark agents, write evals, review evals, analyze traces, optimize prompts, governance linting. Covers: eval running, eval writing, eval review, trace analysis, description optimization, autoresearch, and governance…
Skill Claude CodeCodex
Capture, optimize, and publish screenshots to Astro docs. Use when asked to take screenshots for docs, update doc images, compress PNG assets, or add visual documentation to the agentv.dev docs site. Triggers on "add screenshots to docs", "update docs images", "compress screenshots", "optimize PNG", "document with…
Skill Claude CodeCodex
Run AgentV evaluations and optimize agents through eval-driven iteration. Triggers: run evals, benchmark agents, optimize prompts/skills against evals, compare agent outputs across providers, analyze eval results, offline evaluation of recorded sessions, run autoresearch, optimize unattended, run overnight…
Agent
Analyze AgentV evaluation results to identify weak assertions, suggest deterministic upgrades for LLM-grader graders, flag cost/quality improvements, and surface cross-run benchmark patterns. Use when reviewing eval quality, improving evaluation configs, or triaging flaky/expensive evaluations.
Agent
Perform bias-free blind comparison of evaluation outputs from multiple providers or configurations. Randomizes labeling, generates task-specific rubrics, scores N-way comparisons, then unblinds results and attributes improvements. Dispatch this agent when comparing outputs across targets or iterations.
Agent
Execute an AgentV evaluation test case by performing the task described in the input. Reads input.json from the test directory, carries out the task using available tools, and writes response.md with the result. Dispatch one executor subagent per test case, all in parallel.
Agent
Grade a candidate response for an AgentV evaluation test case. Evaluates all assertion types natively — deterministic checks via string operations, LLM grading via Claude's own reasoning, script-grader via Bash script execution. Zero CLI dependency. Dispatch this agent after a candidate completes a test case.
Agent
Generate improved versions of the artifact under test (skill, prompt, config, or directory of related files) based on failure analysis. Reads the current best artifact from the working tree, applies targeted mutations to address failing assertions, and writes changes in place. Supports single files and multi-file…
Skill Claude CodeCodex
Migrate AgentV eval YAML across breaking schema changes, especially workspace contract updates and portable-vs-local runtime binding cleanup.
Skill Claude CodeCodex
Use when reviewing eval YAML files for quality issues, linting eval files before committing, checking eval schema compliance, or when asked to "review these evals", "check eval quality", "lint eval files", or "validate eval structure". Do NOT use for writing evals (use agentv-eval-writer) or running evals (use…