agent-plugin-review

A review guide for checking AI add-ons before they are released or merged into a project. It covers file structure, required tests, and how the add-on's workflow is designed.

In plain words
What is it for?
Use it to review an add-on pull request, check its skills and evaluation files, run structural checks, and organize findings by severity.
Why use it?
It catches missing files, broken references, invalid paths, and other quality problems before release. This reduces the chance that an add-on passes review while still being incomplete or difficult to use.

Skill for Claude CodeCodex

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add skills/entityprocess/agentv/agent-plugin-review
Any agent
npx skills add EntityProcess/agentv --skill agent-plugin-review
Clone the repo
git clone --depth 1 https://github.com/EntityProcess/agentv

Made for: Claude Code, Codex.

Per session 60 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,424 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00060 $0.01424
Opus 5 $0.00030 $0.00712
Sonnet 5 $0.00012 $0.00285
Haiku 4.5 $0.00006 $0.00142

Measured yesterday against content hash 94c3d53726a5, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

agent-plugin-review scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured yesterday.

The scan reads SKILL.md. This mod also ships 1 executable file (scripts/lint_plugin.py), listed below but not scanned — reading those needs a real analyzer, not pattern matching.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

plugins/agentic-engineering/skills/agent-plugin-review/SKILL.md · 114 lines

How it starts

The opening of the file, as written. The whole thing — 114 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Plugin Review

Overview

Review AI plugin PRs by running deterministic structural checks first, then applying LLM judgment for skill quality and workflow architecture. Post findings as inline PR comments.

Process

Step 1: Structural lint

Run scripts/lint_plugin.py against the plugin directory:

python scripts/lint_plugin.py <plugin-dir> --evals-dir <evals-dir> --json

The script checks:

  • Every skills/*/SKILL.md has a corresponding eval file
  • SKILL.md frontmatter has name and description
  • No hardcoded local paths (drive letters, absolute OS paths)
  • No version printing instructions
  • Referenced files (references/*.md) exist
  • Commands reference existing skills
  • Path style consistency across commands

Report findings grouped by severity (error > warning > info).

Step 2: Eval lint

If the PR includes eval files, invoke agentv-eval-review for AgentV-specific eval quality checks.

Additionally, check each eval YAML for these structural patterns:

  • File path format: Every type: file input value MUST start with a leading / (workspace-root-relative). Paths like plugins/foo/SKILL.md are wrong — correct form is /plugins/foo/SKILL.md. Scan every type: file entry and flag any missing leading slash, showing the corrected path.
  • Repeated inputs: If the same file input (same type: file + value) appears identically in every test case, recommend extracting it to the top-level input field. AgentV eval files support a top-level input section that applies to all tests, eliminating per-test duplication.

Step 3: Skill quality review (LLM judgment)

For each SKILL.md, check against references/skill-quality-checklist.md:

  • Description starts with "Use when..." and describes triggering conditions only (not workflow)
  • Description does NOT summarize the skill's process — this causes agents to follow the description instead of reading the SKILL.md body
  • Body is concise — only include what the agent doesn't already know
  • Content is domain-specific (internal conventions, business patterns, context for WHY) — universal concepts AI agents already know are excluded
  • Imperative/infinitive form, not second person
  • Heavy reference (100+ lines) moved to references/ files
  • One excellent code example beats many mediocre ones
  • Flowcharts only for non-obvious decisions
  • Keywords throughout for search discovery
  • Cross-references use skill name with requirement markers, not @ force-load syntax
  • Discipline-enforcing skills have rationalization tables, red flags lists, and explicit loophole closures
  • Consistency — no contradictions within or across files (tool names, filenames, commands, rules)
  • No manual routing workarounds — if AGENTS.md or instruction files contain heavy TRIGGER/ACTION routing tables or skill-chain logic, the skill descriptions are likely too weak. Good descriptions enable auto-discovery without manual routing.

Read the full file on GitHub · 114 lines

Files

What ships with it

3 files beside SKILL.md in the same directory: the scripts, references and assets a skill reads on demand. Not counted in the per-session cost; read them before you install if any of them is executable.

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. yesterday First seen · 114 lines · 60 tokens per session scan A 94c3d53726a5

Subscribe to this mod's changes

agent-plugin-review is a skill published in the GitHub repository EntityProcess/agentv (15 stars, last pushed 1mo ago), licensed MIT. It adds 60 tokens to every session and 1,424 once invoked, about $0.0003 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.

Related

Other skills, from other repositories

neuron-test-engineer

Write tests for Neuron AI agents, RAG systems, workflows, and tools using the built-in testing utilities. Use this skill when the user mentions testing agents, writing unit tests, mocking AI providers, testing tool execution, verifying RAG retrieval, testing workflow behavior, or creating test cases for Neuron AI…

neuron-core/neuron-ai · 94 tokens

neuron-tool-creator

Create custom tools, toolkits, and MCP integrations for Neuron AI agents. Use this skill when the user mentions creating tools, building toolkits, extending Tool class, defining tool properties, implementing tool execution, MCP server integration, Model Context Protocol, connecting external tools, or tool guidelines.…

neuron-core/neuron-ai · 100 tokens

neuron-evaluation-engineer

Create and run AI evaluations with datasets, assertions, and output drivers in Neuron AI. Use this skill whenever the user mentions evaluation, testing AI systems, creating evaluators, dataset-driven testing, assertion-based validation, or wants to measure AI system performance. Also trigger for tasks involving…

neuron-core/neuron-ai · 77 tokens

neuron-structured-output

Design and implement structured output classes for Neuron AI agents using SchemaProperty attributes and validation rules. Use this skill when the user mentions structured output, JSON schema extraction, data validation, output classes, DTOs for AI responses, extracting structured data from LLM, or configuring property…

neuron-core/neuron-ai · 104 tokens

neuron-workflow-architect

Build custom Neuron AI workflows with nodes, events, middleware, and human-in-the-loop patterns. Use this skill whenever the user mentions workflows, orchestration, event-driven systems, custom agents, complex multi-step processes, human-in-the-loop patterns, or wants to build a custom agentic system from scratch.…

neuron-core/neuron-ai · 89 tokens

neuron-agent-builder

Create and configure Neuron AI agents with providers, tools, instructions, and memory. Use this skill whenever the user mentions building agents, creating AI assistants, setting up LLM-powered chat bots, configuring chat agents, or wants to create an agent that can talk, use tools, or handle conversations. Also…

neuron-core/neuron-ai · 89 tokens