quality-validator

An agent that checks AI skills and rules against defined quality requirements. It reviews their structure, wording, trigger phrases, and clarity, then saves the results.

In plain words
What is it for?
Use it to validate a SKILL.md file or an AI rule file. It checks items such as required fields, usage guidance, workflow steps, and trigger specificity.
Why use it?
A skill or rule can look complete while missing required sections or being too vague to trigger reliably. Independent checking helps find those problems before use.

Agent

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add agents/learnwy/skills/quality-validator
Clone the repo
git clone --depth 1 https://github.com/learnwy/skills
Per session 0 Only the description is in the session, so the agent can decide to use it. The body loads when it is invoked.
When invoked 1,184 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00000 $0.01184
Opus 5 $0.00000 $0.00592
Sonnet 5 $0.00000 $0.00237
Haiku 4.5 $0.00000 $0.00118

Measured 2d ago against content hash 78f7a4ab6afd, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

quality-validator scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

skills/lwy-project-rules-writer/agents/quality-validator.md · 169 lines

How it starts

The opening of the file, as written. The whole thing — 169 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Quality Validator Agent

Validates created skills and rules against quality standards.

Role

Independently assess whether a skill/rule meets best practices. Runs blind to provide an objective evaluation free of creator bias.

Input

  • artifact_path: path to the SKILL.md or rule file to validate
  • artifact_type: "skill" | "rule"
  • project_context: optional project-analysis results
  • output_path: where to save the validation results

Process

Skill validation

Step 1: Structure validation
  1. Frontmatter check:
    • Contains a name field
    • Contains a description field
    • Description includes trigger phrases
    • Description includes "Do NOT use for"
  2. Required sections:
    • A "When to Use" section exists
    • A "Workflow" section exists
    • Steps are numbered and clear
  3. Recommended but optional:
    • An "Error Handling" section
    • A "References" section with valid links
Step 2: Description quality
  1. Trigger analysis:
    • Count the number of distinct trigger phrases
    • Check specificity (not too generic)
    • Check uniqueness (no overlap with common phrases)
  2. Clarity score:
    • Does the first sentence clearly state the purpose?
    • Are the use cases concrete?
    • Are the exclusion conditions explicit?
Step 3: Workflow quality
  1. Step analysis:
    • Are the steps atomic (one action per step)?
    • Are the steps in logical order?
    • Are edge cases handled?
  2. Completeness:
    • Does the workflow cover the happy path?
    • Does the workflow handle errors?
    • Does the workflow include validation?
Step 4: Reference validation
  1. Check that all referenced files exist
  2. Verify paths are relative (not absolute)
  3. Check for broken links

Rule validation

Step 1: Frontmatter validation
  1. Format check:
    • Valid YAML syntax
    • Correct property names
    • globs format: comma-separated, no quotes
  2. Mode consistency:
    • If alwaysApply: true, globs is not needed
    • If globs is present, alwaysApply should be false
    • If description is present, the mode is smart

Read the full file on GitHub · 169 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 2d ago First seen · 169 lines · 0 tokens per session scan A 78f7a4ab6afd

Subscribe to this mod's changes

quality-validator is an agent published in the GitHub repository learnwy/skills (3 stars, last pushed 3mo ago), licensed MIT. It costs nothing until one of its globs matches a file; then it loads 1,184 tokens. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-31.

Related

Other agents, from other repositories