devkit-validate

A validator for an AIWG add-on, framework, or extension. It checks the package manifest, folder layout, referenced files, and component metadata.

In plain words
What is it for?
Use it to inspect a package at a given path, view detailed results, or attempt automatic fixes for common problems.
Why use it?
It catches missing files, invalid settings, orphaned files, and structural mismatches that can stop a package from working correctly.

Skill for Claude CodeCodex

Install

Getting it into your agent

One page per mod, every tool's command on it. A separate URL per tool would split the same page into five that compete with each other.

agentmods
npx agentmods add skills/jmagly/aiwg/devkit-validate
Any agent
npx skills add jmagly/aiwg --skill devkit-validate
Clone the repo
git clone --depth 1 https://github.com/jmagly/aiwg

Made for: Claude Code, Codex.

Per session 15 Skills are progressive disclosure: only the name and description are preloaded; the body loads when the skill is used.
When invoked 1,018 The whole file, excluding the scripts and references it only reads on demand.
Security scan A 0 findings. Scan, not verified.
Origin original No closer match found in the catalogue.
Token cost

What it costs to keep this loaded

Counted locally with the o200k_base tokenizer, which is exact for GPT models; Claude uses its own tokenizer and its counts differ. Treat this as one consistent yardstick across the catalogue rather than a bill. Prices are per million input tokens.

ModelPer sessionOnce invoked
Fable 5 $0.00015 $0.01018
Opus 5 $0.00008 $0.00509
Sonnet 5 $0.00003 $0.00204
Haiku 4.5 $0.00002 $0.00102

Measured 2d ago against content hash 8a391eaf7446, method: parsed. Prices are Anthropic first-party input rates as of 2026-08-30, from the pricing page.

Security

Grade A, and why

devkit-validate scanned grade A with 0 findings against 26 rules in 11 categories — prompt injection, anti-refusal, data exfiltration, privilege escalation, supply chain, agent snooping, system-prompt leakage, SSRF and excessive agency — measured 2d ago.

A static scan of the body, not an audit. Every finding is printed with the line that produced it so you can judge whether it matters here. A mod is markdown that instructs an agent; that is exactly why what it instructs is worth reading.

Nothing flagged

None of the 26 patterns this scan looks for appear in this file: no shell pipes, no recursive deletes, no credential paths, no hidden text, no instruction-override or anti-refusal phrasing, no agent-config snooping. That is not a guarantee, it is the absence of the things that are checkable.

agentic/code/addons/aiwg-dev/skills/devkit-validate/SKILL.md · 163 lines

How it starts

The opening of the file, as written. The whole thing — 163 lines — stays where its author put it; the contents beside it link to each section on GitHub.

Validate AIWG Package

Validate the structure and manifest of an addon, framework, or extension.

Usage

/devkit-validate <path> [options]

Arguments

Argument Required Description
path Yes Path to addon, framework, or extension

Options

Option Description
--fix Attempt to auto-fix common issues
--verbose Show detailed validation output

What It Validates

Manifest Validation

  • manifest.json exists
  • Required fields present: id, type, name, version, description
  • Type is valid: addon, framework, or extension
  • For extensions: requires field specifies valid parent framework
  • All referenced agents exist in agents/ directory
  • All referenced commands exist in commands/ directory
  • All referenced skills exist in skills/ directory
  • All referenced templates exist in templates/ directory

Structure Validation

  • Directory structure matches type expectations
  • README.md exists
  • Entry directories exist if specified
  • No orphaned files (files not in manifest)

Content Validation

  • Agent files have valid frontmatter (name, description, model, tools)
  • Command files have valid frontmatter (name, description, args)
  • Skill directories have SKILL.md with required fields

Extension-Specific Validation

  • Parent framework exists
  • Extension is in parent's extensions/ directory
  • requires field matches parent location

Examples

# Validate addon
/devkit-validate agentic/code/addons/aiwg-utils

# Validate framework
/devkit-validate agentic/code/frameworks/sdlc-complete

# Validate extension
/devkit-validate agentic/code/frameworks/sdlc-complete/extensions/gdpr

# Validate with auto-fix
/devkit-validate agentic/code/addons/my-addon --fix

# Verbose output
/devkit-validate . --verbose

Output Format

Success

✓ Validating: agentic/code/addons/aiwg-utils
  Type: addon
  Version: 1.1.0

✓ Manifest: Valid
  - id: aiwg-utils
  - agents: 1 (1 found)
  - commands: 10 (10 found)
  - skills: 2 (2 found)

✓ Structure: Valid
  - agents/: OK
  - commands/: OK
  - skills/: OK

✓ Content: Valid
  - Agent frontmatter: OK
  - Command frontmatter: OK
  - Skill definitions: OK

═══════════════════════════════
VALIDATION PASSED
═══════════════════════════════

Read the full file on GitHub · 163 lines

Changes

What this file has done since we first saw it

Hashed on every crawl. A supply-chain change to an agent config is a question of when, not whether, so the history is kept rather than the latest state alone.

  1. 2d ago First seen · 163 lines · 15 tokens per session scan A 8a391eaf7446

Subscribe to this mod's changes

devkit-validate is a skill published in the GitHub repository jmagly/aiwg (205 stars, last pushed 4d ago), licensed MIT. It adds 15 tokens to every session and 1,018 once invoked, about $0.0001 per session on Opus 5. A static security scan graded it A with 0 findings. No closer match exists in the catalogue, so it is treated as the original; first seen 2026-08-30.