website-audit

Full Website SEO Audit

Standalone website auditing tool. URL in → crawl → analyze → report out. No dependency on the blog-writer pipeline, project system, or article creation flow.

Invocation

/website-audit https://example.com
/website-audit https://example.com --max-pages 100

Process

Phase 1: INITIALIZE

1. Validate URL:

python -c "from scripts._core.ssrf_guard import validate_url, SSRFError; import sys
try:
    validate_url('$URL', allow_http=True); print('OK')
except SSRFError as e:
    print(f'BLOCKED: {e}'); sys.exit(1)"

⚠️ validate_url() signals success by RETURNING a truthy ValidatedURL and failure by RAISING SSRFError. The old snippet here did err = validate_url(...); print(err or 'OK'), which prints the success object and can never print OK — and that inverted reading got copied into verify_backlinks.py, where it marked every valid backlink "blocked" and silently disabled link verification entirely. Never treat the return value as an error indicator. 2. Create output directory: ./Website Audit/seo-audit-{domain}-{YYYY-MM-DD}/ ⚠️ The Website Audit/ parent already exists and holds every prior audit — write there, NOT in the repo root. This was violated on 2026-08-06 (audit-client.example) and cost a 149 MB directory move plus an artifact URL rescue. Create the full path before crawling, not after. 3. Show cost estimate to user (based on detected page count):

• 8 core agents (Opus): ~$8
• With conditional agents: ~$15 max
• Await user confirmation if over $10

Phase 2: CRAWL

python -m scripts.audit.crawl_site "$URL" --max-pages 500 --concurrent 5 --delay 1.0 --output ./"Website Audit"/seo-audit-{domain}-{date}/crawl-results.json

Configuration:

• Max pages: 500 (user-overridable via --max-pages)
• Respect robots.txt: Yes
• Follow redirects: Yes (max 3 hops)
• Timeout per page: 30 seconds
• Concurrent requests: 5
• Delay between requests: 1 second

Phase 3: DETECT BUSINESS TYPE