spronta/crawlie

Fast, free, open-source technical SEO + GEO crawler: built for humans and agents.

101Stars on the repository
7Mods indexed here, across every type
1mo agoLast push, which is what freshness is scored on
noneNo LICENSE: all rights reserved, so bodies are not copied

fix-broken-links

01

spronta/crawlie

Skill Claude CodeCodex

Find and fix broken links, dead pages, and redirect chains on a website with crawlie. Use when the user asks to find broken links, 404s, dead links, link rot, redirect chains/loops, or 4xx/5xx pages, or to check that a site's links are healthy. Works even if crawlie is not installed.

101 1mo ago A 77 tokens

geo-ai-readiness

02

spronta/crawlie

Skill Claude CodeCodex

Assess how ready a website is to be cited and answered by AI search and LLMs (Generative Engine Optimization / GEO) using crawlie. Use when the user asks about AI search, generative engine optimization, GEO, getting cited by ChatGPT / Perplexity / Google AI Overviews, llms.txt, structured data for AI, or whether their…

101 1mo ago A 98 tokens

spronta/crawlie

Skill Claude CodeCodex

Run a pre-launch / pre-deploy SEO gate on a site or set of pages with crawlie, returning a clear pass/fail. Use when the user is about to launch, deploy, or ship and wants to verify there are no blocking SEO issues (broken links, 5xx, missing titles/canonicals, noindex slips), or wants a CI gate for SEO regressions.…

101 1mo ago A 94 tokens

seo-site-audit

04

spronta/crawlie

Skill Claude CodeCodex

Run a complete technical SEO + AI-search audit of a website with crawlie. Use when the user asks to audit, crawl, or check a site for SEO issues, broken links, redirects, missing titles/descriptions/metadata, canonical or heading problems, image alt text, duplicate or thin content, or generative-engine (GEO /…

101 1mo ago A 87 tokens