Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf
Crawl4AI is an open-source web crawler and scraper that converts online content into clean Markdown for language-model retrieval, agents, and data pipelines. It is used for web extraction at scale where structured, LLM-ready content is needed. The catalogue includes a command for working with Crawl4AI.
Latest release v0.9.5 — Release v0.9.5 · 14 Oct 2026
1 file for Claude Code: c4ai-check .
.claude/commands/c4ai-check.md A 13 tok These files are unclecode/crawl4ai's own configuration — they tell Claude Code how to work on this repository, so they are not mods to install elsewhere. Copy one as a starting point and replace the parts that are about this project.