Web crawling tool that integrates with AI assistants via the MCP
Latest release v0.1.6 — Release v0.1.6 · 31 Aug 2026
2 files for GitHub Copilot, Codex and OpenCode: crawl4ai-mcp-llm copilot-instructions.md, crawl4ai-mcp-llm AGENTS.md — 2,630 tokens loaded in every session.
.github/copilot-instructions.md A 395 tok AGENTS.md A 2,235 tok These files are laurentvv/crawl4ai-mcp-llm's own configuration — they tell GitHub Copilot, Codex and OpenCode how to work on this repository, so they are not mods to install elsewhere. Copy one as a starting point and replace the parts that are about this project.