A Model Context Protocol (MCP) server built on Cloudflare Workers that provides intelligent web crawling capabilities using browser rendering and AI-powered link extraction.
1 file for Claude Code: smart-web-crawler-mcp CLAUDE.md — 961 tokens loaded in every session.
CLAUDE.md A 961 tok These files are dhannusch/smart-web-crawler-mcp's own configuration — they tell Claude Code how to work on this repository, so they are not mods to install elsewhere. Copy one as a starting point and replace the parts that are about this project.