dhannusch/smart-web-crawler-mcp

A Model Context Protocol (MCP) server built on Cloudflare Workers that provides intelligent web crawling capabilities using browser rendering and AI-powered link extraction.

These files are dhannusch/smart-web-crawler-mcp's own configuration. They tell Claude Code how to work on this repository, so they are not mods to install elsewhere. Copy one as a starting point and replace the parts that are about this project.

3Stars on the repository
1Files it configures its agents with
961Tokens loaded in every session
1Agent configured

Instructions