bilginerdem/craw-mcp

Self-hostable MCP server that lets Claude crawl pages blocked by anti-bot walls, JS challenges, or IP bans, without paid scraping APIs. Bring your own proxies. RabbitMQ queue, Rust crawler, MinIO claim-check.

1Stars on the repository
1Mods indexed here, across every type
2mo agoLast push, which is what freshness is scored on
AGPL-3.0Licence, which decides whether bodies are shown

crawmcp

01

bilginerdem/craw-mcp

MCP server Claude CodeCodexCursor

MCP server "crawmcp" as configured in bilginerdem/craw-mcp. Runs locally from the crawmcp npm package.

1 2mo ago A tokens not measured AGPL-3.0