31 MCP tools that give Claude, Cursor and any MCP client the live web — scrape, crawl, search, real Google rank, change tracking, document parsing, plus an autonomous agent that researches from a plain-English prompt with no URLs. Clean Markdown and schema-validated JSON, not raw HTML. Local-Ollama extraction by default. MIT, 1,000 free credits.
This repository also configures its own agents. See what crawlforge-mcp tells them →
MCP server Claude CodeCodexCursor +2
Web scraping, crawling, deep research & autonomous extraction — 31 MCP tools, clean Markdown/JSON. Runs locally from the crawlforge-mcp-server npm package. Needs 3 environment variables to run.