Anshumaan031/Web-knowledge-Crawler

A distributed Model Context Protocol (MCP) server implementing an intelligent web ingestion and retrieval-augmented generation pipeline for AI agents and coding assistants.

Open on GitHub

8Stars on the repository

1Mods indexed here, across every type

1y agoLast push, which is what freshness is scored on

MITLicence, which decides whether bodies are shown

Sort Relevance Recently updated Fewest tokens Security grade Repo stars Stars this week Top rated 1 mods

crawl4ai-mcp

Anshumaan031/Web-knowledge-Crawler

MCP server Claude CodeCodexCursor +2

A web crawler using Model Context Protocol (MCP). Runs locally from the crawl4ai-mcp Python package.

8 1y ago A tokens not measured original MIT