0xMassi/webclaw

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

About the project

webclaw is a web-content extraction tool that turns webpages into clean Markdown, JSON, and context suitable for language models. It is for AI agents and retrieval-augmented applications that need usable content from websites, and can be used through a CLI, REST API, SDKs, or MCP server. The catalogue includes instructions and an MCP integration for connecting compatible agents to it.

Latest release v0.6.22 · 30 Aug 2026

These files are 0xMassi/webclaw's own configuration. They tell Claude Code how to work on this repository, so they are not mods to install elsewhere. Copy one as a starting point and replace the parts that are about this project.

2,323Stars on the repository
1Files it configures its agents with
5,176Tokens loaded in every session
1Agent configured

Instructions