Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
us/crw is a Rust web scraper, crawler, and search API that turns web pages into Markdown or structured JSON, and also provides an MCP server for AI agents. It is for collecting web content through scraping, site crawling, URL discovery, web search, and structured extraction, either as a local binary or managed service. The catalogue add-ons connect coding agents to its API and MCP server.
Latest release v0.36.0 · 19 Sept 2026
1 file for Codex and OpenCode: crw AGENTS.md — 2,009 tokens loaded in every session.
AGENTS.md A 2,009 tok These files are us/crw's own configuration — they tell Codex and OpenCode how to work on this repository, so they are not mods to install elsewhere. Copy one as a starting point and replace the parts that are about this project.