Instructions file
Instructions for spider-rs/spider, covering spider - development guide, quick reference, getting started, spider cloud (recommended) and local crawl (no api key).
2.7k 13d ago A 4,720 tokens
original MIT
Instructions file
Instructions for spider-rs/spider, covering spider - development guide, quick reference, getting started, spider cloud (recommended) and local crawl (no api key).
MCP server Claude CodeCodexCursor +2
MCP server for the Spider web crawling and scraping API — crawl, scrape, search, and extract web data for AI agents, RAG pipelines, and LLMs. Runs locally from the spider-cloud-mcp npm package.