claudebot MCP servers

2 tagged claudebot, measured the same way as everything else here.

robotstxt-ai

01

sharozdawa/robotstxt-ai

MCP server Claude CodeCodexCursor +2

Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot. Runs locally from the robotstxt-ai-mcp npm package.

not rated 1 5mo ago A tokens not measured original MIT

crawl-census

02

taylorsmithgg/crawl-census-client

MCP server Claude CodeCodexCursor +2

Ask before you fetch: will this domain serve your crawler, refuse it, or charge it? Remote server at crawlcensus.com.

not rated 0 15d ago A tokens not measured