agentmods.dev

gptbot MCP servers

4 tagged gptbot, measured the same way as everything else here.

Sort RelevanceRecently updatedFewest tokensSecurity gradeRepo starsStars this weekTop rated 4 mods

prerenderbuddy-mcp

01

kopachlager/prerenderbuddy-mcp

MCP server Claude CodeCodexCursor +2

Local MCP tools for crawler-readability and discovery-file diagnostics. Runs locally from the @prerenderbuddy/mcp npm package.

not rated 1 4d ago A tokens not measured original Apache-2.0

robotstxt-ai

02

sharozdawa/robotstxt-ai

MCP server Claude CodeCodexCursor +2

Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot. Runs locally from the robotstxt-ai-mcp npm package.

not rated 1 6mo ago A tokens not measured original MIT

crawlbit

03

amati032-dev/crawlbit-mcp

MCP server Claude CodeCodexCursor +2

Four free tools to check if AI engines can find, read and recognise a site. No API key. Runs locally from the crawlbit-mcp npm package. Needs 1 environment variable to run.

not rated 1 2mo ago A tokens not measured original MIT

crawl-census

04

taylorsmithgg/crawl-census-client

MCP server Claude CodeCodexCursor +2

Ask before you fetch: will this domain serve your crawler, refuse it, or charge it? Remote server at crawlcensus.com.

not rated 0 1mo ago A tokens not measured