robots-ai
01Skill Claude CodeCodex
Analyze and generate robots.txt files with AI crawler awareness. Detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.) are blocked or allowed on any website.
1 5mo ago A 44 tokens
original MIT