R
robotstxt-ai
40FairAnalyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.
Loading the directory
MCP servers linked to github.com/sharozdawa.
5 servers
Analyze and generate robots.txt with AI crawler detection for 20+ bots like GPTBot and ClaudeBot.
Submit URLs for instant indexing via IndexNow and Google Indexing API.
Generate Schema.org JSON-LD markup for 12 types including Person, Product, and FAQ.
SERP-based content scoring and optimization with 7 SEO categories.
Track brand visibility across ChatGPT, Perplexity, Claude, and Gemini.