← Free Grader / /tools/sitemap

Are crawlers
actually finding
your pages?

AI bots respect robots.txt — your robots.txt better tell them yes. We fetch your robots.txt and sitemap.xml directly, check for AI crawler allow rules (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot), and validate sitemap freshness.

Fetching robots.txt → fetching sitemap.xml → validating