Is your site blocking AI crawlers?
Enter a domain. We read its robots.txt and tell you which AI crawlers can reach it — and which are shut out. Blocked crawlers can't cite you, no matter how good the content is.
Why blocking AI crawlers costs you
Live-answer crawlers like OAI-SearchBot, Perplexity-User and Claude-Web fetch pages at the moment someone asks a question. If robots.txt turns them away, your brand simply isn't available to be quoted — the answer gets built from whoever is. Training crawlers like GPTBot and Google-Extended matter over a longer horizon: they decide whether a model knows your brand at all.