GetMentionedByAILoading checker…
What you get
Seven crawlers
GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, Google-Extended, PerplexityBot, Googlebot.
Sitemap lines
We list Sitemap: URLs declared in the file.
The matching rule
See which Allow/Disallow actually fired.
No account
One URL. No login.
How to use
- 1
Enter a domain
We always request /robots.txt. Path tested is the homepage (/).
- 2
Parse the groups
A GPTBot group beats *. Empty or missing file usually means allowed.
- 3
Read Allow vs Block
Longest matching rule wins. Use this before you lock AI crawlers out by accident.
FAQ
How do I know if GPTBot can crawl my site?
Fetch /robots.txt and look for a GPTBot group, then *. Empty or missing file usually means allowed. This checker shows Allow vs Block for GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, Google-Extended, PerplexityBot, and Googlebot on /.
Does blocking GPTBot hide me from ChatGPT answers?
It stops that crawler from fetching you going forward. ChatGPT can still mention you from training data, licensed sets, or other sources. Blocking is not an AEO strategy.
Is an empty robots.txt a problem?
No. It usually means allowed. A problem is a Disallow you did not mean — or no sitemap line if you wanted crawlers to find one.