How to Check If You

A friend messaged me last week asking why his documentation site wasn't showing up in ChatGPT's search results. He'd been doing all the right things. Good content, proper meta tags, decent domain authority. Took me about 30 seconds to find the problem. His robots.txt was blocking GPTBot. Not intentionally. His hosting provider's default template included a block on several AI crawlers, and he never noticed. Turns out this is way more common than you'd think. The New Crawlers You Probably Don't K