Can AI search crawlers read your site?
Check public crawling rules and the text available in your homepage HTML. Search access and model-training permission are different things.
Need a new website?
Our business website package is £499 in total, with £99 to start. Check the scope before deciding.
View the packageCan AI search discover my website?
A public technical check can identify barriers, but cannot establish whether an AI service knows or recommends your business. This tool requests the homepage HTML and robots.txt. It looks for readable text, general indexing directives and rules relevant to OpenAI search crawling. It does not query ChatGPT, inspect private search indexes or simulate every crawler. A pass means the checked signal was found, not that a recommendation or citation will follow.
Search access is not training permission
OpenAI describes OAI-SearchBot as a search crawler and GPTBot as a crawler whose content may be used for model training. Their purposes are separate. You may choose to allow search while restricting training. This checker reports that choice neutrally instead of treating every blocked bot as an SEO failure. Complex robots rules, authentication and firewall responses need a manual review.
Give crawlers and customers useful information
Make your services, business identity and contact information clear in accessible page content. Check that useful text is available without relying entirely on JavaScript, and keep structured data consistent with what people can see. A sitemap helps crawlers find URLs but is not proof of indexing. Crawl access is only one part of discoverability; accurate, useful content remains the main reason someone would want to read or cite a page.
Common questions
Does this check all AI agents?
No. It examines specific public signals and OpenAI crawler rules. It cannot establish how every search engine, assistant or third-party agent fetches and uses a website.
Why does the check fail when my website opens normally?
A firewall may reject automated requests, or the server may be slow or redirect in a way this limited checker does not support. An unavailable result is not proof that AI crawlers are blocked. Ask for a manual review.
Does allowing a crawler guarantee visibility?
No. Permission to fetch a page is not the same as fetching it, indexing it or selecting it for an answer. No reliable visibility percentage can be inferred from these checks alone.
Reference: OpenAI crawler descriptions · Google robots.txt introduction