OAI-AdsBot
Checks the safety of landing pages submitted as ads in ChatGPT, and may use their content to judge when an ad is relevant. It visits only the pages submitted as ads, and OpenAI says what it collects is not used to train generative AI foundation models. OpenAI does not say how it treats robots.txt.
Where this comes from
- Documented by the vendor. Source: developers.openai.com
- Robots.txt behaviour undocumented. Published addresses: openai.com/adsbot.json.
- Listed, not scored. It cannot keep a site out of today's answers, so the check shows a block without deducting for it.
In the top 1,000 websites
Not measured in the October 2026 study of the top 1,000 websites.
What blocking it costs
Nothing: it only crawls when the site owner sets it up. The check lists the block without deducting for it.
The robots.txt lines
To let it in (a group that names the crawler replaces any wildcard rules for it, so this also lifts a User-agent: * block):
User-agent: OAI-AdsBot
Allow: /To keep it out:
User-agent: OAI-AdsBot
Disallow: /A rule in robots.txt is a request. Whether this crawler honours it is undocumented. The robots.txt generator writes a whole file with the same split: block the training crawlers, keep the search and answer crawlers.
Also from OpenAI
GPTBot· Training onlyOAI-SearchBot· AI search indexChatGPT-User· Fetches when a user asks
Does OAI-AdsBot get through on your site?
Run the free check: it reads your robots.txt against all 60 crawlers and tells you which ones can read you, and what to change.