Amzn-SearchBot
Improves search in Amazon's products, so allowed pages can appear in places like Alexa; Amazon says it does not crawl for generative AI training. When robots.txt does not name it but allows other search crawlers, it follows the rules given to those.
Where this comes from
- Documented by the vendor. Source: developer.amazon.com
- Honours robots.txt.
- Counted in the readiness score. It can keep a site out of AI search or answers, so a block costs points.
In the top 1,000 websites
Not measured in the October 2026 study of the top 1,000 websites.
What blocking it costs
Your pages leave the search index Amzn-SearchBot builds, so Amazon's product can no longer find or cite them from its own index. The score counts it among the crawlers that feed AI search and answers, so a block costs points.
The robots.txt lines
To let it in (a group that names the crawler replaces any wildcard rules for it, so this also lifts a User-agent: * block):
User-agent: Amzn-SearchBot
Allow: /To keep it out:
User-agent: Amzn-SearchBot
Disallow: /A rule in robots.txt is a request. Amazon says this crawler honours it. The robots.txt generator writes a whole file with the same split: block the training crawlers, keep the search and answer crawlers.
Also from Amazon
Does Amzn-SearchBot get through on your site?
Run the free check: it reads your robots.txt against all 60 crawlers and tells you which ones can read you, and what to change.