AI crawlers · Amazon · AI answers · Counted in the score

Amazonbot

Improves Amazon's products and services and may be used to train Amazon AI models. Amazon documents two further agents, Amzn-SearchBot (search, including Alexa) and Amzn-User (fetches for a user's Alexa question), which say they do not crawl for generative AI training.

Where this comes from

  • Documented by the vendor. Source: developer.amazon.com
  • Honours robots.txt.
  • Counted in the readiness score. It can keep a site out of AI search or answers, so a block costs points.

In the top 1,000 websites

What blocking it costs

Amazon says this token controls more than training, so a block can keep your pages out of its answers or product features. The score counts it, so a block costs points.

The robots.txt lines

To let it in (a group that names the crawler replaces any wildcard rules for it, so this also lifts a User-agent: * block):

User-agent: Amazonbot
Allow: /

To keep it out:

User-agent: Amazonbot
Disallow: /

A rule in robots.txt is a request. Amazon says this crawler honours it. The robots.txt generator writes a whole file with the same split: block the training crawlers, keep the search and answer crawlers.

Does Amazonbot get through on your site?

Run the free check: it reads your robots.txt against all 51 crawlers and tells you which ones can read you, and what to change.