AI crawlers · Yandex AI · AI answers · Counted in the score

YandexAdditional

Yandex's control for its AI answers: disallow it to keep pages Yandex has already indexed out of Yandex AI answers while staying in ordinary Yandex search. It does not request new pages.

Where this comes from

  • Documented by the vendor. Source: yandex.com
  • Honours robots.txt.
  • Counted in the readiness score. It can keep a site out of AI search or answers, so a block costs points.

In the top 1,000 websites

What blocking it costs

Yandex AI says this token controls more than training, so a block can keep your pages out of its answers or product features. The score counts it, so a block costs points.

The robots.txt lines

To let it in (a group that names the crawler replaces any wildcard rules for it, so this also lifts a User-agent: * block):

User-agent: YandexAdditional
Allow: /

To keep it out:

User-agent: YandexAdditional
Disallow: /

A rule in robots.txt is a request. Yandex AI says this crawler honours it. The robots.txt generator writes a whole file with the same split: block the training crawlers, keep the search and answer crawlers.

Also from Yandex AI

Does YandexAdditional get through on your site?

Run the free check: it reads your robots.txt against all 51 crawlers and tells you which ones can read you, and what to change.