AI crawlers · Yandex AI · 2 tokens

Yandex AI's AI crawlers

Yandex AI documents each of these and says what it is for, so a site can say yes to one and no to another. Numbers are from the October 2026 study of the top 1,000 websites (2026-10-12).

The split

TokenJobScoreBlocked byAllowed but refused at the server
YandexAdditionalAI answersCounted8.3%not tested
YandexAdditionalBotAI answersCounted8.4%not tested

“Blocked by” is the share of the 569 top-1,000 sites with a robots.txt. The last column was measured for four crawlers only.

YandexAdditional · AI answers

Yandex's control for its AI answers: disallow it to keep pages Yandex has already indexed out of Yandex AI answers while staying in ordinary Yandex search. It does not request new pages.

Documented by the vendor. Its page has the robots.txt lines and what blocking costs.

YandexAdditionalBot · AI answers

The same control as YandexAdditional under the name Yandex's example uses; either token works.

Documented by the vendor. Its page has the robots.txt lines and what blocking costs.

Which of Yandex AI's crawlers can read your site?

Run the free check, or write the whole policy with the robots.txt generator.