MistralAI-Training
Crawls web content to build the datasets that train Mistral's generative models; not used for search or live answers. Mistral says a robots.txt disallow keeps a site out.
Where this comes from
- Documented by the vendor. Source: docs.mistral.ai
- Honours robots.txt.
- Listed, not scored. It cannot keep a site out of today's answers, so the check shows a block without deducting for it.
In the top 1,000 websites
Not measured in the October 2026 study of the top 1,000 websites.
What blocking it costs
Nothing in today's answers, and nothing in the readiness score: MistralAI-Training only gathers training data, so blocking it is a policy choice about future models, not about being found. The check lists the block without deducting for it.
The robots.txt lines
To let it in (a group that names the crawler replaces any wildcard rules for it, so this also lifts a User-agent: * block):
User-agent: MistralAI-Training
Allow: /To keep it out:
User-agent: MistralAI-Training
Disallow: /A rule in robots.txt is a request. Mistral says this crawler honours it. The robots.txt generator writes a whole file with the same split: block the training crawlers, keep the search and answer crawlers.
Also from Mistral
MistralAI-User· Fetches when a user asksMistralAI-Index· AI search index
Does MistralAI-Training get through on your site?
Run the free check: it reads your robots.txt against all 60 crawlers and tells you which ones can read you, and what to change.