AI crawlers · DuckDuckGo AI · AI search index · Counted in the score

DuckAssistBot

Crawls pages in real time for DuckDuckGo's AI-assisted answers, which cite their sources. DuckDuckGo says the data is not used in any way to train AI models.

Where this comes from

  • Documented by the vendor. Source: duckduckgo.com
  • Honours robots.txt.
  • Counted in the readiness score. It can keep a site out of AI search or answers, so a block costs points.

In the top 1,000 websites

What blocking it costs

Your pages leave the search index DuckAssistBot builds, so DuckDuckGo AI's product can no longer find or cite them from its own index. The score counts it among the crawlers that feed AI search and answers, so a block costs points.

The robots.txt lines

To let it in (a group that names the crawler replaces any wildcard rules for it, so this also lifts a User-agent: * block):

User-agent: DuckAssistBot
Allow: /

To keep it out:

User-agent: DuckAssistBot
Disallow: /

A rule in robots.txt is a request. DuckDuckGo AI says this crawler honours it. The robots.txt generator writes a whole file with the same split: block the training crawlers, keep the search and answer crawlers.

Does DuckAssistBot get through on your site?

Run the free check: it reads your robots.txt against all 51 crawlers and tells you which ones can read you, and what to change.