AI Readiness Report
blog.delishahk.com
Restricted by Design
◆75/100
This site restricts most AI crawlers by choice — 6 of 35 AI search and answer crawlers are blocked in robots.txt.
This site appears to intentionally restrict AI crawler access — a valid strategy many publishers and brands choose (for example, keeping content out of AI training). If that’s deliberate, the site is working as intended: the score below measures how open a site is to AI, so a low number here is the expected result of that choice — not a failure to fix.
29
Allowed
6
Blocked
3
Fixes
Blocked crawlers
- Google-ExtendedGoogle AI
- meta-externalagentMeta AI
- AmazonbotAmazon
- PetalBotHuawei
- cohere-aiCohere
- DiffbotDiffbot
- GPTBotOpenAI · Training only
- ClaudeBotAnthropic · Training only
Recommended fixes
- AI crawlers appear to be intentionally restricted (6 of 35 AI search and answer crawlers blocked in robots.txt)Impact · low
- Your homepage returned HTTP 403 to our crawler — homepage checks were skippedImpact · info
- No Sitemap directive in robots.txtImpact · low
Optional extra
Your site has no llms.txt file
A Markdown summary of blog.delishahk.com for AI systems. Not scored, since few AI crawlers ask for it yet, but quick to add.
Quick fix available
6 AI crawlers blocked by robots.txt
Generate an AI-crawler-aware robots.txt for blog.delishahk.com — pick a preset, download the file.