AI Readiness Report
shortifye.in
Restricted by Design
◆80/100
This site restricts 4 of 40 AI search and answer crawlers by choice, in robots.txt.
Access policyOpen to AI · AI search: yes · AI training: yes · stricter than written
This site appears to restrict AI crawlers on purpose — a valid choice many publishers and brands make (for example, keeping content out of AI training, or reserving it for the AI companies they have a deal with). If that’s deliberate, the site is working as intended. Read the verdict, not the number: the score still counts each blocked crawler, so a lower score is the expected result of that choice, not a failure to fix.
36
Allowed
4
Blocked
1
Fixes
Blocked crawlers
- meta-externalagentMeta AI
- PetalBotHuawei
- cohere-aiCohere
- DiffbotDiffbot
- Claude-WebAnthropic · Retired token
- anthropic-aiAnthropic · Retired token
- GoogleOtherGoogle AI · Research crawl
- Google-CloudVertexBotGoogle AI · Only for the site owner
- +4 morein the full check
Recommended fixes
- AI crawlers appear to be intentionally restricted (4 of 40 AI search and answer crawlers blocked in robots.txt)Impact · low
Your choice
Want a different policy?
Generate a robots.txt for shortifye.in that states the policy you choose: open, AI search without training, or closed.