ai.txt adoption
ai.txt is a permissions file at /ai.txt, proposed by Spawning as
a way for sites to declare whether their content may be used for AI training. It predates most
robots.txt AI-crawler tokens and remains a niche convention.
Data for Aug 2026, from our monthly crawl. Every percentage divides by the base the first tile names.
Notable adopters
- amazon.fr 9.0
- amazon-adsystem.com 9.0
- shopifycloud.com 8.8
- tn.gov 8.7
- shields.io 8.7
- unwomen.org 8.7
- visualwebsiteoptimizer.com 8.7
- irishtimes.com 8.7
- snopes.com 8.6
- uio.no 8.6
- vwo.com 8.5
- doe.gov 8.4
- malwarebytes.com 8.4
- maxcdn.com 8.4
- wellsfargo.com 8.3
- bitdefender.com 8.3
- saarland.de 8.3
- sina.cn 8.3
- snl.no 8.3
- lazada.co.th 8.3
- globaltimes.cn 8.3
- liadm.com 8.2
- tvtropes.org 8.2
- gsk.com 8.2
Ranked by Open Page Rank. The per-domain page shows each site's full AI crawler policy.
Where this standard actually stands
ai.txt never reached broad adoption and most AI crawler operators do not document reading it. The robots.txt tokens on the AI Crawlers page are where the real policy action is; we track ai.txt because the files still exist and some tools still write them.
Counting method and definitions are on the methodology page.