llms.txt adoption

llms.txt is a proposed convention: a markdown file at /llms.txt that gives language models a curated index of a site's content. Proposed by Answer.AI in September 2024, it is published by site owners in the hope that AI systems read it.

14.84% publish llms.txt 4.25 million of 28.64 million domains that answered our crawl 3.49% also publish llms-full.txt 1 million domains serve the expanded companion file

Data for Aug 2026, from our monthly crawl. Every percentage divides by the base the first tile names.

Notable adopters

Ranked by Open Page Rank. The per-domain page shows each site's full AI crawler policy.

Where this standard actually stands

No major AI crawler operator has committed to reading llms.txt, and Google has said publicly that its systems do not use it, comparing it to the old keywords meta tag. Publishing one is currently a signal of intent, not a control. We count files because adoption itself is worth tracking; we make no claim that the files are being read.

Our count includes every domain that answers with a file at /llms.txt. Some of those responses are empty or boilerplate, so treat the total as an upper bound on deliberate adoption.

Counting method and definitions are on the methodology page.

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018