Websites blocking ChatGPT-User

The user-agent ChatGPT uses when it fetches a page on behalf of a user, for example to answer a question about a link. It acts on direct user requests rather than crawling on a schedule.

Operated by OpenAI · User-request fetcher · operator documentation

4.35% block ChatGPT-User 1.07 million of 24.68 million domains with a known robots.txt policy 0.80% block it by name 197K domains, the rest inherit a blanket * block 0.67% restrict it by name 165K domains name it and close some of its paths 2.33% name it in robots.txt 575K domains give it rules of their own

Data for Oct 2026. All four percentages divide by the same 24.68 million domains. Blocked counts both explicit User-agent: ChatGPT-User blocks and blanket * blocks the crawler inherits.

Blocking trend

Share of domains with a known robots.txt policy blocking ChatGPT-User in each monthly crawl. The denominator moves with each crawl and is defined in the methodology.

Historical mentions, HTTP Archive

Share of sites in each month's HTTP Archive crawl whose robots.txt named ChatGPT-User. This series counts mentions only (the archive keeps no rule text), comes from a different population than our own crawl above, and the two are never merged.

High-authority sites blocking ChatGPT-User by name

Domain OPROpen Page Rank Blocking since
linkedin.com 9.82/10 Aug 2026
cloudfront.net 9.47/10 Oct 2026
nytimes.com 9.28/10 Aug 2026
yahoo.com 9.27/10 Nov 2026
ca.gov 9.23/10 Nov 2026
bbc.co.uk 9.18/10 Nov 2026
cnn.com 9.16/10 Nov 2026
npr.org 9.16/10 Nov 2026
techcrunch.com 9.09/10 Nov 2026
lnkd.in 9.05/10 Aug 2026
msn.com 9.04/10 Nov 2026
telegraph.co.uk 9.04/10 Nov 2026
justice.gov 9.04/10 Nov 2026
nhk.or.jp 8.98/10 Aug 2026
hotjar.com 8.96/10 Nov 2026
theconversation.com 8.96/10 Nov 2026
quora.com 8.92/10 Aug 2026
ovhcloud.com 8.91/10 Nov 2026
huffpost.com 8.91/10 Aug 2026
amazon.ca 8.91/10 Nov 2026
ssrn.com 8.88/10 Nov 2026
claude.ai 8.87/10 Sep 2026
mashable.com 8.87/10 Sep 2026
francetvinfo.fr 8.87/10 Aug 2026
moz.com 8.83/10 Nov 2026
thehill.com 8.83/10 Nov 2026
radiofrance.fr 8.82/10 Aug 2026
wikihow.com 8.81/10 Aug 2026
aljazeera.com 8.81/10 Oct 2026
metro.co.uk 8.72/10 Aug 2026

Sites whose robots.txt names ChatGPT-User (or a legacy alias) with a full block, ranked by Open Page Rank. Sites blocking every crawler with a blanket * rule are counted above but not listed here. Since dates start at our first observation of the rule.

Restricting some paths

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018