Websites blocking ChatGPT-User

The user-agent ChatGPT uses when it fetches a page on behalf of a user, for example to answer a question about a link. It acts on direct user requests rather than crawling on a schedule.

Operated by OpenAI · User-request fetcher · operator documentation

3.96% block ChatGPT-User 987K of 24.91 million domains with a known robots.txt policy 0.64% block it by name 161K domains, the rest inherit a blanket * block 0.48% restrict it by name 119K domains name it and close some of its paths 1.81% name it in robots.txt 451K domains give it rules of their own

Data for Aug 2026. All four percentages divide by the same 24.91 million domains. Blocked counts both explicit User-agent: ChatGPT-User blocks and blanket * blocks the crawler inherits.

Historical mentions, HTTP Archive

Share of sites in each month's HTTP Archive crawl whose robots.txt named ChatGPT-User. This series counts mentions only (the archive keeps no rule text), comes from a different population than our own crawl above, and the two are never merged.

High-authority sites blocking ChatGPT-User by name

Domain OPROpen Page Rank Blocking since
linkedin.com 9.82/10 Aug 2026
nytimes.com 9.28/10 Aug 2026
sagepub.com 9.07/10 Aug 2026
lnkd.in 9.05/10 Aug 2026
congress.gov 9.05/10 Aug 2026
msn.com 9.04/10 Aug 2026
cambridge.org 9.04/10 Aug 2026
abc.net.au 9.04/10 Aug 2026
science.org 8.95/10 Aug 2026
lefigaro.fr 8.95/10 Aug 2026
usgs.gov 8.95/10 Aug 2026
quora.com 8.92/10 Aug 2026
huffpost.com 8.91/10 Aug 2026
claude.ai 8.87/10 Aug 2026
mashable.com 8.87/10 Aug 2026
francetvinfo.fr 8.87/10 Aug 2026
smh.com.au 8.86/10 Aug 2026
thelancet.com 8.85/10 Aug 2026
wikihow.com 8.81/10 Aug 2026
aljazeera.com 8.81/10 Aug 2026
pcmag.com 8.80/10 Aug 2026
technologyreview.com 8.78/10 Aug 2026
amazon.it 8.78/10 Aug 2026
hotpepper.jp 8.76/10 Aug 2026
ucl.ac.uk 8.74/10 Aug 2026
rfi.fr 8.73/10 Aug 2026
metro.co.uk 8.72/10 Aug 2026
ctvnews.ca 8.72/10 Aug 2026
yomiuri.co.jp 8.69/10 Aug 2026
france24.com 8.68/10 Aug 2026

Sites whose robots.txt names ChatGPT-User (or a legacy alias) with a full block, ranked by Open Page Rank. Sites blocking every crawler with a blanket * rule are counted above but not listed here. Since dates start at our first observation of the rule.

Restricting some paths

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018