Websites blocking MistralAI-User

The user-agent Mistral's Le Chat assistant uses when it fetches a page to answer a user's question about it.

Operated by Mistral AI · User-request fetcher · operator documentation

3.93% block MistralAI-User 970K of 24.68 million domains with a known robots.txt policy 0.10% block it by name 23,540 domains, the rest inherit a blanket * block 0.08% restrict it by name 20,469 domains name it and close some of its paths 0.26% name it in robots.txt 63,516 domains give it rules of their own

Data for Oct 2026. All four percentages divide by the same 24.68 million domains. Blocked counts both explicit User-agent: MistralAI-User blocks and blanket * blocks the crawler inherits.

Blocking trend

Share of domains with a known robots.txt policy blocking MistralAI-User in each monthly crawl. The denominator moves with each crawl and is defined in the methodology.

Historical mentions, HTTP Archive

Share of sites in each month's HTTP Archive crawl whose robots.txt named MistralAI-User. This series counts mentions only (the archive keeps no rule text), comes from a different population than our own crawl above, and the two are never merged.

High-authority sites blocking MistralAI-User by name

Domain OPROpen Page Rank Blocking since
cnn.com 9.16/10 Oct 2026
amazon.co.jp 9.16/10 Sep 2026
amazon.de 9.13/10 Oct 2026
usatoday.com 9.08/10 Sep 2026
wired.com 9.07/10 Oct 2026
fastcompany.com 9.00/10 Oct 2026
uol.com.br 8.92/10 Oct 2026
newyorker.com 8.90/10 Oct 2026
mashable.com 8.87/10 Sep 2026
francetvinfo.fr 8.87/10 Aug 2026
arstechnica.com 8.84/10 Aug 2026
radiofrance.fr 8.82/10 Aug 2026
wikihow.com 8.81/10 Aug 2026
pcmag.com 8.80/10 Aug 2026
welt.de 8.78/10 Oct 2026
epfl.ch 8.74/10 Oct 2026
rfi.fr 8.73/10 Aug 2026
verywellmind.com 8.72/10 Aug 2026
metro.co.uk 8.72/10 Aug 2026
people.com 8.70/10 Aug 2026
bild.de 8.70/10 Oct 2026
vanityfair.com 8.64/10 Oct 2026
francebleu.fr 8.61/10 Aug 2026
videolan.org 8.60/10 Oct 2026
verywellhealth.com 8.59/10 Aug 2026
hackernoon.com 8.58/10 Oct 2026
thespruce.com 8.58/10 Aug 2026
franceculture.fr 8.58/10 Aug 2026
thoughtco.com 8.55/10 Aug 2026
france.tv 8.54/10 Aug 2026

Sites whose robots.txt names MistralAI-User (or a legacy alias) with a full block, ranked by Open Page Rank. Sites blocking every crawler with a blanket * rule are counted above but not listed here. Since dates start at our first observation of the rule.

Restricting some paths

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018