Websites blocking GoogleAgent-Mariner

The user-agent of Google's agentic browsing project Mariner, which navigates sites on behalf of a user completing a task.

Operated by Google · User-request fetcher · operator documentation

3.57% block GoogleAgent-Mariner 889K of 24.91 million domains with a known robots.txt policy 0.07% block it by name 16,302 domains, the rest inherit a blanket * block <0.01% restrict it by name 823 domains name it and close some of its paths 0.07% name it in robots.txt 17,482 domains give it rules of their own

Data for Aug 2026. All four percentages divide by the same 24.91 million domains. Blocked counts both explicit User-agent: GoogleAgent-Mariner blocks and blanket * blocks the crawler inherits.

Historical mentions, HTTP Archive

Share of sites in each month's HTTP Archive crawl whose robots.txt named GoogleAgent-Mariner. This series counts mentions only (the archive keeps no rule text), comes from a different population than our own crawl above, and the two are never merged.

High-authority sites blocking GoogleAgent-Mariner by name

Domain OPROpen Page Rank Blocking since
usatoday.com 9.08/10 Aug 2026
congress.gov 9.05/10 Aug 2026
lefigaro.fr 8.95/10 Aug 2026
amazon.it 8.78/10 Aug 2026
fedoraproject.org 8.62/10 Aug 2026
francebleu.fr 8.61/10 Aug 2026
franceculture.fr 8.58/10 Aug 2026
imageshack.us 8.54/10 Aug 2026
nzherald.co.nz 8.51/10 Aug 2026
franceinter.fr 8.50/10 Aug 2026
primevideo.com 8.45/10 Aug 2026
freep.com 8.37/10 Aug 2026
sandiegouniontribune.com 8.35/10 Aug 2026
tf1info.fr 8.35/10 Aug 2026
dispatch.com 8.23/10 Aug 2026
amazon.se 8.20/10 Aug 2026
imageshack.com 8.13/10 Aug 2026
amazon.pl 8.11/10 Aug 2026
amazon.jp 8.10/10 Aug 2026
gvsu.edu 8.08/10 Aug 2026
ebird.org 8.08/10 Aug 2026
tv2.dk 8.05/10 Aug 2026
iospress.nl 8.01/10 Aug 2026
derwesten.de 8.00/10 Aug 2026
netbsd.org 7.97/10 Aug 2026
jwz.org 7.96/10 Aug 2026
courier-journal.com 7.96/10 Aug 2026
amazon.ae 7.91/10 Aug 2026
jogtar.hu 7.91/10 Aug 2026
tu.berlin 7.87/10 Aug 2026

Sites whose robots.txt names GoogleAgent-Mariner (or a legacy alias) with a full block, ranked by Open Page Rank. Sites blocking every crawler with a blanket * rule are counted above but not listed here. Since dates start at our first observation of the rule.

Restricting some paths

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018