Websites blocking ImagesiftBot

An image-focused crawler operated by Hive that collects pictures from the web. Hive sells AI models and data services built on such collections.

Operated by Hive · Training crawler · operator documentation

3.96% block ImagesiftBot 987K of 24.91 million domains with a known robots.txt policy 0.56% block it by name 139K domains, the rest inherit a blanket * block 0.10% restrict it by name 23,726 domains name it and close some of its paths 0.67% name it in robots.txt 167K domains give it rules of their own

Data for Aug 2026. All four percentages divide by the same 24.91 million domains. Blocked counts both explicit User-agent: ImagesiftBot blocks and blanket * blocks the crawler inherits.

Historical mentions, HTTP Archive

Share of sites in each month's HTTP Archive crawl whose robots.txt named ImagesiftBot. This series counts mentions only (the archive keeps no rule text), comes from a different population than our own crawl above, and the two are never merged.

High-authority sites blocking ImagesiftBot by name

Domain OPROpen Page Rank Blocking since
vimeo.com 9.54/10 Aug 2026
nytimes.com 9.28/10 Aug 2026
tumblr.com 9.27/10 Aug 2026
usatoday.com 9.08/10 Aug 2026
bandcamp.com 9.06/10 Aug 2026
congress.gov 9.05/10 Aug 2026
msn.com 9.04/10 Aug 2026
investopedia.com 9.01/10 Aug 2026
quora.com 8.92/10 Aug 2026
mashable.com 8.87/10 Aug 2026
smh.com.au 8.86/10 Aug 2026
gizmodo.com 8.82/10 Aug 2026
wikihow.com 8.81/10 Aug 2026
venturebeat.com 8.80/10 Aug 2026
pcmag.com 8.80/10 Aug 2026
technologyreview.com 8.78/10 Aug 2026
amazon.it 8.78/10 Aug 2026
fliphtml5.com 8.75/10 Aug 2026
verywellmind.com 8.72/10 Aug 2026
metro.co.uk 8.72/10 Aug 2026
repubblica.it 8.71/10 Aug 2026
people.com 8.70/10 Aug 2026
idnes.cz 8.70/10 Aug 2026
nos.nl 8.67/10 Aug 2026
technorati.com 8.63/10 Aug 2026
launchpad.net 8.63/10 Aug 2026
computerworld.com 8.63/10 Aug 2026
vermont.gov 8.63/10 Aug 2026
fedoraproject.org 8.62/10 Aug 2026
eurekalert.org 8.62/10 Aug 2026

Sites whose robots.txt names ImagesiftBot (or a legacy alias) with a full block, ranked by Open Page Rank. Sites blocking every crawler with a blanket * rule are counted above but not listed here. Since dates start at our first observation of the rule.

Restricting some paths

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018