Websites blocking ImagesiftBot

An image-focused crawler operated by Hive that collects pictures from the web. Hive sells AI models and data services built on such collections.

Operated by Hive · Training crawler · operator documentation

4.37% block ImagesiftBot 1.08 million of 24.68 million domains with a known robots.txt policy 0.74% block it by name 182K domains, the rest inherit a blanket * block 0.02% restrict it by name 5,340 domains name it and close some of its paths 0.78% name it in robots.txt 192K domains give it rules of their own

Data for Oct 2026. All four percentages divide by the same 24.68 million domains. Blocked counts both explicit User-agent: ImagesiftBot blocks and blanket * blocks the crawler inherits.

Blocking trend

Share of domains with a known robots.txt policy blocking ImagesiftBot in each monthly crawl. The denominator moves with each crawl and is defined in the methodology.

Historical mentions, HTTP Archive

Share of sites in each month's HTTP Archive crawl whose robots.txt named ImagesiftBot. This series counts mentions only (the archive keeps no rule text), comes from a different population than our own crawl above, and the two are never merged.

High-authority sites blocking ImagesiftBot by name

Domain OPROpen Page Rank Blocking since
vimeo.com 9.54/10 Nov 2026
cloudfront.net 9.47/10 Oct 2026
nytimes.com 9.28/10 Aug 2026
tumblr.com 9.27/10 Aug 2026
yahoo.com 9.27/10 Nov 2026
cnn.com 9.16/10 Nov 2026
usatoday.com 9.08/10 Sep 2026
bandcamp.com 9.06/10 Aug 2026
msn.com 9.04/10 Nov 2026
telegraph.co.uk 9.04/10 Nov 2026
theconversation.com 8.96/10 Nov 2026
mastodon.social 8.93/10 Nov 2026
quora.com 8.92/10 Aug 2026
amazon.ca 8.91/10 Nov 2026
mashable.com 8.87/10 Sep 2026
francetvinfo.fr 8.87/10 Sep 2026
axios.com 8.86/10 Nov 2026
thehill.com 8.83/10 Nov 2026
gizmodo.com 8.82/10 Aug 2026
radiofrance.fr 8.82/10 Aug 2026
wikihow.com 8.81/10 Aug 2026
venturebeat.com 8.80/10 Aug 2026
nzz.ch 8.74/10 Nov 2026
verywellmind.com 8.72/10 Aug 2026
metro.co.uk 8.72/10 Aug 2026
repubblica.it 8.71/10 Nov 2026
people.com 8.70/10 Aug 2026
rtve.es 8.68/10 Oct 2026
newscientist.com 8.65/10 Nov 2026
gamblingtherapy.org 8.64/10 Oct 2026

Sites whose robots.txt names ImagesiftBot (or a legacy alias) with a full block, ranked by Open Page Rank. Sites blocking every crawler with a blanket * rule are counted above but not listed here. Since dates start at our first observation of the rule.

Restricting some paths

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018