What powers crowdpickreviews.com?
Last seen Aug 2026 · 14 technologies across 10 categories
Advertising
Analytics
Blogs
CDN
Font scripts
JavaScript libraries
Miscellaneous
Programming languages
Security
Web servers
AI Crawlers
Blocks 11 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
- PanguBot Blocked
The other 22 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
AI Crawlers
11 of 33 AI crawlers blocked
Search traffic
1 est. monthly organic visits (US)
3 keywords in Google's top 30
Infrastructure
- Hosted on Google (216.239.32.21)
- DNS: Spaceship
- Email: no MX record returned
- Email security: DNSSEC signed
- SSL: Google Trust Services, RSA 2048, expires Dec 2026
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted
Full technology history →
Report an incorrect detection
Recent changes
- dropped Helix Ultimate Mar 2026
- dropped Joomla Mar 2026
- dropped PHP Mar 2026
- detected Blogger Feb 2026
- detected cdnjs Feb 2026
- detected Cloudflare Feb 2026
- detected Font Awesome Feb 2026
- detected jQuery Feb 2026
- detected Python Feb 2026