What powers
stereonet.co.uk?
Last seen Aug 2021 · 10 technologies across 8 categories
Advertising
Analytics
Font scripts
JavaScript libraries
Retargeting
Tag managers
UI frameworks
Web servers
AI Crawlers
Blocks 16 of 33 AI crawlers we track by name in its robots.txt, restricts 11 more. Checked Sep 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- meta-externalagent Blocked
- PanguBot Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Amazonbot Blocked
- Claude-SearchBot Restricted
- DuckAssistBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
- PetalBot Restricted
- YouBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- meta-externalfetcher Restricted
- MistralAI-User Restricted
- Perplexity-User Restricted
The other 6 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not found
AI Crawlers
16 of 33 AI crawlers blocked
Standards: llms.txt
Open Page Rank
3.96 / 10 · ranked #598,777 of all domains
72 referring domains · OpenPageRank
Infrastructure
- Hosted on GOHOSTING-AS-AP GoHosting (103.11.147.125)
- DNS: gohosting.com.au
- Email: Microsoft 365
- Email security: SPF (soft fail), no DMARC record
- SSL: Let's Encrypt, RSA 2048, wildcard, expires Nov 2026
- Common Crawl link graph: rank 2,578,794, 2 hosts
- Verified with: Microsoft 365
DNS records as swept Sep 2026, certificate as seen Sep 2026. How the web is hosted