What powers spad.uk?
Last seen Sep 2026 · 8 technologies across 6 categories
Analytics
Plausible
since Jun 2024
Caching
Varnish
since Mar 2024
CDN
Cloudflare
since Mar 2024
Fastly
since Mar 2024
Miscellaneous
Open Graph
since Mar 2024
RSS
since Mar 2024
PaaS
GitHub Pages
since Mar 2024
Static site generator
AI Crawlers
Blocks 32 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GoogleOther Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- img2dataset Blocked
- meta-externalagent Blocked
- PanguBot Blocked
- SBIntuitionsBot Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Amazonbot Blocked
- Applebot Blocked
- Claude-SearchBot Blocked
- DuckAssistBot Blocked
- OAI-SearchBot Blocked
- PerplexityBot Blocked
- PetalBot Blocked
- YouBot Blocked
User-request fetchers
- ChatGPT-User Blocked
- Claude-User Blocked
- GoogleAgent-Mariner Blocked
- meta-externalfetcher Blocked
- MistralAI-User Blocked
- Perplexity-User Blocked
The other 1 AI crawler we track is not mentioned and stays allowed by default.
- robots.txt found
- llms.txt not found
- ai.txt not found
AI Crawlers
32 of 33 AI crawlers blocked
Open Page Rank
1.77 / 10 · ranked #4,503,509 of all domains
8 referring domains · OpenPageRank
Infrastructure
- Hosted on Fastly (185.199.108.153, IPv6)
- DNS: Cloudflare DNS
- Email: no MX record returned
- Email security: SPF (hard fail), DMARC reject, CAA
- SSL: Let's Encrypt, RSA 2048, expires Nov 2026
- Common Crawl link graph: rank 9,483,368, 2 hosts
- Verified with: Google
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted