What powers theregister.co.uk?
Last seen Feb 2021 · 14 technologies across 13 categories
Advertising
Google AdSense
since Jun 2018
Google Publisher Tag
since Feb 2021
Advertising Networks
DoubleClick for Publishers (DFP)
since Apr 2018
Analytics
Google Analytics
since Jun 2018
CDN
Cloudflare
since Apr 2018
Font Scripts
Google Font API
since Apr 2018
JavaScript libraries
Miscellaneous
SWFObject
since Aug 2018
Operating systems
Debian
since Aug 2018
Programming languages
Security
reCAPTCHA
since Oct 2018
Tag managers
Google Tag Manager
since Jun 2018
Web server extensions
Web servers
AI Crawlers
Blocks 18 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- meta-externalagent Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Amazonbot Blocked
- DuckAssistBot Blocked
- YouBot Blocked
- Applebot Allowed
- Claude-SearchBot Allowed
- OAI-SearchBot Allowed
- PerplexityBot Allowed
User-request fetchers
- meta-externalfetcher Blocked
- ChatGPT-User Allowed
- Claude-User Allowed
The other 9 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not checked
- ai.txt not checked
Subdomains
| Host | Techs |
|---|---|
| whitepapers.theregister.co.uk | 8 |
| m.forums.theregister.co.uk | 7 |
| m.theregister.co.uk | 7 |
| www.theregister.co.uk | 6 |
| forums.theregister.co.uk | 5 |
| search.theregister.co.uk | 5 |
| account.theregister.co.uk | 4 |