What powers guardian.co.uk?
Last seen Nov 2021 · 17 technologies across 11 categories
Advertising Networks
Analytics
comScore
since May 2017
Google Analytics
since Jun 2018
Cache Tools
Varnish
since Jun 2018
CDN
Amazon CloudFront
since Oct 2021
JavaScript libraries
Load balancers
Amazon ALB
since Oct 2021
Miscellaneous
PaaS
Amazon Web Services
since Oct 2021
Security
reCAPTCHA
since Oct 2021
Tag managers
Google Tag Manager
since Jun 2018
Widgets
AI Crawlers
Blocks 14 of 33 AI crawlers we track by name in its robots.txt. Checked Sep 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- FacebookBot Blocked
- Google-CloudVertexBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
- Claude-SearchBot Blocked
- DuckAssistBot Blocked
- PerplexityBot Blocked
- PetalBot Blocked
- YouBot Blocked
User-request fetchers
- Claude-User Blocked
The other 19 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
- Aug 2026 perplexitybot added to robots.txt
- Aug 2026 petalbot added to robots.txt
- Aug 2026 amazonbot added to robots.txt
- Aug 2026 applebot-extended added to robots.txt
- Aug 2026 google-cloudvertexbot added to robots.txt
- Aug 2026 anthropic-ai added to robots.txt
AI Crawlers
14 of 33 AI crawlers blocked
Open Page Rank
8.77 / 10 · ranked #881 of all domains
23,165 referring domains · OpenPageRank
Organisation
- Guardian Monthly
- Founded: 2006
From Wikidata (CC0).
Infrastructure
- Registered Jun 1995 (31 years) via GoDaddy.com, LLC., renews Jun 2027
- Hosted on Fastly (151.101.1.111)
- Email: Google Workspace
- Email security: SPF (hard fail), DMARC reject
- SSL: GlobalSign, RSA 2048, wildcard, expires Mar 2027
- Common Crawl link graph: rank 5,543, 112 hosts
- Verified with: Adobe, Amazon SES, Apple Business, Atlassian, Cisco, DocuSign, GlobalSign, Google and 1 more
DNS records as swept Sep 2026, certificate as seen Sep 2026, registration from the registry's RDAP service. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| www.guardian.co.uk | 10 |
| jobs.guardian.co.uk | 9 |