What powers paulroberts.jp?
Last seen Oct 2026 · 24 technologies across 15 categories
Analytics
CDN
CMS
Databases
JavaScript libraries
Marketing automation
Miscellaneous
Page builders
Performance
Programming languages
Security
Tag managers
Webmail
WordPress plugins
WordPress themes
AI Crawlers
Blocks 10 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Applebot Allowed
- Claude-SearchBot Allowed
- OAI-SearchBot Allowed
- PerplexityBot Allowed
User-request fetchers
- ChatGPT-User Allowed
- Claude-User Allowed
The other 17 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt not found
- ai.txt not found
- Sep 2026 applebot added to robots.txt
- Sep 2026 chatgpt-user added to robots.txt
- Sep 2026 perplexitybot: Allowed (was Blocked)
- Sep 2026 claude-user added to robots.txt
- Sep 2026 amazonbot removed from robots.txt
- Sep 2026 oai-searchbot added to robots.txt
AI Crawlers
10 of 33 AI crawlers blocked
Open Page Rank
1.80 / 10 · ranked #4,371,161 of all domains
6 referring domains · OpenPageRank
Page
- Language: English (United Kingdom)
- CDN: Cloudflare
- Weight: 0.8 MB · 66 requests
- WordPress theme: generatepress · all themes
- Structured data: JSON-LD, Microdata, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Oct 2026.
Organisation
From the homepage's own structured data (Oct 2026).
Infrastructure
- Hosted on Cloudflare (104.21.26.29, IPv6)
- DNS: Cloudflare DNS
- Email: Proton Mail
- Email security: SPF (soft fail), no DMARC record, CAA
- SSL: Google Trust Services, ECDSA P256, wildcard, expires Jan 2027
- Common Crawl link graph: rank 29,503,313
- Verified with: Brave Creators, Google, Proton
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted
Full technology history →
Report an incorrect detection
Recent changes
- detected Cloudflare Browser Insights Sep 2026
- dropped AlmaLinux Apr 2026
- dropped Apache HTTP Server Apr 2026
- dropped WordPress Super Cache Apr 2026
- detected Autoptimize Mar 2026
- detected Cloudflare Zaraz Mar 2026
- detected DataTables Mar 2026
- detected HSTS Mar 2026
- detected HTTP/3 Mar 2026
- detected Proton Mail Mar 2026