What powers headlessdomains.com?
Last seen May 2026 · 9 technologies across 7 categories
Analytics
CDN
CRM
Font scripts
Miscellaneous
Tag managers
UI frameworks
AI Crawlers
Blocks 4 of 33 AI crawlers we track by name in its robots.txt, restricts 5 more. Checked Sep 2026.
Training crawlers
- Bytespider Blocked
- CCBot Blocked
- FacebookBot Blocked
- Webzio-Extended Blocked
- ClaudeBot Restricted
- Google-Extended Restricted
- GPTBot Restricted
Search and AI assistants
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
The other 24 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- llms-full.txt found
- ai.txt not found
- Aug 2026 chatgpt-user: Restricted (was Allowed)
- Aug 2026 perplexitybot: Restricted (was Allowed)
- Aug 2026 gptbot: Restricted (was Allowed)
- Aug 2026 claudebot: Restricted (was Allowed)
- Aug 2026 claude-web: Restricted (was Allowed)
- Aug 2026 google-extended: Restricted (was Allowed)
AI Crawlers
4 of 33 AI crawlers blocked
Standards: llms.txt, llms-full.txt
Open Page Rank
3.42 / 10 · ranked #986,931 of all domains
131 referring domains · OpenPageRank
Infrastructure
- Hosted on RAILWAY (69.46.46.53)
- DNS: Cloudflare DNS
- Email: Zoho Mail
- Email security: SPF (soft fail), DMARC monitor only
- SSL: Let's Encrypt, RSA 2048, expires Dec 2026
- Common Crawl link graph: rank 15,226,848, 6 hosts
- Verified with: Google, Zoho
DNS records as swept Sep 2026, certificate as seen Sep 2026. How the web is hosted