What powers astroe.io?
Last seen Oct 2026 · 25 technologies across 14 categories
Advertising
Analytics
Authentication
CDN
Databases
Font scripts
JavaScript frameworks
JavaScript graphics
JavaScript libraries
Miscellaneous
Programming languages
Security
Tag managers
Widgets
AI Crawlers
Restricts 13 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- Applebot-Extended Restricted
- Bytespider Restricted
- CCBot Restricted
- ClaudeBot Restricted
- Google-Extended Restricted
- GPTBot Restricted
- meta-externalagent Restricted
Search and AI assistants
- Claude-SearchBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- Perplexity-User Restricted
The other 20 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not found
Content Signals:
search=yes ai-input=yes declared in robots.txt
AI Crawlers
13 of 33 AI crawlers restricted
Standards: llms.txt, Content Signals
Open Page Rank
1.61 / 10 · ranked #5,617,480 of all domains
10 referring domains · OpenPageRank
Page
- Language: English
- CDN: Cloudflare
- Weight: 1.4 MB · 32 requests
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Oct 2026.
Organisation
- Industry: Games (declares
VideoGame)
From the homepage's own structured data (Oct 2026).
Infrastructure
- Hosted on Cloudflare (104.21.77.162, IPv6)
- DNS: Cloudflare DNS
- Email: Namecheap
- Email security: SPF (soft fail), no DMARC record
- SSL: Google Trust Services, ECDSA P256, wildcard, expires Dec 2026
- Common Crawl link graph: rank 42,301,957, 4 hosts
- Verified with: Google
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted