What powers aperobotics.io?
Last seen Aug 2026 · 8 technologies across 7 categories
Analytics
Caching
CDN
JavaScript graphics
Miscellaneous
PaaS
Rich text editors
AI Crawlers
Blocks 8 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026. A recent check saw a policy file missing; awaiting confirmation.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
The other 25 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt not found
- ai.txt not found
Content Signals:
search=yes ai-train=no declared in robots.txt
Page
- CDN: Cloudflare, Fastly
- Weight: 3.5 MB · 17 requests
Homepage as crawled by the HTTP Archive, Nov 2026.
Infrastructure
- Hosted on Cloudflare (104.21.83.238, IPv6)
- DNS: Cloudflare DNS
- Email: no MX record returned
- SSL: Google Trust Services, ECDSA P256, expires Nov 2026
- Common Crawl link graph: rank 27,438,095
- Verified with: Google
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted