What powers astralith.net?
Last seen Sep 2026 · 7 technologies across 5 categories
Analytics
Cloudflare Browser Insights
since Nov 2025
CDN
Cloudflare
since Nov 2025
Documentation
Obsidian Publish
since Nov 2025
JavaScript graphics
PIXIjs
since Nov 2025
Miscellaneous
AI Crawlers
Blocks 13 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GoogleOther Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
- PetalBot Blocked
The other 20 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt not checked
- ai.txt not checked
Content Signals:
search=yes ai-train=no declared in robots.txt
- Oct 2026 claude-web added to robots.txt
- Oct 2026 petalbot added to robots.txt
- Oct 2026 googleother added to robots.txt
- Oct 2026 diffbot added to robots.txt
- Oct 2026 cohere-ai added to robots.txt
- Oct 2026 google-cloudvertexbot added to robots.txt
Infrastructure
- Hosted on Cloudflare (104.21.1.127, IPv6)
- DNS: Cloudflare DNS
- Email: no MX record returned
- Email security: SPF (hard fail), DMARC reject
- SSL: Google Trust Services, ECDSA P256, expires Dec 2026
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| astralith.net | 7 |
| wiki.astralith.net | 7 |