What powers safianov.com?
Last seen Sep 2026 · 8 technologies across 8 categories
Caching
Varnish
since Sep 2026
JavaScript libraries
Lightbox
since Sep 2026
Miscellaneous
Open Graph
since Sep 2026
Operating systems
Ubuntu
since Sep 2026
Programming languages
Python
since Sep 2026
Security
HSTS
since Sep 2026
Web frameworks
Django
since Sep 2026
Web servers
AI Crawlers
Restricts 20 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- Applebot-Extended Restricted
- Bytespider Restricted
- CCBot Restricted
- ClaudeBot Restricted
- cohere-training-data-crawler Restricted
- Google-Extended Restricted
- GPTBot Restricted
- meta-externalagent Restricted
Search and AI assistants
- Amazonbot Restricted
- Applebot Restricted
- Claude-SearchBot Restricted
- DuckAssistBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
- YouBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- meta-externalfetcher Restricted
- MistralAI-User Restricted
- Perplexity-User Restricted
The other 13 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- llms-full.txt found
- ai.txt not found
Infrastructure
- Hosted on Fastly (151.101.1.242)
- DNS: Network Solutions
- Email: no MX record returned
- SSL: Certainly, RSA 2048, expires Nov 2026
- Common Crawl link graph: rank 17,626,806
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted