What powers
openlit.io?
Last seen Aug 2026 · 25 technologies across 11 categories
Analytics
CDN
Ecommerce
JavaScript frameworks
JavaScript graphics
Miscellaneous
PaaS
Performance
Programming languages
Security
UI frameworks
AI Crawlers
Restricts 12 of 33 AI crawlers we track by name in its robots.txt. Checked Nov 2026.
Training crawlers
- Applebot-Extended Restricted
- CCBot Restricted
- ClaudeBot Restricted
- Google-Extended Restricted
- GPTBot Restricted
- meta-externalagent Restricted
Search and AI assistants
- Claude-SearchBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- Perplexity-User Restricted
The other 21 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- llms-full.txt found
- ai.txt not found
- Oct 2026 mistralai-user removed from robots.txt
- Oct 2026 chatgpt-user: Restricted (was Allowed)
- Oct 2026 claude-searchbot: Restricted (was Allowed)
- Oct 2026 claude-user: Restricted (was Allowed)
- Oct 2026 ccbot: Restricted (was Allowed)
- Oct 2026 amazonbot removed from robots.txt
AI Crawlers
12 of 33 AI crawlers restricted
Standards: llms.txt, llms-full.txt
Open Page Rank
4.72 / 10 · ranked #295,847 of all domains
59 referring domains · OpenPageRank
Infrastructure
- Hosted on Cloudflare (104.21.12.99, IPv6)
- Email: Zoho Mail
- Email security: SPF (soft fail), no DMARC record, CAA
- SSL: Google Trust Services, ECDSA P256, expires Jan 2027
- Common Crawl link graph: rank 715,538, 2 hosts
- Verified with: Google, Zoho
DNS records as swept Nov 2026, certificate as seen Nov 2026. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| openlit.io | 22 |
| docs.openlit.io | 16 |
Full technology history →
Report an incorrect detection