What powers
karafka.io?
Last seen Sep 2026 · 12 technologies across 8 categories
Analytics
CDN
Font scripts
JavaScript libraries
Miscellaneous
Security
UI frameworks
Web servers
AI Crawlers
Restricts 10 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- AI2Bot Restricted
- Bytespider Restricted
- CCBot Restricted
- cohere-training-data-crawler Restricted
- Diffbot Restricted
- FacebookBot Restricted
- Google-Extended Restricted
- GPTBot Restricted
- meta-externalagent Restricted
- Applebot-Extended Allowed
- ClaudeBot Allowed
Search and AI assistants
- Amazonbot Restricted
- PerplexityBot Allowed
- YouBot Allowed
User-request fetchers
- ChatGPT-User Allowed
The other 18 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt found
AI Crawlers
10 of 33 AI crawlers restricted
Standards: llms.txt, ai.txt
Open Page Rank
3.64 / 10 · ranked #791,770 of all domains
18 referring domains · OpenPageRank
Page
- Language: English
- CDN: Cloudflare
- Weight: 0.9 MB · 51 requests
Homepage as crawled by the HTTP Archive, Sep 2026.
Infrastructure
- Hosted on Cloudflare (104.21.18.253, IPv6)
- DNS: Cloudflare DNS
- Email: Proton Mail
- Email security: SPF (hard fail), DMARC reject
- SSL: Google Trust Services, ECDSA P256, wildcard, expires Nov 2026
- Common Crawl link graph: rank 2,104,383, 3 hosts
- Verified with: Google, Proton
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted