What powers karafka.io?

Last seen Sep 2026 · 12 technologies across 8 categories

Analytics

CDN

cdnjs
since Nov 2022
Cloudflare
since Nov 2022

Font scripts

Font Awesome
since Nov 2022
Google Font API
since Nov 2022

JavaScript libraries

Highlight.js
since Nov 2022
Tiny Slider
since Nov 2022

Miscellaneous

HTTP/3
since Sep 2026
Popper
since Nov 2022

Security

HSTS
since Sep 2026

UI frameworks

Bootstrap
since Nov 2022

Web servers

Apache HTTP Server v2.4
since Nov 2022

AI Crawlers

Restricts 10 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.

Training crawlers

  • AI2Bot Restricted
  • Bytespider Restricted
  • CCBot Restricted
  • cohere-training-data-crawler Restricted
  • Diffbot Restricted
  • FacebookBot Restricted
  • Google-Extended Restricted
  • GPTBot Restricted
  • meta-externalagent Restricted
  • Applebot-Extended Allowed
  • ClaudeBot Allowed

Search and AI assistants

  • Amazonbot Restricted
  • PerplexityBot Allowed
  • YouBot Allowed

User-request fetchers

  • ChatGPT-User Allowed

The other 18 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.

See who blocks each AI crawler across the web

AI Crawlers

10 of 33 AI crawlers restricted

Standards: llms.txt, ai.txt

Full breakdown

Open Page Rank

3.64 / 10 · ranked #791,770 of all domains

18 referring domains · OpenPageRank

Page

  • Language: English
  • CDN: Cloudflare
  • Weight: 0.9 MB · 51 requests

Homepage as crawled by the HTTP Archive, Sep 2026.

Infrastructure

DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted

Full technology history →
Report an incorrect detection

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018