What powers aircompdx.com?

Last seen Aug 2026 · 14 technologies across 9 categories

Analytics

Google Analytics
since Jul 2026
Tinybird
since Jul 2026

CDN

Cloudflare
since Jul 2026

Font scripts

Google Font API
since Jul 2026

JavaScript frameworks

TanStack Start
since Aug 2026

Miscellaneous

Open Graph
since Jul 2026
PWA
since Jul 2026

Payment processors

Stripe vdahlia
since Jul 2026

Performance

Priority Hints
since Jul 2026

Security

Cloudflare Bot Management
since Jul 2026
HSTS
since Jul 2026

UI frameworks

Radix UI
since Jul 2026
shadcn/ui
since Jul 2026
Tailwind CSS
since Jul 2026

AI Crawlers

Restricts 13 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.

Training crawlers

  • Applebot-Extended Restricted
  • CCBot Restricted
  • ClaudeBot Restricted
  • FacebookBot Restricted
  • Google-Extended Restricted
  • GPTBot Restricted
  • meta-externalagent Restricted
  • cohere-training-data-crawler Allowed
  • Diffbot Allowed

Search and AI assistants

  • Applebot Restricted
  • DuckAssistBot Restricted
  • OAI-SearchBot Restricted
  • PerplexityBot Restricted
  • Amazonbot Allowed
  • YouBot Allowed

User-request fetchers

  • ChatGPT-User Restricted
  • Perplexity-User Restricted

The other 16 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.

See who blocks each AI crawler across the web

AI Crawlers

13 of 33 AI crawlers restricted

Standards: llms.txt

Full breakdown

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018