What powers aimedit.org?

Last seen Jul 2026 · 12 technologies across 9 categories

Analytics

Authentication

Clerk
since Jul 2026

CDN

Cloudflare
since Jul 2026

JavaScript frameworks

Next.js v15.5.19
since Jul 2026
Next.js App Router
since Jul 2026
React
since Jul 2026

Miscellaneous

HTTP/3
since Jul 2026
Webpack
since Jul 2026

Performance

Priority Hints
since Jul 2026

Programming languages

Node.js
since Jul 2026

Security

Cloudflare Bot Management
since Jul 2026

UI frameworks

Tailwind CSS
since Jul 2026

AI Crawlers

Blocks 12 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.

Training crawlers

  • Applebot-Extended Blocked
  • Bytespider Blocked
  • CCBot Blocked
  • ClaudeBot Blocked
  • cohere-training-data-crawler Blocked
  • FacebookBot Blocked
  • Google-Extended Blocked
  • GPTBot Blocked
  • meta-externalagent Blocked

Search and AI assistants

  • Amazonbot Blocked
  • PerplexityBot Blocked

User-request fetchers

  • ChatGPT-User Blocked

The other 21 AI crawlers we track are not mentioned and stay allowed by default.

  • robots.txt found
  • llms.txt not found
  • ai.txt not found

Content Signals: search=yes ai-train=no declared in robots.txt

See who blocks each AI crawler across the web

AI Crawlers

12 of 33 AI crawlers blocked

Standards: Content Signals

Full breakdown

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018