What powers geo-search-console.com?

Last seen Jul 2026 · 8 technologies across 6 categories

Analytics

Google Analytics
since Jul 2026

Hosting

Hostinger
since Jul 2026

Miscellaneous

HTTP/3
since Jul 2026
Open Graph
since Jul 2026
PWA
since Jul 2026

Programming languages

Python
since Jul 2026

Security

HSTS
since Jul 2026

Web servers

Uvicorn
since Jul 2026

AI Crawlers

Restricts 13 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.

Training crawlers

  • Applebot-Extended Restricted
  • Bytespider Restricted
  • CCBot Restricted
  • ClaudeBot Restricted
  • Google-Extended Restricted
  • GoogleOther Restricted
  • GPTBot Restricted
  • meta-externalagent Restricted

Search and AI assistants

  • Amazonbot Restricted
  • OAI-SearchBot Restricted
  • PerplexityBot Restricted

User-request fetchers

  • ChatGPT-User Restricted
  • Perplexity-User Restricted

The other 20 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.

See who blocks each AI crawler across the web

AI Crawlers

13 of 33 AI crawlers restricted

Standards: llms.txt, llms-full.txt

Full breakdown

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018