What powers gala.fyi?

Last seen Aug 2026 · 8 technologies across 5 categories

Analytics

Google Analytics
since Aug 2026

Caching

Varnish
since Aug 2026

CDN

Fastly
since Aug 2026
jsDelivr
since Aug 2026

Miscellaneous

Open Graph
since Aug 2026
Prism
since Aug 2026
PWA
since Aug 2026

PaaS

GitHub Pages
since Aug 2026

AI Crawlers

Does not block any of the 33 AI crawlers we track in its robots.txt. Checked Oct 2026.

Training crawlers

  • Applebot-Extended Allowed
  • CCBot Allowed
  • ClaudeBot Allowed
  • cohere-training-data-crawler Allowed
  • Google-Extended Allowed
  • GPTBot Allowed
  • meta-externalagent Allowed

Search and AI assistants

  • Amazonbot Allowed
  • Claude-SearchBot Allowed
  • DuckAssistBot Allowed
  • OAI-SearchBot Allowed
  • PerplexityBot Allowed

User-request fetchers

  • ChatGPT-User Allowed
  • Claude-User Allowed
  • MistralAI-User Allowed
  • Perplexity-User Allowed

The other 17 AI crawlers we track are not mentioned and stay allowed by default.

  • Oct 2026 mistralai-user added to robots.txt
  • Oct 2026 claude-searchbot added to robots.txt
  • Oct 2026 claude-user added to robots.txt
  • Oct 2026 claudebot added to robots.txt
  • Oct 2026 chatgpt-user added to robots.txt
  • Oct 2026 amazonbot added to robots.txt

See who blocks each AI crawler across the web

AI Crawlers

No AI crawlers blocked

Standards: llms.txt

Full breakdown

Infrastructure

  • Email: no MX record returned
  • Email security: SPF (soft fail), DMARC monitor only
  • SSL: Let's Encrypt, RSA 2048, expires Dec 2026
  • Common Crawl link graph: rank 43,677,548

DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted

Full technology history →
Report an incorrect detection

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018