What powers flashfeed.pl?

Last seen Jul 2026 · 14 technologies across 10 categories

Analytics

Google Analytics
since Jul 2026

CDN

Cloudflare
since Jul 2026

Font scripts

Google Font API
since Jul 2026

JavaScript frameworks

React
since Jul 2026
Stimulus
since Jul 2026

Miscellaneous

HTTP/3
since Jul 2026
Open Graph
since Jul 2026
PWA
since Jul 2026

PaaS

Render
since Jul 2026

Performance

Priority Hints
since Jul 2026
Turbo
since Jul 2026

Programming languages

Ruby
since Jul 2026

Security

HSTS
since Jul 2026

Web frameworks

Ruby on Rails
since Jul 2026

AI Crawlers

Blocks 2 of 33 AI crawlers we track by name in its robots.txt, restricts 16 more. Checked Oct 2026.

Training crawlers

  • Bytespider Blocked
  • Applebot-Extended Restricted
  • CCBot Restricted
  • ClaudeBot Restricted
  • cohere-training-data-crawler Restricted
  • Google-Extended Restricted
  • GPTBot Restricted
  • meta-externalagent Restricted

Search and AI assistants

  • PetalBot Blocked
  • Amazonbot Restricted
  • Applebot Restricted
  • Claude-SearchBot Restricted
  • DuckAssistBot Restricted
  • OAI-SearchBot Restricted
  • PerplexityBot Restricted
  • YouBot Restricted

User-request fetchers

  • ChatGPT-User Restricted
  • Perplexity-User Restricted

The other 15 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.

  • Oct 2026 bytespider: Blocked (was Restricted)
  • Oct 2026 petalbot added to robots.txt

See who blocks each AI crawler across the web

AI Crawlers

2 of 33 AI crawlers blocked

Standards: llms.txt

Full breakdown

Infrastructure

DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted

Full technology history →
Report an incorrect detection

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018