What powers statabet.ru?

Last seen Aug 2026 · 10 technologies across 8 categories

Analytics

Yandex.Metrika
since Jul 2026

CDN

Cloudflare
since Jul 2026

Font scripts

Google Font API
since Jul 2026

JavaScript frameworks

React
since Jul 2026
React Router v7.12.0
since Jul 2026

JavaScript graphics

Recharts
since Jul 2026

Miscellaneous

Open Graph
since Jul 2026
PWA
since Jul 2026

Security

HSTS
since Jul 2026

Web servers

Nginx
since Jul 2026

AI Crawlers

Restricts 10 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.

Training crawlers

  • Bytespider Restricted
  • CCBot Restricted
  • ClaudeBot Restricted
  • Google-Extended Restricted
  • GPTBot Restricted
  • meta-externalagent Restricted
  • Applebot-Extended Allowed
  • cohere-training-data-crawler Allowed
  • Diffbot Allowed
  • FacebookBot Allowed
  • GoogleOther Allowed

Search and AI assistants

  • Amazonbot Restricted
  • OAI-SearchBot Restricted
  • PerplexityBot Restricted
  • Applebot Allowed
  • DuckAssistBot Allowed
  • YouBot Allowed

User-request fetchers

  • ChatGPT-User Restricted
  • MistralAI-User Allowed
  • Perplexity-User Allowed

The other 13 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.

See who blocks each AI crawler across the web

AI Crawlers

10 of 33 AI crawlers restricted

Standards: llms.txt

Full breakdown

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018