What powers ai6yr.org?

Last seen Aug 2026 · 12 technologies across 10 categories

Analytics

CDN

Cloudflare
since Jan 2023

JavaScript frameworks

React
since Jan 2023

JavaScript libraries

core-js v3.43.0
since Jan 2023

Marketing automation

Mautic
since Jun 2026

Message boards

Mastodon
since Jan 2023

Miscellaneous

HTTP/3
since Jan 2023
Open Graph
since Jan 2023
PWA
since Jan 2023

Programming languages

Ruby
since Jan 2023

Security

HSTS
since Jan 2023

Web frameworks

Ruby on Rails
since Jan 2023

AI Crawlers

Blocks 8 of 33 AI crawlers we track by name in its robots.txt. Checked Sep 2026.

Training crawlers

  • Applebot-Extended Blocked
  • Bytespider Blocked
  • CCBot Blocked
  • ClaudeBot Blocked
  • Google-Extended Blocked
  • GPTBot Blocked
  • meta-externalagent Blocked

Search and AI assistants

  • Amazonbot Blocked

The other 25 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.

  • robots.txt found
  • llms.txt not found
  • ai.txt not found

Content Signals: search=yes ai-train=no declared in robots.txt

See who blocks each AI crawler across the web

AI Crawlers

8 of 33 AI crawlers blocked

Standards: Content Signals

Full breakdown

Open Page Rank

3.42 / 10 · ranked #986,174 of all domains

73 referring domains · OpenPageRank

Page

  • Language: English
  • CDN: Cloudflare
  • Weight: 1.1 MB · 102 requests
  • Structured data: OpenGraph

Homepage as crawled by the HTTP Archive, Aug 2026.

Full technology history →
Report an incorrect detection

Recent changes

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018