What powers mstdn.plus?

Last seen Aug 2026 · 6 technologies across 5 categories

CDN

Cloudflare
since Jan 2023

JavaScript libraries

core-js v3.49.0
since Jan 2023

Message boards

Mastodon
since Jan 2023

Miscellaneous

Open Graph
since Jan 2023
PWA
since Jan 2023

Security

HSTS
since Jan 2023

AI Crawlers

Blocks 8 of 33 AI crawlers we track by name in its robots.txt. Checked Sep 2026.

Training crawlers

  • Applebot-Extended Blocked
  • Bytespider Blocked
  • CCBot Blocked
  • ClaudeBot Blocked
  • Google-Extended Blocked
  • GPTBot Blocked
  • meta-externalagent Blocked

Search and AI assistants

  • Amazonbot Blocked

The other 25 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.

  • robots.txt found
  • llms.txt not found
  • ai.txt not found

Content Signals: search=yes ai-train=no declared in robots.txt

See who blocks each AI crawler across the web

AI Crawlers

8 of 33 AI crawlers blocked

Standards: Content Signals

Full breakdown

Open Page Rank

4.79 / 10 · ranked #267,426 of all domains

135 referring domains · OpenPageRank

Page

  • Language: English
  • CDN: Cloudflare
  • Weight: 10.6 MB · 172 requests
  • Structured data: OpenGraph

Homepage as crawled by the HTTP Archive, Aug 2026.

Full technology history →
Report an incorrect detection

Recent changes

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018