What powers rachelbythebay.com?

Last seen Dec 2025 · 1 technologies across 1 categories

Web servers

Apache HTTP Server
since Feb 2019

AI Crawlers

Blocks all crawlers by default in robots.txt (User-agent: *). Checked Sep 2026.

Training crawlers

  • AI2Bot Blocked
  • Applebot-Extended Blocked
  • Bytespider Blocked
  • CCBot Blocked
  • ClaudeBot Blocked
  • cohere-training-data-crawler Blocked
  • Diffbot Blocked
  • FacebookBot Blocked
  • Google-CloudVertexBot Blocked
  • Google-Extended Blocked
  • GoogleOther Blocked
  • GPTBot Blocked
  • ImagesiftBot Blocked
  • img2dataset Blocked
  • meta-externalagent Blocked
  • PanguBot Blocked
  • SBIntuitionsBot Blocked
  • Webzio-Extended Blocked

Search and AI assistants

  • Amazonbot Blocked
  • Applebot Blocked
  • Claude-SearchBot Blocked
  • DuckAssistBot Blocked
  • OAI-SearchBot Blocked
  • PerplexityBot Blocked
  • PetalBot Blocked
  • YouBot Blocked

User-request fetchers

  • ChatGPT-User Blocked
  • Claude-User Blocked
  • GoogleAgent-Mariner Blocked
  • meta-externalfetcher Blocked
  • MistralAI-User Blocked
  • Perplexity-User Blocked

The other 1 AI crawler we track is not mentioned and is blocked by the catch-all rule (User-agent: *).

  • robots.txt found
  • llms.txt not checked
  • ai.txt not checked

See who blocks each AI crawler across the web

AI Crawlers

All crawlers blocked

Full breakdown

Audience

  • United States

Where the site's Chrome visitors come from, largest estimated audience first.

Open Page Rank

5.32 / 10 · ranked #187,342 of all domains

292 referring domains · OpenPageRank

Core Web Vitals

LCP0.6 s
INP50 ms
CLS0
TTFB400 ms

Real user p75, Chrome UX Report, Aug 2026.

Infrastructure

DNS records as swept Sep 2026. How the web is hosted

Full technology history →
Report an incorrect detection

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018