What powers spaceaware.io?

Last seen Oct 2026 · 12 technologies across 10 categories

Analytics

Google Analytics
since Feb 2026

Caching

Varnish
since Feb 2023

CDN

Cloudflare
since Feb 2023
Fastly
since Feb 2023

Email

Mailgun
since Nov 2023

JavaScript frameworks

RxJS
since Feb 2026
Svelte
since Feb 2023

Miscellaneous

HTTP/3
since Feb 2023

PaaS

GitHub Pages
since Feb 2023

Programming languages

Java
since Jun 2024

Security

HSTS
since Feb 2026

UI frameworks

Tailwind CSS
since Dec 2023

AI Crawlers

Blocks 22 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.

Training crawlers

  • AI2Bot Blocked
  • Applebot-Extended Blocked
  • Bytespider Blocked
  • CCBot Blocked
  • ClaudeBot Blocked
  • cohere-training-data-crawler Blocked
  • Diffbot Blocked
  • Google-Extended Blocked
  • GPTBot Blocked
  • ImagesiftBot Blocked
  • meta-externalagent Blocked

Search and AI assistants

  • Amazonbot Blocked
  • Claude-SearchBot Blocked
  • DuckAssistBot Blocked
  • OAI-SearchBot Blocked
  • PerplexityBot Blocked
  • YouBot Blocked

User-request fetchers

  • ChatGPT-User Blocked
  • Claude-User Blocked
  • meta-externalfetcher Blocked
  • MistralAI-User Blocked
  • Perplexity-User Blocked

The other 11 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.

  • robots.txt found
  • llms.txt not found
  • ai.txt not found

Content Signals: search=yes ai-train=no ai-input=no declared in robots.txt

  • Oct 2026 bytespider added to robots.txt
  • Oct 2026 applebot-extended added to robots.txt
  • Oct 2026 chatgpt-user added to robots.txt
  • Oct 2026 claude-searchbot added to robots.txt
  • Oct 2026 ccbot added to robots.txt
  • Oct 2026 claude-user added to robots.txt

See who blocks each AI crawler across the web

AI Crawlers

22 of 33 AI crawlers blocked

Standards: Content Signals

Full breakdown

Open Page Rank

1.31 / 10 · ranked #8,480,620 of all domains

4 referring domains · OpenPageRank

Page

  • Language: English
  • CDN: Cloudflare, Fastly
  • Weight: 23.4 MB · 35 requests

Homepage as crawled by the HTTP Archive, Nov 2026.

Infrastructure

DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted

Subdomains

HostTechs
sbi.spaceaware.io 9
tap.spaceaware.io 8
beta.spaceaware.io 7
spaceaware.io 7

Full technology history →
Report an incorrect detection

Recent changes

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018