What powers rubicon-foundation.org?

Last seen Nov 2023 · 10 technologies across 8 categories

CDN

Cloudflare
since Oct 2022

Issue trackers

JavaScript frameworks

AMP
since Oct 2022

JavaScript libraries

Lightbox
since Oct 2022

Miscellaneous

HTTP/3
since Oct 2022
Open Graph
since Oct 2022

Payment processors

PayPal
since Feb 2019

Programming languages

Java
since Feb 2019
PHP v8.0.30
since Nov 2023

Web servers

Apache Tomcat v1.1
since Feb 2019

AI Crawlers

Restricts 10 of 33 AI crawlers we track by name in its robots.txt. Checked Nov 2026.

Training crawlers

  • Applebot-Extended Restricted
  • CCBot Restricted
  • ClaudeBot Restricted
  • Google-Extended Restricted
  • GPTBot Restricted

Search and AI assistants

  • Claude-SearchBot Restricted
  • OAI-SearchBot Restricted
  • PerplexityBot Restricted

User-request fetchers

  • ChatGPT-User Restricted
  • Claude-User Restricted

The other 23 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.

  • Oct 2026 claudebot: Restricted (was Allowed)
  • Oct 2026 perplexitybot: Restricted (was Allowed)
  • Oct 2026 applebot-extended: Restricted (was Allowed)
  • Oct 2026 ccbot: Restricted (was Allowed)
  • Oct 2026 anthropic-ai: Restricted (was Allowed)
  • Oct 2026 oai-searchbot: Restricted (was Allowed)

See who blocks each AI crawler across the web

AI Crawlers

10 of 33 AI crawlers restricted

Standards: llms.txt

Full breakdown

Open Page Rank

4.25 / 10 · ranked #442,839 of all domains

79 referring domains · OpenPageRank

Organisation

  • Rubicon Foundation
  • Country: United States

From Wikidata (CC0).

Infrastructure

DNS records as swept Nov 2026, certificate as seen Nov 2026, registration from the registry's RDAP service. How the web is hosted

Subdomains

HostTechs
archive.rubicon-foundation.org 9
rubicon-foundation.org 6

Full technology history →
Report an incorrect detection

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018