What powers
rubicon-foundation.org?
Last seen Nov 2023 · 10 technologies across 8 categories
CDN
Issue trackers
JavaScript frameworks
JavaScript libraries
Miscellaneous
Payment processors
Programming languages
Web servers
AI Crawlers
Restricts 10 of 33 AI crawlers we track by name in its robots.txt. Checked Nov 2026.
Training crawlers
- Applebot-Extended Restricted
- CCBot Restricted
- ClaudeBot Restricted
- Google-Extended Restricted
- GPTBot Restricted
Search and AI assistants
- Claude-SearchBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
The other 23 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not found
- Oct 2026 claudebot: Restricted (was Allowed)
- Oct 2026 perplexitybot: Restricted (was Allowed)
- Oct 2026 applebot-extended: Restricted (was Allowed)
- Oct 2026 ccbot: Restricted (was Allowed)
- Oct 2026 anthropic-ai: Restricted (was Allowed)
- Oct 2026 oai-searchbot: Restricted (was Allowed)
AI Crawlers
10 of 33 AI crawlers restricted
Standards: llms.txt
Open Page Rank
4.25 / 10 · ranked #442,839 of all domains
79 referring domains · OpenPageRank
Organisation
- Rubicon Foundation
- Country: United States
From Wikidata (CC0).
Infrastructure
- Registered Jul 2002 (24 years) via GoDaddy.com, LLC, renews Jul 2027
- Hosted on HOSTKEY-AS HOSTKEY B.V. (193.247.82.232)
- DNS: Cloudflare DNS
- Email: Cloudflare Email Routing
- Email security: SPF (soft fail), DMARC reject
- SSL: Let's Encrypt, ECDSA P256, expires Feb 2027
- Common Crawl link graph: rank 606,931, 4 hosts
DNS records as swept Nov 2026, certificate as seen Nov 2026, registration from the registry's RDAP service. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| archive.rubicon-foundation.org | 9 |
| rubicon-foundation.org | 6 |