What powers
subbu.org?
Last seen Jun 2026 · 22 technologies across 13 categories
Analytics
Blogs
CDN
Font scripts
JavaScript frameworks
JavaScript libraries
Miscellaneous
PaaS
Programming languages
Reverse proxies
RUM
Static site generator
Webmail
AI Crawlers
Blocks 25 of 33 AI crawlers we track by name in its robots.txt. Checked Sep 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-Extended Blocked
- GoogleOther Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- img2dataset Blocked
- meta-externalagent Blocked
- PanguBot Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Amazonbot Blocked
- Applebot Blocked
- DuckAssistBot Blocked
- OAI-SearchBot Blocked
- PerplexityBot Blocked
- PetalBot Blocked
- YouBot Blocked
User-request fetchers
- ChatGPT-User Blocked
- meta-externalfetcher Blocked
The other 8 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt not found
- ai.txt not found
- Sep 2026 Content Signals changed
- Sep 2026 * removed from robots.txt
AI Crawlers
25 of 33 AI crawlers blocked
Open Page Rank
4.53 / 10 · ranked #397,055 of all domains
91 referring domains · OpenPageRank
Infrastructure
- Hosted on Cloudflare (104.21.48.78, IPv6)
- DNS: Cloudflare DNS
- Email: iCloud Mail
- Email security: SPF (soft fail), DMARC quarantine
- SSL: Google Trust Services, ECDSA P256, expires Dec 2026
- Common Crawl link graph: rank 479,636, 4 hosts
- Verified with: Apple Business
DNS records as swept Sep 2026, certificate as seen Sep 2026. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| m.subbu.org | 16 |
| www.subbu.org | 9 |
Full technology history →
Report an incorrect detection
Recent changes
- dropped HSTS May 2026