What powers crabtreebooks.com?
Last seen Oct 2026 · 24 technologies across 12 categories
Analytics
CDN
CMS
Ecommerce
Font scripts
JavaScript libraries
Operating systems
Payment processors
Programming languages
Security
Web frameworks
Web servers
AI Crawlers
Blocks 25 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- img2dataset Blocked
- meta-externalagent Blocked
- PanguBot Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Amazonbot Blocked
- Claude-SearchBot Blocked
- DuckAssistBot Blocked
- OAI-SearchBot Blocked
- PerplexityBot Blocked
- PetalBot Blocked
- YouBot Blocked
User-request fetchers
- Claude-User Blocked
- meta-externalfetcher Blocked
The other 8 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not checked
- ai.txt not checked
AI Crawlers
25 of 33 AI crawlers blocked
Audience
- 84% desktop
- 16% phone
United States
Canada
Where the site's Chrome visitors come from, largest estimated audience first.
Open Page Rank
3.38 / 10 · ranked #1,025,743 of all domains
47 referring domains · OpenPageRank
Search traffic
7,600 est. monthly organic visits (US)
2,887 keywords in Google's top 30
Core Web Vitals
| LCP | 1.5 s |
| INP | 25 ms |
| CLS | 0 |
| TTFB | 1000 ms |
Real user p75, Chrome UX Report, Oct 2026.
Page
- Language: English (United States)
- Weight: 5.5 MB · 63 requests
Homepage as crawled by the HTTP Archive, Nov 2026.
Infrastructure
- Hosted on DigitalOcean (165.227.26.152)
- DNS: vaxxine.com
- Email: Barracuda
- Email security: SPF (soft fail), DMARC quarantine
- SSL: Let's Encrypt, ECDSA P256, expires Nov 2026
- Common Crawl link graph: rank 123,933, 2 hosts
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| www.crabtreebooks.com | 23 |
| crabtreebooks.com | 16 |