What powers crabtreebooks.com?

Last seen Oct 2026 · 24 technologies across 12 categories

Analytics

Google Analytics
since Feb 2019

CDN

cdnjs
since Nov 2021
Cloudflare
since May 2022
Google Hosted Libraries
since Feb 2022

CMS

Progress Sitefinity v9.2.6275.0 SE
since Feb 2019

Ecommerce

Cart Functionality
since Aug 2020

Font scripts

Font Awesome
since Sep 2022
Google Font API
since Jan 2019

JavaScript libraries

core-js v3.6.5
since Sep 2022
FancyBox v3.5.7
since Sep 2022
jQuery v1.12.4
since Jan 2019
jQuery UI v1.14.1
since Sep 2022
Modernizr v2.6.2
since Feb 2019
Select2
since Sep 2022

Operating systems

Windows Server
since Jan 2019

Payment processors

Stripe vbasil
since Sep 2022

Programming languages

Ruby
since Sep 2022

Security

Cloudflare Bot Management
since Feb 2025
HSTS
since Sep 2022

Web frameworks

Microsoft ASP.NET v4.0.30319
since Jan 2019
Ruby on Rails
since Sep 2022

Web servers

Apache HTTP Server
since Sep 2022
IIS v7.5
since Jan 2019
Phusion Passenger v6.0.12
since Sep 2022

AI Crawlers

Blocks 25 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.

Training crawlers

  • AI2Bot Blocked
  • Applebot-Extended Blocked
  • Bytespider Blocked
  • CCBot Blocked
  • ClaudeBot Blocked
  • cohere-training-data-crawler Blocked
  • Diffbot Blocked
  • FacebookBot Blocked
  • Google-CloudVertexBot Blocked
  • Google-Extended Blocked
  • GPTBot Blocked
  • ImagesiftBot Blocked
  • img2dataset Blocked
  • meta-externalagent Blocked
  • PanguBot Blocked
  • Webzio-Extended Blocked

Search and AI assistants

  • Amazonbot Blocked
  • Claude-SearchBot Blocked
  • DuckAssistBot Blocked
  • OAI-SearchBot Blocked
  • PerplexityBot Blocked
  • PetalBot Blocked
  • YouBot Blocked

User-request fetchers

  • Claude-User Blocked
  • meta-externalfetcher Blocked

The other 8 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.

  • robots.txt found
  • llms.txt not checked
  • ai.txt not checked

See who blocks each AI crawler across the web

AI Crawlers

25 of 33 AI crawlers blocked

Full breakdown

Audience

  • 84% desktop
  • 16% phone
  • United States
  • Canada

Where the site's Chrome visitors come from, largest estimated audience first.

Open Page Rank

3.38 / 10 · ranked #1,025,743 of all domains

47 referring domains · OpenPageRank

Search traffic

7,600 est. monthly organic visits (US)

2,887 keywords in Google's top 30

Core Web Vitals

LCP1.5 s
INP25 ms
CLS0
TTFB1000 ms

Real user p75, Chrome UX Report, Oct 2026.

Page

  • Language: English (United States)
  • Weight: 5.5 MB · 63 requests

Homepage as crawled by the HTTP Archive, Nov 2026.

Infrastructure

  • Hosted on DigitalOcean (165.227.26.152)
  • DNS: vaxxine.com
  • Email: Barracuda
  • Email security: SPF (soft fail), DMARC quarantine
  • SSL: Let's Encrypt, ECDSA P256, expires Nov 2026
  • Common Crawl link graph: rank 123,933, 2 hosts

DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted

Subdomains

HostTechs
www.crabtreebooks.com 23
crabtreebooks.com 16

Full technology history →
Report an incorrect detection

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018