What powers shipindex.org?
Last seen Oct 2026 · 27 technologies across 20 categories
Analytics
CDN
CMS
Databases
Hosting
JavaScript frameworks
JavaScript libraries
Marketing automation
Miscellaneous
PaaS
Page builders
Performance
Programming languages
Rich text editors
Security
Tag managers
UI frameworks
Web frameworks
Web servers
AI Crawlers
Blocks 6 of 33 AI crawlers we track by name in its robots.txt, restricts 11 more. Checked Oct 2026.
Training crawlers
- Bytespider Blocked
- Diffbot Blocked
- ImagesiftBot Blocked
- meta-externalagent Blocked
- Webzio-Extended Blocked
- CCBot Restricted
- ClaudeBot Restricted
- GPTBot Restricted
Search and AI assistants
- PetalBot Blocked
- Amazonbot Restricted
- Claude-SearchBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
- YouBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- Perplexity-User Restricted
The other 16 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
- Sep 2026 claude-searchbot added to robots.txt
- Sep 2026 claudebot added to robots.txt
- Sep 2026 claude-user added to robots.txt
- Sep 2026 diffbot added to robots.txt
- Sep 2026 chatgpt-user added to robots.txt
- Sep 2026 amazonbot added to robots.txt
AI Crawlers
6 of 33 AI crawlers blocked
Audience
- 55% desktop
- 45% phone
United Kingdom
United States
Where the site's Chrome visitors come from, largest estimated audience first.
Open Page Rank
2.78 / 10 · ranked #2,026,145 of all domains
28 referring domains · OpenPageRank
Core Web Vitals
| LCP | 1.4 s |
| INP | 50 ms |
| CLS | 0 |
| TTFB | 700 ms |
Real user p75, Chrome UX Report, Oct 2026.
Page
- Language: English
- Weight: 1.6 MB · 38 requests
- Structured data: Microdata
Homepage as crawled by the HTTP Archive, Nov 2026.
Organisation
- ShipIndex.org
- Country: United States
From Wikidata (CC0).
Infrastructure
- Hosted on Amazon Web Services (18.205.222.128)
- DNS: DreamHost
- Email: Google Workspace
- Email security: no SPF record, DMARC monitor only
- SSL: Let's Encrypt, RSA 2048, expires Dec 2026
- Common Crawl link graph: rank 818,432, 3 hosts
- Verified with: Brevo, Google
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| blog.shipindex.org | 17 |
| www.shipindex.org | 17 |
Full technology history →
Report an incorrect detection
Recent changes
- dropped Webpack Mar 2026