What powers arowest.com?
Last seen Oct 2026 · 22 technologies across 14 categories
Analytics
CDN
CMS
Databases
Ecommerce
Font scripts
JavaScript libraries
Miscellaneous
Performance
Programming languages
Reviews
Security
UI frameworks
Web servers
AI Crawlers
Blocks 17 of 33 AI crawlers we track by name in its robots.txt, restricts 11 more. Checked Oct 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- img2dataset Blocked
- meta-externalagent Blocked
- PanguBot Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Amazonbot Blocked
- Applebot Restricted
- Claude-SearchBot Restricted
- DuckAssistBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
- YouBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- meta-externalfetcher Restricted
- MistralAI-User Restricted
- Perplexity-User Restricted
The other 5 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not found
Content Signals:
search=yes ai-train=no ai-input=yes declared in robots.txt
- Oct 2026 *: Restricted (was Allowed)
- Oct 2026 claude-user: Restricted (was Allowed)
- Oct 2026 claude-searchbot: Restricted (was Allowed)
- Oct 2026 duckassistbot: Restricted (was Allowed)
- Oct 2026 applebot: Restricted (was Allowed)
- Oct 2026 chatgpt-user: Restricted (was Allowed)
AI Crawlers
17 of 33 AI crawlers blocked
Standards: llms.txt, Content Signals
Audience
- 81% phone
- 19% desktop
India
Where the site's Chrome visitors come from, largest estimated audience first.
Core Web Vitals
| LCP | 2.6 s |
| INP | 150 ms |
| CLS | 0 |
| TTFB | 1900 ms |
Real user p75, Chrome UX Report, Oct 2026.
Page
- Language: English
- CDN: Cloudflare
- Weight: 1.0 MB · 42 requests
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Nov 2026.
Organisation
From the homepage's own structured data (Nov 2026).
Infrastructure
- Hosted on Cloudflare (104.21.3.219, IPv6)
- DNS: Cloudflare DNS
- Email: arowest.com
- Email security: SPF (soft fail), DMARC monitor only, DNSSEC signed
- SSL: Google Trust Services, ECDSA P256, wildcard, expires Dec 2026
- Verified with: Google
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| arowest.com | 15 |
| shop.arowest.com | 15 |