What powers rockkrawler.com?
Last seen Aug 2026 · 27 technologies across 16 categories
Analytics
CDN
Ecommerce
Font scripts
Hosting
IaaS
JavaScript Frameworks
JavaScript libraries
Miscellaneous
Programming languages
Security
Tag managers
UI frameworks
Video players
Web servers
Widgets
AI Crawlers
Restricts 23 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- AI2Bot Restricted
- Applebot-Extended Restricted
- Bytespider Restricted
- CCBot Restricted
- ClaudeBot Restricted
- cohere-training-data-crawler Restricted
- Diffbot Restricted
- FacebookBot Restricted
- Google-Extended Restricted
- GoogleOther Restricted
- GPTBot Restricted
- ImagesiftBot Restricted
- img2dataset Restricted
- meta-externalagent Restricted
- Webzio-Extended Restricted
Search and AI assistants
- Amazonbot Restricted
- Applebot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
- PetalBot Restricted
- YouBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- meta-externalfetcher Restricted
The other 10 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
AI Crawlers
23 of 33 AI crawlers restricted
Audience
- 52% phone
- 48% desktop
United States
Where the site's Chrome visitors come from, largest estimated audience first.
Open Page Rank
2.15 / 10 · ranked #3,211,694 of all domains
26 referring domains · OpenPageRank
Core Web Vitals
| LCP | 1.5 s |
| INP | 50 ms |
| CLS | 0 |
| TTFB | 500 ms |
Real user p75, Chrome UX Report, Aug 2026.
Page
- Language: English
- CDN: Cloudflare, Google
- Weight: 3.5 MB · 74 requests
Homepage as crawled by the HTTP Archive, Sep 2026.
Subdomains
| Host | Techs |
|---|---|
| rockkrawler.com | 22 |
| www.rockkrawler.com | 10 |
Full technology history →
Report an incorrect detection
Recent changes
- detected Google Cloud CDN Jun 2026
- dropped Klaviyo Jan 2026