What powers dirtydickscrabs.com?
Last seen Aug 2026 · 46 technologies across 26 categories
Analytics
CDN
CMS
Databases
Development
Font scripts
JavaScript frameworks
JavaScript libraries
Live chat
Maps
Miscellaneous
Operating systems
PaaS
Page builders
Performance
Programming languages
Rich text editors
Search engines
Security
Tag managers
UI frameworks
Web frameworks
Web servers
Widgets
WordPress plugins
WordPress themes
AI Crawlers
Blocks 9 of 33 AI crawlers we track by name in its robots.txt, restricts 7 more. Checked Aug 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- FacebookBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Applebot Restricted
- Claude-SearchBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- Perplexity-User Restricted
The other 17 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not found
AI Crawlers
9 of 33 AI crawlers blocked
Standards: llms.txt
Audience
- 91% phone
- 9% desktop
United States
India
Where the site's Chrome visitors come from, largest estimated audience first.
Open Page Rank
1.79 / 10 · ranked #4,406,862 of all domains
20 referring domains · OpenPageRank
Core Web Vitals
| LCP | 0.8 s |
| INP | 50 ms |
| CLS | 0 |
| TTFB | 400 ms |
Real user p75, Chrome UX Report, Aug 2026.
Page
- Language: English (United States)
- CDN: Cloudflare
- Weight: 2.6 MB · 58 requests
- WordPress theme: generatepress (child: dirty-dicks) · all themes
- Structured data: JSON-LD, Microdata, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Sep 2026.
Subdomains
| Host | Techs |
|---|---|
| dirtydickscrabs.com | 31 |
| www.dirtydickscrabs.com | 26 |
Full technology history →
Report an incorrect detection
Recent changes
- detected GenerateBlocks Aug 2026
- detected GeneratePress Aug 2026
- detected GeneratePress GP Premium Aug 2026
- detected Lightbox Aug 2026
- detected Priority Hints Aug 2026
- detected WhatsApp Business Chat Aug 2026
- detected WordPress Block Editor Aug 2026
- detected Yext Aug 2026
- detected Yoast SEO Aug 2026
- detected Google Tag Manager Jun 2026
- detected HSTS May 2026
- dropped RSS Feb 2026