What powers sludgeunderground.com?
Last seen Oct 2026 · 20 technologies across 11 categories
Analytics
CDN
Font scripts
JavaScript libraries
Miscellaneous
Performance
Programming languages
Security
UI frameworks
Video players
Web frameworks
AI Crawlers
Blocks 2 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- Applebot-Extended Allowed
- Bytespider Allowed
- CCBot Allowed
- ClaudeBot Allowed
- cohere-training-data-crawler Allowed
- Diffbot Allowed
- FacebookBot Allowed
- Google-Extended Allowed
- GPTBot Allowed
- ImagesiftBot Allowed
- meta-externalagent Allowed
- Webzio-Extended Allowed
Search and AI assistants
- Amazonbot Blocked
- PetalBot Blocked
- Claude-SearchBot Allowed
- DuckAssistBot Allowed
- OAI-SearchBot Allowed
- PerplexityBot Allowed
User-request fetchers
- ChatGPT-User Allowed
- Claude-User Allowed
- Perplexity-User Allowed
The other 12 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt found
- ai.txt not checked
AI Crawlers
2 of 33 AI crawlers blocked
Standards: llms.txt
Open Page Rank
0.10 / 10 · ranked #117,439,387 of all domains
0 referring domains · OpenPageRank
Page
- Language: English
- CDN: Cloudflare
- Weight: 2.5 MB · 49 requests
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Nov 2026.
Organisation
From the homepage's own structured data (Nov 2026).
Infrastructure
- Hosted on Amazon Web Services (54.90.47.105)
- DNS: Hover
- Email: OpenSRS Email
- Email security: SPF (soft fail), DMARC monitor only
- SSL: Let's Encrypt, ECDSA P256, expires Nov 2026
- Common Crawl link graph: rank 41,177,729, 2 hosts
- Verified with: Google, MailerLite
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted
Full technology history →
Report an incorrect detection
Recent changes
- dropped Cloudflare Bot Management Sep 2026
- dropped Twitter Sep 2026
- dropped Twitter Ads Sep 2026
- dropped Font Awesome Aug 2026
- detected Isotope Aug 2026
- dropped Amazon ALB May 2026
- dropped Amazon Web Services May 2026
- dropped core-js May 2026
- dropped React May 2026
- dropped Algolia Mar 2026
- dropped Alpine.js Mar 2026
- dropped cdnjs Mar 2026
- dropped Cloudflare Mar 2026
- dropped Dropzone Mar 2026
- dropped FancyBox Mar 2026
- dropped Isotope Mar 2026
- dropped jQuery UI Mar 2026
- dropped Modernizr Mar 2026
- dropped Plyr Mar 2026
- dropped Select2 Mar 2026
- detected Amazon ALB Jan 2026
- detected Amazon Web Services Jan 2026
- detected core-js Jan 2026
- detected React Jan 2026