What powers monsteroil.net?
Last seen Sep 2026 · 23 technologies across 14 categories
Advertising
Affiliate programs
Analytics
CDN
Cookie compliance
Ecommerce
Font scripts
IaaS
JavaScript frameworks
JavaScript libraries
Marketing automation
Miscellaneous
Security
UI frameworks
AI Crawlers
Restricts 23 of 33 AI crawlers we track by name in its robots.txt. Checked Sep 2026.
Training crawlers
- AI2Bot Restricted
- Applebot-Extended Restricted
- Bytespider Restricted
- CCBot Restricted
- ClaudeBot Restricted
- cohere-training-data-crawler Restricted
- Diffbot Restricted
- FacebookBot Restricted
- Google-Extended Restricted
- GoogleOther Restricted
- GPTBot Restricted
- ImagesiftBot Restricted
- img2dataset Restricted
- meta-externalagent Restricted
- Webzio-Extended Restricted
Search and AI assistants
- Amazonbot Restricted
- Applebot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
- PetalBot Restricted
- YouBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- meta-externalfetcher Restricted
The other 10 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
- Sep 2026 *: Restricted (was Blocked)
AI Crawlers
23 of 33 AI crawlers restricted
Open Page Rank
0.82 / 10 · ranked #15,974,254 of all domains
4 referring domains · OpenPageRank
Page
- Language: English
- CDN: Cloudflare, Google
- Weight: 1.7 MB · 31 requests
Homepage as crawled by the HTTP Archive, Sep 2026.
Infrastructure
- Hosted on BIGCOMMERCE (63.141.128.8)
- DNS: bigcommerce.com
- Email: bigcommerce.com
- Email security: no SPF record, no DMARC record
- SSL: Google Trust Services, ECDSA P256, expires Dec 2026
- Common Crawl link graph: rank 6,955,428, 2 hosts
DNS records as swept Aug 2026, certificate as seen Sep 2026. How the web is hosted