What powers dealsforum.com?
Last seen Aug 2026 · 38 technologies across 19 categories
Advertising
Affiliate programs
Analytics
Caching
CDN
Databases
Font scripts
JavaScript frameworks
JavaScript libraries
Message boards
Miscellaneous
Programming languages
Reverse proxies
Security
Segmentation
Surveys
Tag managers
Web frameworks
AI Crawlers
Blocks 16 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- meta-externalagent Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Amazonbot Blocked
- OAI-SearchBot Blocked
- PerplexityBot Blocked
- YouBot Blocked
User-request fetchers
- ChatGPT-User Blocked
The other 17 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
AI Crawlers
16 of 33 AI crawlers blocked
Open Page Rank
0.28 / 10 · ranked #58,753,068 of all domains
1 referring domains · OpenPageRank
Page
- Language: English (United States)
- CDN: Fastly
- Weight: 3.7 MB · 384 requests
Homepage as crawled by the HTTP Archive, Aug 2026.
Full technology history →
Report an incorrect detection
Recent changes
- dropped Priority Hints Aug 2026
- dropped Unpkg Aug 2026
- dropped web-vitals Aug 2026
- detected Preact Dec 2025
- detected Survicate Dec 2025
- detected Priority Hints Nov 2025
- detected Unpkg Nov 2025
- detected web-vitals Nov 2025
- dropped Preact Oct 2025
- dropped Survicate Oct 2025