What powers crackbay.org?
Last seen Jul 2026 · 31 technologies across 20 categories
Advertising
Affiliate programs
Analytics
Authentication
CDN
CMS
Databases
Ecommerce
Font scripts
JavaScript frameworks
JavaScript libraries
Miscellaneous
Payment processors
Programming languages
Security
Tag managers
Web servers
Widgets
WordPress plugins
WordPress themes
AI Crawlers
Blocks 8 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
The other 25 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt not found
- ai.txt not found
Content Signals:
search=yes ai-train=no declared in robots.txt
AI Crawlers
8 of 33 AI crawlers blocked
Standards: Content Signals
Open Page Rank
1.80 / 10 · ranked #4,376,130 of all domains
18 referring domains · OpenPageRank