What powers thecollectivecwa.com?
Last seen Aug 2026 · 37 technologies across 20 categories
Advertising
Analytics
Authentication
CDN
Cookie compliance
Font scripts
Hosting
JavaScript frameworks
JavaScript graphics
JavaScript libraries
Maps
Miscellaneous
Performance
Programming languages
Security
Tag managers
UI frameworks
Video players
Web servers
Webmail
AI Crawlers
Blocks 1 of 33 AI crawlers we track by name in its robots.txt, restricts 14 more. Checked Sep 2026. A recent check saw a policy file missing; awaiting confirmation.
Training crawlers
- Bytespider Blocked
- Applebot-Extended Restricted
- CCBot Restricted
- ClaudeBot Restricted
- Google-Extended Restricted
- GPTBot Restricted
- meta-externalagent Restricted
Search and AI assistants
- Applebot Restricted
- Claude-SearchBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- meta-externalfetcher Restricted
- Perplexity-User Restricted
The other 18 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- llms-full.txt found
- ai.txt found
- Sep 2026 applebot-extended added to robots.txt
- Sep 2026 bytespider: Blocked (was Restricted)
- Sep 2026 meta-externalagent added to robots.txt
- Sep 2026 meta-externalfetcher added to robots.txt
AI Crawlers
1 of 33 AI crawlers blocked
Standards: llms.txt, llms-full.txt, ai.txt
Open Page Rank
0.10 / 10 · ranked #91,297,281 of all domains
0 referring domains · OpenPageRank
Infrastructure
- DNS: GoDaddy DNS
- Email: Microsoft 365
- Email security: SPF (hard fail), no DMARC record
- SSL: Let's Encrypt, RSA 2048, expires Nov 2026
- Common Crawl link graph: rank 97,190,244
DNS records as swept Sep 2026, certificate as seen Sep 2026. How the web is hosted
Full technology history →
Report an incorrect detection
Recent changes
- dropped Branch Aug 2026
- dropped Mapbox GL JS Aug 2026