What powers cybedefend.com?
Last seen Sep 2026 · 21 technologies across 11 categories
Analytics
CDN
Development
IaaS
JavaScript frameworks
Miscellaneous
Performance
Programming languages
Security
UI frameworks
Webmail
AI Crawlers
Restricts 16 of 33 AI crawlers we track by name in its robots.txt. Checked Sep 2026.
Training crawlers
- Applebot-Extended Restricted
- Bytespider Restricted
- CCBot Restricted
- ClaudeBot Restricted
- Diffbot Restricted
- Google-Extended Restricted
- GPTBot Restricted
- meta-externalagent Restricted
Search and AI assistants
- Amazonbot Restricted
- Applebot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- meta-externalfetcher Restricted
- MistralAI-User Restricted
- Perplexity-User Restricted
The other 17 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- llms-full.txt found
- ai.txt not found
Content Signals:
search=yes ai-train=yes ai-input=yes declared in robots.txt
AI Crawlers
16 of 33 AI crawlers restricted
Standards: llms.txt, llms-full.txt, Content Signals
Open Page Rank
0.84 / 10 · ranked #15,525,390 of all domains
4 referring domains · OpenPageRank
Page
- Language: English
- CDN: Cloudflare, Google
- Weight: 1.4 MB · 82 requests
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Sep 2026.
Organisation
From the homepage's own structured data (Sep 2026).
Full technology history →
Report an incorrect detection
Recent changes
- detected RxJS Sep 2026