What powers shiftdefi.com?
Last seen Jul 2026 · 13 technologies across 8 categories
Analytics
CDN
Cloudflare
since Apr 2026
JavaScript frameworks
React
since Apr 2026
JavaScript graphics
Recharts
since Jul 2026
Miscellaneous
Security
HSTS
since Apr 2026
UI frameworks
Radix UI
since Jul 2026
Webmail
Proton Mail
since Jul 2026
AI Crawlers
Blocks 8 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
The other 25 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt not checked
- ai.txt not checked
Content Signals:
search=yes ai-train=no declared in robots.txt
AI Crawlers
8 of 33 AI crawlers blocked
Standards: Content Signals
Open Page Rank
0.38 / 10 · ranked #40,959,622 of all domains
2 referring domains · OpenPageRank