What powers exployt.ai?
Last seen Aug 2026 · 9 technologies across 7 categories
CDN
Cloudflare
since Aug 2026
Font scripts
Google Font API
since Aug 2026
Miscellaneous
Open Graph
since Aug 2026
PWA
since Aug 2026
Payment processors
Stripe
since Aug 2026
Security
HSTS
since Aug 2026
Video players
YouTube
since Aug 2026
Web frameworks
Blazor
since Aug 2026
Microsoft ASP.NET
since Aug 2026
AI Crawlers
Restricts 14 of 33 AI crawlers we track by name in its robots.txt. Checked Sep 2026.
Training crawlers
- Applebot-Extended Restricted
- Bytespider Restricted
- CCBot Restricted
- ClaudeBot Restricted
- cohere-training-data-crawler Restricted
- Google-Extended Restricted
- GPTBot Restricted
- meta-externalagent Restricted
Search and AI assistants
- Amazonbot Restricted
- Applebot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Perplexity-User Restricted
The other 19 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not found