What powers charlycrawford.training?
Last seen Jul 2026 · 21 technologies across 14 categories
CDN
Cloudflare
since Nov 2025
Google Cloud CDN
since Jul 2026
Ecommerce
BigCommerce
since Nov 2025
Cart Functionality
since Nov 2025
Font scripts
Google Font API
since Nov 2025
Form builders
Klaviyo Forms
since Nov 2025
IaaS
Google Cloud
since Jul 2026
Issue trackers
Marker
since Nov 2025
JavaScript frameworks
JavaScript libraries
Marketing automation
Klaviyo
since Nov 2025
Miscellaneous
HTTP/3
since Nov 2025
Security
Cloudflare Bot Management
since Nov 2025
HSTS
since Nov 2025
UI frameworks
Webmail
Google Workspace
since Nov 2025
Widgets
Elfsight
since Nov 2025
AI Crawlers
Restricts 23 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- AI2Bot Restricted
- Applebot-Extended Restricted
- Bytespider Restricted
- CCBot Restricted
- ClaudeBot Restricted
- cohere-training-data-crawler Restricted
- Diffbot Restricted
- FacebookBot Restricted
- Google-Extended Restricted
- GoogleOther Restricted
- GPTBot Restricted
- ImagesiftBot Restricted
- img2dataset Restricted
- meta-externalagent Restricted
- Webzio-Extended Restricted
Search and AI assistants
- Amazonbot Restricted
- Applebot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
- PetalBot Restricted
- YouBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- meta-externalfetcher Restricted
The other 10 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
AI Crawlers
23 of 33 AI crawlers restricted
Open Page Rank
0.46 / 10 · ranked #27,440,860 of all domains
1 referring domains · OpenPageRank