What powers huggingbay.xyz?
Last seen Aug 2026 · 4 technologies across 3 categories
CDN
Cloudflare
since Aug 2026
Miscellaneous
HTTP/3
since Aug 2026
Open Graph
since Aug 2026
PaaS
Render
since Aug 2026
AI Crawlers
Restricts 15 of 33 AI crawlers we track by name in its robots.txt. Checked Sep 2026.
Training crawlers
- Applebot-Extended Restricted
- Bytespider Restricted
- CCBot Restricted
- ClaudeBot Restricted
- Google-Extended Restricted
- GPTBot Restricted
- meta-externalagent Restricted
- cohere-training-data-crawler Allowed
- GoogleOther Allowed
Search and AI assistants
- Amazonbot Restricted
- Applebot Restricted
- Claude-SearchBot Restricted
- DuckAssistBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
- PetalBot Restricted
- YouBot Restricted
User-request fetchers
- ChatGPT-User Allowed
- Claude-User Allowed
- MistralAI-User Allowed
- Perplexity-User Allowed
The other 12 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt found
- llms-full.txt found
- ai.txt not checked
AI Crawlers
15 of 33 AI crawlers restricted
Standards: llms.txt, llms-full.txt
Audience
- 56% phone
- 44% desktop
United States
India
Germany
Canada
United Kingdom
Italy
Where the site's Chrome visitors come from, largest estimated audience first.
Core Web Vitals
| LCP | 2.2 s |
| INP | 75 ms |
| CLS | 0.15 |
| TTFB | 1000 ms |
Real user p75, Chrome UX Report, Aug 2026.
Page
- Language: English
- CDN: Cloudflare
- Weight: 0.5 MB · 17 requests
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Aug 2026.