What powers bitbyte24.com?
Last seen Jul 2026 · 14 technologies across 8 categories
Analytics
Cloudflare Browser Insights
since Jul 2026
Google Analytics
since Jul 2026
CDN
Cloudflare
since Jul 2026
Development
Turbopack
since Jul 2026
JavaScript frameworks
Miscellaneous
HTTP/3
since Jul 2026
Open Graph
since Jul 2026
PWA
since Jul 2026
Webpack
since Jul 2026
Websocket
since Jul 2026
Programming languages
Node.js
since Jul 2026
Security
HSTS
since Jul 2026
UI frameworks
Tailwind CSS
since Jul 2026
AI Crawlers
Blocks 15 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- img2dataset Blocked
- meta-externalagent Blocked
- Webzio-Extended Blocked
Search and AI assistants
- YouBot Blocked
- Amazonbot Allowed
- Applebot Allowed
- OAI-SearchBot Allowed
- PerplexityBot Allowed
- PetalBot Allowed
User-request fetchers
- meta-externalfetcher Blocked
- ChatGPT-User Allowed
- Perplexity-User Allowed
The other 11 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not checked
- ai.txt not checked
Content Signals:
search=yes ai-train=no declared in robots.txt
AI Crawlers
15 of 33 AI crawlers blocked
Standards: Content Signals
Open Page Rank
0.99 / 10 · ranked #12,687,294 of all domains
1 referring domains · OpenPageRank