What powers bilitxt.com?
Last seen Aug 2026 · 8 technologies across 8 categories
Analytics
51.LA
since Jul 2026
CMS
WordPress
since Jul 2026
Databases
MySQL
since Jul 2026
JavaScript libraries
Programming languages
PHP
since Jul 2026
Security
HSTS
since Jul 2026
Video players
VideoJS
since Jul 2026
Web servers
Nginx
since Jul 2026
AI Crawlers
Blocks 4 of 33 AI crawlers we track by name in its robots.txt, restricts 1 more. Checked Aug 2026.
Training crawlers
- Bytespider Blocked
- CCBot Blocked
Search and AI assistants
- Amazonbot Blocked
- PetalBot Blocked
- Applebot Restricted
The other 28 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not checked
- ai.txt not checked