What powers tokei.io?
Last seen Sep 2026 · 19 technologies across 11 categories
Analytics
CDN
Issue trackers
JavaScript frameworks
Miscellaneous
PaaS
Performance
Programming languages
Security
UI frameworks
AI Crawlers
Restricts 15 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- Applebot-Extended Restricted
- ClaudeBot Restricted
- cohere-training-data-crawler Restricted
- Google-Extended Restricted
- GPTBot Restricted
- meta-externalagent Restricted
Search and AI assistants
- Amazonbot Restricted
- Claude-SearchBot Restricted
- DuckAssistBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- MistralAI-User Restricted
- Perplexity-User Restricted
The other 18 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not found
AI Crawlers
15 of 33 AI crawlers restricted
Standards: llms.txt
Audience
- 67% desktop
- 33% phone
United States
United Kingdom
Canada
Where the site's Chrome visitors come from, largest estimated audience first.
Core Web Vitals
| LCP | 3.8 s |
| INP | 175 ms |
| CLS | 0.15 |
| TTFB | 1600 ms |
Real user p75, Chrome UX Report, Sep 2026.
Page
- Language: English
- CDN: Netlify
- Weight: 1.9 MB · 110 requests
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Oct 2026.
Organisation
From the homepage's own structured data (Oct 2026).