What powers tidywl.com?
Last seen Sep 2026 · 10 technologies across 8 categories
Caching
CDN
Font scripts
Miscellaneous
PaaS
Performance
Video players
Widgets
AI Crawlers
Does not block any of the 33 AI crawlers we track in its robots.txt. Checked Sep 2026.
Training crawlers
- Applebot-Extended Allowed
- Bytespider Allowed
- CCBot Allowed
- ClaudeBot Allowed
- cohere-training-data-crawler Allowed
- Google-CloudVertexBot Allowed
- Google-Extended Allowed
- GPTBot Allowed
- meta-externalagent Allowed
Search and AI assistants
- Amazonbot Allowed
- Claude-SearchBot Allowed
- OAI-SearchBot Allowed
- PerplexityBot Allowed
User-request fetchers
- ChatGPT-User Allowed
- Claude-User Allowed
- Perplexity-User Allowed
The other 17 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt found
- ai.txt not found
AI Crawlers
No AI crawlers blocked
Standards: llms.txt
Open Page Rank
1.27 / 10 · ranked #8,983,780 of all domains
2 referring domains · OpenPageRank
Page
- Language: English
- CDN: Cloudflare, Fastly
- Weight: 0.2 MB · 7 requests
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Sep 2026.
Organisation
- TidyWL
- Industry: Software and apps (declares
SoftwareApplication) - Profiles: GitHub
From the homepage's own structured data (Sep 2026).
Full technology history →
Report an incorrect detection
Recent changes
- detected HTTP/3 Sep 2026
- detected Priority Hints Sep 2026