What powers linesandveils.com?
Last seen Aug 2026 · 4 technologies across 3 categories
Analytics
Cloudflare Browser Insights
since Jul 2026
GoatCounter
since Jul 2026
CDN
Cloudflare
since Jul 2026
Miscellaneous
HTTP/3
since Jul 2026
AI Crawlers
Blocks 8 of 33 AI crawlers we track by name in its robots.txt, restricts 24 more. Checked Aug 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
- AI2Bot Restricted
- cohere-training-data-crawler Restricted
- Diffbot Restricted
- FacebookBot Restricted
- Google-CloudVertexBot Restricted
- GoogleOther Restricted
- ImagesiftBot Restricted
- img2dataset Restricted
- PanguBot Restricted
- SBIntuitionsBot Restricted
- Webzio-Extended Restricted
Search and AI assistants
- Amazonbot Blocked
- Applebot Restricted
- Claude-SearchBot Restricted
- DuckAssistBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
- PetalBot Restricted
- YouBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- GoogleAgent-Mariner Restricted
- meta-externalfetcher Restricted
- MistralAI-User Restricted
- Perplexity-User Restricted
The other 1 AI crawler we track is not mentioned and only inherits the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
Content Signals:
search=yes ai-train=no declared in robots.txt