What powers astrocollioure.fr?
Last seen Aug 2026 · 8 technologies across 7 categories
CDN
Cloudflare
since Aug 2025
CMS
JavaScript libraries
Miscellaneous
RSS
since Aug 2023
Programming languages
Security
Cloudflare Bot Management
since Aug 2025
HSTS
since Sep 2022
Web servers
Apache HTTP Server
since Sep 2020
AI Crawlers
Blocks 32 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GoogleOther Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- img2dataset Blocked
- meta-externalagent Blocked
- PanguBot Blocked
- SBIntuitionsBot Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Amazonbot Blocked
- Applebot Blocked
- Claude-SearchBot Blocked
- DuckAssistBot Blocked
- OAI-SearchBot Blocked
- PerplexityBot Blocked
- PetalBot Blocked
- YouBot Blocked
User-request fetchers
- ChatGPT-User Blocked
- Claude-User Blocked
- GoogleAgent-Mariner Blocked
- meta-externalfetcher Blocked
- MistralAI-User Blocked
- Perplexity-User Blocked
The other 1 AI crawler we track is not mentioned and only inherits the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
AI Crawlers
32 of 33 AI crawlers blocked
Open Page Rank
1.53 / 10 · ranked #6,277,545 of all domains
6 referring domains · OpenPageRank
Page
- Language: French
- Weight: 1.0 MB · 36 requests
- Structured data: Microdata
Homepage as crawled by the HTTP Archive, Aug 2026.