What powers mastodonien.de?
Last seen Dec 2025 · 3 technologies across 3 categories
Miscellaneous
Open Graph
since Dec 2022
Security
HSTS
since Dec 2022
Web servers
Apache HTTP Server
since Dec 2022
AI Crawlers
Blocks 28 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- img2dataset Blocked
- meta-externalagent Blocked
- PanguBot Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Amazonbot Blocked
- Applebot Blocked
- Claude-SearchBot Blocked
- DuckAssistBot Blocked
- OAI-SearchBot Blocked
- PerplexityBot Blocked
- PetalBot Blocked
- YouBot Blocked
User-request fetchers
- ChatGPT-User Blocked
- Claude-User Blocked
- meta-externalfetcher Blocked
- Perplexity-User Blocked
The other 5 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
AI Crawlers
28 of 33 AI crawlers blocked
Open Page Rank
1.77 / 10 · ranked #4,542,868 of all domains
12 referring domains · OpenPageRank
Subdomains
| Host | Techs |
|---|---|
| mastodonien.de | 3 |
| www.mastodonien.de | 3 |