What powers bookstodon.com?
Last seen Jun 2026 · 10 technologies across 8 categories
Mailgun
since Feb 2023
JavaScript frameworks
React
since Feb 2023
JavaScript libraries
Message boards
Mastodon
since Feb 2023
Miscellaneous
Programming languages
Ruby
since Feb 2023
Security
HSTS
since Feb 2023
Web frameworks
Ruby on Rails
since Feb 2023
AI Crawlers
Blocks all crawlers by default in robots.txt (User-agent: *). Checked Sep 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GoogleOther Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- img2dataset Blocked
- meta-externalagent Blocked
- PanguBot Blocked
- SBIntuitionsBot Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Amazonbot Blocked
- Applebot Blocked
- Claude-SearchBot Blocked
- DuckAssistBot Blocked
- OAI-SearchBot Blocked
- PerplexityBot Blocked
- PetalBot Blocked
- YouBot Blocked
User-request fetchers
- ChatGPT-User Blocked
- Claude-User Blocked
- GoogleAgent-Mariner Blocked
- meta-externalfetcher Blocked
- MistralAI-User Blocked
- Perplexity-User Blocked
The other 2 AI crawlers we track are not mentioned and are blocked by the catch-all rule (User-agent: *).
- robots.txt found
- llms.txt not checked
- ai.txt not checked
AI Crawlers
All crawlers blocked
Open Page Rank
3.52 / 10 · ranked #870,514 of all domains
69 referring domains · OpenPageRank