What powers ibfv.org?
Last seen Jul 2026 · 10 technologies across 4 categories
Analytics
Matomo Analytics
since Jul 2026
JavaScript libraries
Miscellaneous
Open Graph
since Jul 2026
Web servers
Apache HTTP Server
since Jul 2026
AI Crawlers
Blocks 22 of 33 AI crawlers we track by name in its robots.txt, restricts 8 more. Checked Aug 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GoogleOther Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- img2dataset Blocked
- meta-externalagent Blocked
- PanguBot Blocked
- SBIntuitionsBot Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Amazonbot Blocked
- PetalBot Blocked
- YouBot Blocked
- Claude-SearchBot Restricted
- DuckAssistBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- meta-externalfetcher Blocked
- ChatGPT-User Restricted
- Claude-User Restricted
- MistralAI-User Restricted
- Perplexity-User Restricted
The other 3 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
AI Crawlers
22 of 33 AI crawlers blocked
Open Page Rank
0.42 / 10 · ranked #32,623,428 of all domains
1 referring domains · OpenPageRank