What powers sciop.net?
Last seen Aug 2026 · 4 technologies across 4 categories
Hosting
GoDaddy
since Apr 2025
JavaScript libraries
Htmx
since Apr 2025
Miscellaneous
PWA
since Apr 2025
Web servers
AI Crawlers
Blocks 26 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-Extended Blocked
- GoogleOther Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- img2dataset Blocked
- meta-externalagent Blocked
- PanguBot Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Amazonbot Blocked
- Applebot Blocked
- DuckAssistBot Blocked
- OAI-SearchBot Blocked
- PerplexityBot Blocked
- PetalBot Blocked
- YouBot Blocked
User-request fetchers
- ChatGPT-User Blocked
- meta-externalfetcher Blocked
- Perplexity-User Blocked
The other 7 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
AI Crawlers
26 of 33 AI crawlers blocked
Open Page Rank
2.97 / 10 · ranked #1,633,529 of all domains
28 referring domains · OpenPageRank
Page
- Language: English
- Weight: 0.2 MB · 34 requests
Homepage as crawled by the HTTP Archive, Aug 2026.