What powers shiwatensile.com?
Last seen Jul 2026 · 27 technologies across 15 categories
Advertising
CDN
Databases
Documentation
Ecommerce
Font scripts
JavaScript frameworks
JavaScript libraries
Maps
Miscellaneous
Personalisation
Programming languages
Reviews
RUM
Security
AI Crawlers
Blocks 8 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
The other 25 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt not checked
- ai.txt not checked
Content Signals:
search=yes ai-train=no declared in robots.txt
AI Crawlers
8 of 33 AI crawlers blocked
Standards: Content Signals
Open Page Rank
1.44 / 10 · ranked #7,108,743 of all domains
16 referring domains · OpenPageRank