What powers 
unixsheikh.com?
Last seen Feb 2024 · 3 technologies across 2 categories
Miscellaneous
Web servers
Apache HTTP Server
since Mar 2020
AI Crawlers
Blocks 32 of 33 AI crawlers we track by name in its robots.txt. Checked Sep 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GoogleOther Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- img2dataset Blocked
- meta-externalagent Blocked
- PanguBot Blocked
- SBIntuitionsBot Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Amazonbot Blocked
- Applebot Blocked
- Claude-SearchBot Blocked
- DuckAssistBot Blocked
- OAI-SearchBot Blocked
- PerplexityBot Blocked
- PetalBot Blocked
- YouBot Blocked
User-request fetchers
- ChatGPT-User Blocked
- Claude-User Blocked
- GoogleAgent-Mariner Blocked
- meta-externalfetcher Blocked
- MistralAI-User Blocked
- Perplexity-User Blocked
The other 1 AI crawler we track is not mentioned and only inherits the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
AI Crawlers
32 of 33 AI crawlers blocked
Open Page Rank
3.96 / 10 · ranked #599,016 of all domains
102 referring domains · OpenPageRank
Infrastructure
- Hosted on SENTIA (46.183.138.100)
- DNS: gigahost.dk
- Email: gigahost.dk
- Email security: SPF (hard fail), DMARC reject, MTA-STS, BIMI
- SSL: DigiCert, RSA 2048, expires Oct 2026
- Common Crawl link graph: rank 2,080,538, 2 hosts
DNS records as swept Sep 2026, certificate as seen Sep 2026. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| unixsheikh.com | 3 |
| www.unixsheikh.com | 3 |