What powers jobnestin.com?
Last seen Sep 2026 · 10 technologies across 8 categories
Advertising
Google AdSense
since Sep 2026
Blogs
Blogger
since Sep 2026
Font scripts
Google Font API
since Sep 2026
Miscellaneous
Open Graph
since Sep 2026
RSS
since Sep 2026
Performance
Priority Hints
since Sep 2026
Programming languages
Security
reCAPTCHA
since Sep 2026
Web servers
OpenGSE
since Sep 2026
AI Crawlers
Blocks 18 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GoogleOther Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
- PetalBot Blocked
User-request fetchers
- ChatGPT-User Blocked
- Claude-User Blocked
- meta-externalfetcher Blocked
- MistralAI-User Blocked
- Perplexity-User Blocked
The other 15 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt not checked
- ai.txt not checked
Content Signals:
search=yes ai-train=no declared in robots.txt
Infrastructure
- Hosted on Cloudflare (104.21.43.159, IPv6)
- DNS: Cloudflare DNS
- Email: no MX record returned
- SSL: Let's Encrypt, ECDSA P256, wildcard, expires Dec 2026
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted