What powers job-scouts.com?

Last seen Oct 2026 · 16 technologies across 12 categories

Analytics

Google Analytics
since Aug 2026

CDN

cdnjs
since Aug 2026
Cloudflare
since Aug 2026
jsDelivr
since Aug 2026

Font scripts

Font Awesome v6.5.0
since Aug 2026
Google Font API
since Aug 2026

Hosting

GoDaddy
since Aug 2026

Live chat

WhatsApp Business Chat
since Aug 2026

Miscellaneous

Open Graph
since Aug 2026
PWA
since Aug 2026

Operating systems

Ubuntu
since Aug 2026

Programming languages

Python
since Aug 2026

Security

HSTS
since Aug 2026

UI frameworks

Bootstrap v5.3.2
since Aug 2026

Web frameworks

Django
since Aug 2026

Web servers

Nginx v1.18.0
since Aug 2026

AI Crawlers

Blocks 1 of 33 AI crawlers we track by name in its robots.txt, restricts 6 more. Checked Oct 2026.

Training crawlers

  • Bytespider Restricted
  • CCBot Restricted
  • ClaudeBot Restricted
  • GPTBot Restricted
  • meta-externalagent Restricted

Search and AI assistants

  • PetalBot Blocked
  • Amazonbot Restricted

The other 26 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.

  • robots.txt found
  • llms.txt not found
  • ai.txt not found
  • Oct 2026 bytespider added to robots.txt
  • Oct 2026 petalbot added to robots.txt
  • Oct 2026 meta-externalagent added to robots.txt
  • Oct 2026 claudebot added to robots.txt
  • Oct 2026 ccbot added to robots.txt
  • Oct 2026 gptbot added to robots.txt

See who blocks each AI crawler across the web

AI Crawlers

1 of 33 AI crawlers blocked

Full breakdown

Infrastructure

DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted

Full technology history →
Report an incorrect detection

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018