What powers agentrust-io.com?

Last seen Sep 2026 · 7 technologies across 5 categories

Analytics

Caching

Varnish
since Sep 2026

CDN

Cloudflare
since Sep 2026
Fastly
since Sep 2026

Miscellaneous

HTTP/3
since Sep 2026
Open Graph
since Sep 2026

PaaS

GitHub Pages
since Sep 2026

AI Crawlers

Does not block any of the 33 AI crawlers we track in its robots.txt. Checked Oct 2026.

Training crawlers

  • CCBot Allowed
  • ClaudeBot Allowed
  • Google-Extended Allowed
  • GPTBot Allowed

Search and AI assistants

  • Claude-SearchBot Allowed
  • OAI-SearchBot Allowed
  • PerplexityBot Allowed

User-request fetchers

  • ChatGPT-User Allowed
  • Claude-User Allowed
  • Perplexity-User Allowed

The other 23 AI crawlers we track are not mentioned and stay allowed by default.

See who blocks each AI crawler across the web

AI Crawlers

No AI crawlers blocked

Standards: llms.txt

Full breakdown

Infrastructure

  • Hosted on Cloudflare (104.21.77.130, IPv6)
  • DNS: Cloudflare DNS
  • Email: no MX record returned
  • Email security: SPF (hard fail), DMARC reject
  • SSL: Google Trust Services, ECDSA P256, wildcard, expires Jan 2027
  • Common Crawl link graph: rank 45,037,069, 3 hosts
  • Verified with: Google

DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted

Full technology history →
Report an incorrect detection

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018