What powers agentrust-io.com?
Last seen Sep 2026 · 7 technologies across 5 categories
Analytics
Cloudflare Browser Insights
since Sep 2026
Caching
Varnish
since Sep 2026
CDN
Cloudflare
since Sep 2026
Fastly
since Sep 2026
Miscellaneous
HTTP/3
since Sep 2026
Open Graph
since Sep 2026
PaaS
GitHub Pages
since Sep 2026
AI Crawlers
Does not block any of the 33 AI crawlers we track in its robots.txt. Checked Oct 2026.
Training crawlers
- CCBot Allowed
- ClaudeBot Allowed
- Google-Extended Allowed
- GPTBot Allowed
Search and AI assistants
- Claude-SearchBot Allowed
- OAI-SearchBot Allowed
- PerplexityBot Allowed
User-request fetchers
- ChatGPT-User Allowed
- Claude-User Allowed
- Perplexity-User Allowed
The other 23 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt found
- ai.txt not found
Infrastructure
- Hosted on Cloudflare (104.21.77.130, IPv6)
- DNS: Cloudflare DNS
- Email: no MX record returned
- Email security: SPF (hard fail), DMARC reject
- SSL: Google Trust Services, ECDSA P256, wildcard, expires Jan 2027
- Common Crawl link graph: rank 45,037,069, 3 hosts
- Verified with: Google
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted