What powers denshub.com?

Last seen Oct 2026 · 8 technologies across 5 categories

Analytics

Umami
since Apr 2026

CDN

Cloudflare
since Aug 2022

Miscellaneous

HTTP/3
since Sep 2022
Open Graph
since Sep 2022
PWA
since Aug 2022
RSS
since Dec 2022

Performance

Priority Hints
since Jun 2026

Security

HSTS
since Apr 2023

AI Crawlers

Blocks 1 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.

Training crawlers

  • Applebot-Extended Allowed
  • Bytespider Allowed
  • CCBot Allowed
  • ClaudeBot Allowed
  • cohere-training-data-crawler Allowed
  • Diffbot Allowed
  • Google-Extended Allowed
  • GPTBot Allowed
  • ImagesiftBot Allowed
  • meta-externalagent Allowed

Search and AI assistants

  • PetalBot Blocked
  • Amazonbot Allowed
  • Applebot Allowed
  • DuckAssistBot Allowed
  • OAI-SearchBot Allowed
  • PerplexityBot Allowed

User-request fetchers

  • ChatGPT-User Allowed
  • meta-externalfetcher Allowed
  • Perplexity-User Allowed

The other 14 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.

See who blocks each AI crawler across the web

AI Crawlers

1 of 33 AI crawlers blocked

Standards: llms.txt

Full breakdown

Open Page Rank

1.39 / 10 · ranked #7,557,461 of all domains

8 referring domains · OpenPageRank

Search traffic

95 est. monthly organic visits (US)

176 keywords in Google's top 30

Page

  • Language: English
  • CDN: Cloudflare
  • Weight: 0.1 MB · 13 requests
  • Structured data: JSON-LD, Microdata, OpenGraph, Twitter Cards

Homepage as crawled by the HTTP Archive, Oct 2026.

Organisation

From the homepage's own structured data (Oct 2026).

Infrastructure

  • Hosted on Cloudflare (104.21.20.192, IPv6)
  • DNS: Cloudflare DNS
  • Email: Fastmail
  • Email security: SPF (soft fail), DMARC reject, DNSSEC signed, CAA
  • SSL: Google Trust Services, ECDSA P256, wildcard, expires Jan 2027
  • Common Crawl link graph: rank 2,167,806, 3 hosts
  • Verified with: Google, OpenAI, Pinterest

DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted

Full technology history →
Report an incorrect detection

Recent changes

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018