What powers bingobrawlers.com?

Last seen Sep 2026 · 13 technologies across 10 categories

Analytics

CDN

Cloudflare
since Jun 2026

Font scripts

Google Font API
since Jun 2026

JavaScript frameworks

Angular v20.3.21
since Jun 2026
Zone.js
since Jun 2026

JavaScript libraries

jQuery v3.7.1
since Jun 2026

Miscellaneous

HTTP/3
since Jun 2026
Open Graph
since Mar 2023
PWA
since Jun 2026

Programming languages

TypeScript
since Jun 2026

Security

HSTS
since Jun 2026

UI frameworks

Tailwind CSS
since Aug 2026

Web servers

Nginx
since Mar 2023

AI Crawlers

Blocks 13 of 33 AI crawlers we track by name in its robots.txt. Checked Nov 2026.

Training crawlers

  • Applebot-Extended Blocked
  • Bytespider Blocked
  • CCBot Blocked
  • ClaudeBot Blocked
  • cohere-training-data-crawler Blocked
  • Diffbot Blocked
  • Google-CloudVertexBot Blocked
  • Google-Extended Blocked
  • GoogleOther Blocked
  • GPTBot Blocked
  • meta-externalagent Blocked

Search and AI assistants

  • Amazonbot Blocked
  • PetalBot Blocked

The other 20 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.

  • robots.txt found
  • llms.txt not checked
  • ai.txt not checked

Content Signals: search=yes ai-train=no declared in robots.txt

  • Oct 2026 ccbot added to robots.txt
  • Oct 2026 claude-web added to robots.txt
  • Oct 2026 claudebot added to robots.txt
  • Oct 2026 bytespider added to robots.txt
  • Oct 2026 Content Signals changed
  • Oct 2026 amazonbot added to robots.txt

See who blocks each AI crawler across the web

AI Crawlers

13 of 33 AI crawlers blocked

Standards: Content Signals

Full breakdown

Open Page Rank

0.47 / 10 · ranked #26,320,567 of all domains

3 referring domains · OpenPageRank

Search traffic

92 est. monthly organic visits (US)

116 keywords in Google's top 30

Infrastructure

  • Hosted on Cloudflare (104.21.21.141, IPv6)
  • DNS: Cloudflare DNS
  • Email: no MX record returned
  • Email security: SPF (hard fail), DMARC reject
  • SSL: Let's Encrypt, ECDSA P256, wildcard, expires Dec 2026
  • Common Crawl link graph: rank 14,291,895, 2 hosts
  • Verified with: Google

DNS records as swept Oct 2026, certificate as seen Nov 2026. How the web is hosted

Subdomains

HostTechs
bingobrawlers.com 11
old.bingobrawlers.com 2

Full technology history →
Report an incorrect detection

Recent changes

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018