What powers digger.mx?

Last seen Aug 2026 · 13 technologies across 9 categories

Analytics

CDN

Cloudflare
since Apr 2023

Development

Turbopack
since Jul 2026

JavaScript frameworks

Next.js v16.2.9
since Jul 2026
Next.js App Router
since Jul 2026
React
since Nov 2019

Miscellaneous

HTTP/3
since Apr 2026
Open Graph
since Sep 2022
Webpack
since Jul 2026

Performance

Priority Hints
since May 2024

Programming languages

Node.js
since Jul 2026

UI frameworks

Tailwind CSS
since Jul 2026

Webmail

Google Workspace
since Aug 2022

AI Crawlers

Blocks 8 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.

Training crawlers

  • Applebot-Extended Blocked
  • Bytespider Blocked
  • CCBot Blocked
  • ClaudeBot Blocked
  • Google-Extended Blocked
  • GPTBot Blocked
  • meta-externalagent Blocked

Search and AI assistants

  • Amazonbot Blocked

The other 25 AI crawlers we track are not mentioned and stay allowed by default.

  • robots.txt found
  • llms.txt not found
  • ai.txt not found

Content Signals: search=yes ai-train=no declared in robots.txt

See who blocks each AI crawler across the web

AI Crawlers

8 of 33 AI crawlers blocked

Standards: Content Signals

Full breakdown

Open Page Rank

1.44 / 10 · ranked #7,087,288 of all domains

7 referring domains · OpenPageRank

Page

  • Language: Spanish
  • CDN: Cloudflare
  • Weight: 0.2 MB · 16 requests
  • Structured data: OpenGraph, Twitter Cards

Homepage as crawled by the HTTP Archive, Aug 2026.

Full technology history →
Report an incorrect detection

Recent changes

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018