What powers blockmachine.io?
Last seen Aug 2026 · 19 technologies across 12 categories
Analytics
CDN
Development
Issue trackers
JavaScript frameworks
JavaScript graphics
Miscellaneous
Performance
Programming languages
Security
UI frameworks
Webmail
AI Crawlers
Blocks 7 of 33 AI crawlers we track by name in its robots.txt, restricts 4 more. Checked Oct 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
- Claude-SearchBot Restricted
- OAI-SearchBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
The other 22 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not found
- Oct 2026 chatgpt-user added to robots.txt
- Oct 2026 claude-searchbot added to robots.txt
- Oct 2026 claude-user added to robots.txt
- Oct 2026 oai-searchbot added to robots.txt
AI Crawlers
7 of 33 AI crawlers blocked
Standards: llms.txt
Open Page Rank
0.70 / 10 · ranked #19,352,820 of all domains
2 referring domains · OpenPageRank
Page
- Language: English
- CDN: Cloudflare
- Weight: 1.5 MB · 63 requests
- Structured data: OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Oct 2026.
Infrastructure
- Hosted on Cloudflare (104.21.61.132)
- DNS: Cloudflare DNS
- Email: Google Workspace
- Email security: no SPF record, no DMARC record
- SSL: Google Trust Services, ECDSA P256, wildcard, expires Dec 2026
- Common Crawl link graph: rank 8,862,802
DNS records as swept Sep 2026, certificate as seen Oct 2026. How the web is hosted
Full technology history →
Report an incorrect detection
Recent changes
- detected Cloudflare Jul 2026
- detected Cloudflare Browser Insights Jul 2026
- detected Cloudflare Turnstile Jul 2026
- detected Google Analytics Jul 2026
- detected Google Workspace Jul 2026
- detected HSTS Jul 2026
- detected HTTP/3 Jul 2026
- detected Next.js Jul 2026
- detected Next.js App Router Jul 2026
- detected Node.js Jul 2026
- detected Open Graph Jul 2026
- detected Priority Hints Jul 2026
- detected React Jul 2026
- detected Recharts Jul 2026
- detected RxJS Jul 2026
- detected Sentry Jul 2026
- detected Tailwind CSS Jul 2026
- detected Turbopack Jul 2026
- detected Webpack Jul 2026
- detected Recharts Apr 2026
- detected Google Analytics Mar 2026