What powers datamagnet.co?
Last seen Sep 2026 · 28 technologies across 15 categories
Advertising
Analytics
CDN
Development
Font scripts
JavaScript frameworks
Live chat
Miscellaneous
PaaS
Performance
Programming languages
Security
Tag managers
UI frameworks
Webmail
AI Crawlers
Restricts 7 of 33 AI crawlers we track by name in its robots.txt. Checked Sep 2026.
Training crawlers
- Google-Extended Restricted
Search and AI assistants
- Claude-SearchBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- Perplexity-User Restricted
The other 26 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not found
- Sep 2026 applebot-extended removed from robots.txt
- Sep 2026 bytespider removed from robots.txt
- Sep 2026 meta-externalagent removed from robots.txt
- Sep 2026 claudebot removed from robots.txt
- Sep 2026 amazonbot removed from robots.txt
- Sep 2026 gptbot removed from robots.txt
AI Crawlers
7 of 33 AI crawlers restricted
Standards: llms.txt
Open Page Rank
1.47 / 10 · ranked #6,792,266 of all domains
8 referring domains · OpenPageRank
Page
- Language: English
- CDN: Cloudflare
- Weight: 2.3 MB · 109 requests
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Sep 2026.
Organisation
From the homepage's own structured data (Sep 2026).
Infrastructure
- Hosted on Cloudflare (104.26.6.16, IPv6)
- DNS: Cloudflare DNS
- Email: no MX record returned, SPF names Google Workspace
- Email security: SPF (soft fail), DMARC monitor only
- SSL: Google Trust Services, ECDSA P256, wildcard, expires Oct 2026
- Common Crawl link graph: rank 27,677,866, 3 hosts
- Verified with: Google
DNS records as swept Sep 2026, certificate as seen Sep 2026. How the web is hosted