What powers theroboticsmedia.com?
Last seen Oct 2026 · 14 technologies across 10 categories
Analytics
Google Analytics
since Oct 2026
CDN
Bunny
since Sep 2026
Cloudflare
since Jul 2026
CMS
Contentstack
since Oct 2026
Sanity
since Sep 2026
Hosting panels
Plesk
since Jul 2026
Miscellaneous
Open Graph
since Jul 2026
RSS
since Jul 2026
Performance
Priority Hints
since Sep 2026
Programming languages
Security
Cloudflare Bot Management
since Jul 2026
HSTS
since Jul 2026
UI frameworks
Tailwind CSS
since Jul 2026
Web servers
Nginx
since Jul 2026
AI Crawlers
Restricts 17 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- Applebot-Extended Restricted
- Bytespider Restricted
- CCBot Restricted
- ClaudeBot Restricted
- Google-Extended Restricted
- GPTBot Restricted
- meta-externalagent Restricted
Search and AI assistants
- Amazonbot Restricted
- Applebot Restricted
- Claude-SearchBot Restricted
- DuckAssistBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
- YouBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- meta-externalfetcher Restricted
- Perplexity-User Restricted
The other 16 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- llms-full.txt found
- ai.txt not checked
Page
- Language: English
- Weight: 14.5 MB · 52 requests
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Oct 2026.
Organisation
- The Robotics Media
- Industry: News and media (declares
NewsMediaOrganization) - Profiles: LinkedIn, X, YouTube, Instagram, Facebook
From the homepage's own structured data (Oct 2026).
Infrastructure
- Hosted on YONCU (185.169.55.113)
- DNS: theroboticsmedia.com
- Email: theroboticsmedia.com
- Email security: SPF (hard fail), DMARC quarantine
- SSL: Let's Encrypt, RSA 2048, wildcard, expires Dec 2026
- Common Crawl link graph: rank 10,026,746
- Verified with: Google, LinkedIn
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted
Full technology history →
Report an incorrect detection
Recent changes
- detected Contentstack Oct 2026
- detected Google Analytics Oct 2026
- detected Bunny Sep 2026
- dropped Contentful Sep 2026
- dropped Imgix Sep 2026
- detected Priority Hints Sep 2026
- detected Sanity Sep 2026