What powers todayyoushouldknow.com?
Last seen Sep 2026 · 34 technologies across 18 categories
Advertising
Analytics
CDN
CMS
Ecommerce
Font scripts
JavaScript frameworks
JavaScript libraries
Load balancers
Marketing automation
Miscellaneous
PaaS
Performance
Security
Segmentation
Tag managers
Webmail
AI Crawlers
Restricts 16 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- AI2Bot Restricted
- Applebot-Extended Restricted
- Bytespider Restricted
- CCBot Restricted
- ClaudeBot Restricted
- cohere-training-data-crawler Restricted
- FacebookBot Restricted
- Google-Extended Restricted
- GoogleOther Restricted
- GPTBot Restricted
- img2dataset Restricted
- meta-externalagent Restricted
- Webzio-Extended Restricted
Search and AI assistants
- Amazonbot Restricted
- DuckAssistBot Restricted
- YouBot Restricted
The other 17 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
AI Crawlers
16 of 33 AI crawlers restricted
Open Page Rank
0.94 / 10 · ranked #13,829,437 of all domains
5 referring domains · OpenPageRank
Page
- Language: English (United States)
- Weight: 4.9 MB · 197 requests
- Structured data: JSON-LD, Microdata, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Oct 2026.
Infrastructure
- Hosted on Squarespace (198.49.23.144)
- DNS: Google Cloud DNS
- Email: no MX record returned, SPF names Google Workspace
- Email security: SPF (soft fail), DMARC monitor only, DNSSEC signed
- SSL: Let's Encrypt, RSA 2048, expires Jan 2027
- Common Crawl link graph: rank 9,371,994
DNS records as swept Sep 2026, certificate as seen Oct 2026. How the web is hosted
Full technology history →
Report an incorrect detection
Recent changes
- dropped Angular Sep 2026
- dropped reCAPTCHA Sep 2026
- dropped Sentry Sep 2026
- dropped TypeScript Sep 2026
- dropped Zone.js Sep 2026
- detected Sentry Jun 2026
- detected Mautic May 2026
- detected Angular Apr 2026
- detected TypeScript Apr 2026
- detected Zone.js Apr 2026
- dropped Mautic Mar 2026
- dropped Microsoft ASP.NET Mar 2026
- detected Mautic Nov 2025
- detected Rubicon Project Nov 2025