What powers nyt.com?
Last seen Jul 2023 · 36 technologies across 24 categories
Advertising
Analytics
Authentication
CDN
Cookie compliance
Customer data platform
Digital asset management
Ecommerce
IaaS
Issue trackers
JavaScript frameworks
JavaScript libraries
Miscellaneous
PaaS
Performance
Programming languages
Security
Segmentation
Tag managers
UI frameworks
Video players
Web servers
Webmail
AI Crawlers
Blocks 21 of 33 AI crawlers we track by name in its robots.txt, restricts 2 more. Checked Sep 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- meta-externalagent Blocked
- Webzio-Extended Blocked
- Google-CloudVertexBot Restricted
Search and AI assistants
- Claude-SearchBot Blocked
- DuckAssistBot Blocked
- OAI-SearchBot Blocked
- PerplexityBot Blocked
- YouBot Blocked
- Amazonbot Restricted
User-request fetchers
- ChatGPT-User Blocked
- Claude-User Blocked
- meta-externalfetcher Blocked
- Perplexity-User Blocked
The other 10 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
AI Crawlers
21 of 33 AI crawlers blocked
Audience
- 100% desktop
United States
Where the site's Chrome visitors come from, largest estimated audience first.
Open Page Rank
8.33 / 10 · ranked #3,637 of all domains
7,743 referring domains · OpenPageRank
Core Web Vitals
| LCP | 4.3 s |
| CLS | 0.15 |
| TTFB | 100 ms |
Real user p75, Chrome UX Report, Aug 2026.
Infrastructure
- Registered Oct 1994 (31 years) via MarkMonitor Inc., renews Oct 2027
- Hosted on Fastly (151.101.1.164)
- DNS: IBM NS1
- Email: Google Workspace
- Email security: SPF (soft fail), DMARC reject
- SSL: DigiCert, RSA 2048, wildcard, expires Mar 2027
- Common Crawl link graph: rank 5,387, 28 hosts
- Verified with: Google
DNS records as swept Sep 2026, certificate as seen Sep 2026, registration from the registry's RDAP service. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| www.nyt.com | 34 |
| nyt.com | 31 |