What powers
petdiets.com?
Last seen Sep 2026 · 14 technologies across 6 categories
Analytics
CDN
Font scripts
JavaScript libraries
Miscellaneous
Web frameworks
AI Crawlers
Blocks 13 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GoogleOther Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
- PetalBot Blocked
The other 20 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
Content Signals:
search=yes ai-train=no declared in robots.txt
- Oct 2026 ccbot added to robots.txt
- Oct 2026 claude-web added to robots.txt
- Oct 2026 claudebot added to robots.txt
- Oct 2026 bytespider added to robots.txt
- Oct 2026 Content Signals changed
- Oct 2026 amazonbot added to robots.txt
AI Crawlers
13 of 33 AI crawlers blocked
Standards: Content Signals
Audience
- 74% desktop
- 26% phone
United States
Where the site's Chrome visitors come from, largest estimated audience first.
Open Page Rank
4.41 / 10 · ranked #415,848 of all domains
149 referring domains · OpenPageRank
Core Web Vitals
| LCP | 1.4 s |
| INP | 25 ms |
| CLS | 0 |
| TTFB | 800 ms |
Real user p75, Chrome UX Report, Sep 2026.
Page
- Language: English
- CDN: Cloudflare
- Weight: 0.9 MB · 74 requests
Homepage as crawled by the HTTP Archive, Oct 2026.
Infrastructure
- Registered Sep 1999 (27 years) via Register.com - Network Solutions, LLC, renews Sep 2027
- Hosted on Cloudflare (104.21.26.237, IPv6)
- DNS: Cloudflare DNS
- Email: no MX record returned
- SSL: Let's Encrypt, ECDSA P256, wildcard, expires Dec 2026
- Common Crawl link graph: rank 606,514, 2 hosts
DNS records as swept Oct 2026, certificate as seen Oct 2026, registration from the registry's RDAP service. How the web is hosted
Full technology history →
Report an incorrect detection
Recent changes
- detected Google Font API Aug 2026
- detected Highlight.js Aug 2026
- detected lit-element Aug 2026
- detected lit-html Aug 2026
- dropped IIS Jul 2026
- dropped Windows Server Jul 2026
- detected Cloudflare Jun 2026
- detected Cloudflare Browser Insights Jun 2026
- detected HTTP/3 Jun 2026