What powers thecuriousgirldiaries.com?
Last seen Oct 2026 · 22 technologies across 14 categories
Analytics
CDN
Comment systems
Customer data platform
Ecommerce
Font scripts
Issue trackers
JavaScript libraries
Miscellaneous
Programming languages
Security
Video players
Web frameworks
Webmail
AI Crawlers
Blocks 7 of 33 AI crawlers we track by name in its robots.txt, restricts 6 more. Checked Nov 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Claude-SearchBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- Perplexity-User Restricted
The other 20 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not found
Content Signals:
search=yes ai-train=no ai-input=yes declared in robots.txt
- Nov 2026 meta-externalagent added to robots.txt
- Nov 2026 bytespider added to robots.txt
- Nov 2026 ccbot added to robots.txt
- Nov 2026 chatgpt-user added to robots.txt
- Nov 2026 applebot-extended added to robots.txt
- Nov 2026 llms.txt appeared
AI Crawlers
7 of 33 AI crawlers blocked
Standards: llms.txt, Content Signals
Open Page Rank
1.70 / 10 · ranked #4,936,770 of all domains
9 referring domains · OpenPageRank
Page
- Language: English
- CDN: Cloudflare
- Weight: 3.3 MB · 87 requests
- Structured data: OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Nov 2026.
Infrastructure
- Hosted on Cloudflare (104.21.34.86, IPv6)
- DNS: Cloudflare DNS
- Email: Microsoft 365
- Email security: SPF (hard fail), DMARC monitor only
- SSL: Google Trust Services, ECDSA P256, expires Jan 2027
- Common Crawl link graph: rank 1,083,218
DNS records as swept Oct 2026, certificate as seen Nov 2026. How the web is hosted
Full technology history →
Report an incorrect detection