What powers cookie.engineer?
Last seen Oct 2026 · 5 technologies across 4 categories
Caching
CDN
Miscellaneous
PaaS
AI Crawlers
Blocks all crawlers by default in robots.txt (User-agent: *). Checked Oct 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
Search and AI assistants
- Amazonbot Blocked
- PerplexityBot Blocked
User-request fetchers
- ChatGPT-User Blocked
- Perplexity-User Blocked
The other 23 AI crawlers we track are not mentioned and are blocked by the catch-all rule (User-agent: *).
- robots.txt found
- llms.txt not checked
- ai.txt not checked
Content Signals:
search=yes ai-train=no ai-input=yes declared in robots.txt
AI Crawlers
All crawlers blocked
Standards: Content Signals
Open Page Rank
2.21 / 10 · ranked #3,071,545 of all domains
13 referring domains · OpenPageRank
Search traffic
2 est. monthly organic visits (US)
28 keywords in Google's top 30
Page
- Language: English
- CDN: Fastly
- Weight: 4.6 MB · 209 requests
- Structured data: Microdata, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Oct 2026.
Infrastructure
- Hosted on Fastly (185.199.108.153, IPv6)
- Email: no MX record returned
- Common Crawl link graph: rank 2,054,128
DNS records as swept Aug 2026. How the web is hosted
Full technology history →
Report an incorrect detection
Recent changes
- dropped Ruby Jan 2026
- dropped Ruby on Rails Jan 2026
- dropped Wheelio Jan 2026