What powers esmerit.com?
Last seen Jun 2026 · 22 technologies across 12 categories
Analytics
CDN
JavaScript frameworks
JavaScript libraries
Live chat
Marketing automation
Miscellaneous
Security
Surveys
Tag managers
UI frameworks
Webmail
AI Crawlers
Blocks 5 of 33 AI crawlers we track by name in its robots.txt, restricts 4 more. Checked Aug 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- meta-externalagent Blocked
- ClaudeBot Restricted
- GPTBot Restricted
- Google-Extended Allowed
Search and AI assistants
- Amazonbot Blocked
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
The other 23 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not found
Content Signals:
search=yes ai-train=no declared in robots.txt
AI Crawlers
5 of 33 AI crawlers blocked
Standards: llms.txt, Content Signals
Open Page Rank
0.40 / 10 · ranked #35,898,548 of all domains
2 referring domains · OpenPageRank
Page
- Language: English
- CDN: Cloudflare
- Weight: 4.4 MB · 102 requests
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Sep 2026.
Full technology history →
Report an incorrect detection