What powers thesmartscanner.com?
Last seen Oct 2026 · 11 technologies across 7 categories
Analytics
Caching
CDN
Miscellaneous
PaaS
Security
UI frameworks
AI Crawlers
Does not block any of the 33 AI crawlers we track in its robots.txt. Checked Oct 2026.
Training crawlers
- ClaudeBot Allowed
- Google-Extended Allowed
- GPTBot Allowed
Search and AI assistants
- Claude-SearchBot Allowed
- OAI-SearchBot Allowed
- PerplexityBot Allowed
User-request fetchers
- ChatGPT-User Allowed
The other 26 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt found
- ai.txt not found
- Sep 2026 claude-searchbot added to robots.txt
- Sep 2026 claudebot added to robots.txt
- Sep 2026 perplexitybot added to robots.txt
- Sep 2026 gptbot added to robots.txt
- Sep 2026 chatgpt-user added to robots.txt
- Sep 2026 oai-searchbot added to robots.txt
AI Crawlers
No AI crawlers blocked
Standards: llms.txt
Audience
- 56% desktop
- 44% phone
India
Where the site's Chrome visitors come from, largest estimated audience first.
Open Page Rank
2.21 / 10 · ranked #3,066,832 of all domains
14 referring domains · OpenPageRank
Core Web Vitals
| LCP | 1.5 s |
| CLS | 0 |
| TTFB | 800 ms |
Real user p75, Chrome UX Report, Oct 2026.
Page
- Language: English (United States)
- CDN: Cloudflare, Fastly
- Weight: 0.3 MB · 20 requests
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Oct 2026.
Organisation
From the homepage's own structured data (Oct 2026).
Infrastructure
- Hosted on Cloudflare (104.21.23.36, IPv6)
- DNS: Cloudflare DNS
- Email: Cloudflare Email Routing
- Email security: SPF (soft fail), DMARC reject, DNSSEC signed
- SSL: Google Trust Services, ECDSA P256, wildcard, expires Jan 2027
- Common Crawl link graph: rank 7,695,944
- Verified with: Google
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted