What powers setthesun.com?
Last seen Jul 2026 · 64 technologies across 28 categories
Advertising
Analytics
CDN
CMS
Customer data platform
Ecommerce
Font scripts
Issue trackers
JavaScript frameworks
JavaScript libraries
Live chat
Load balancers
Maps
Miscellaneous
PaaS
Payment processors
Performance
Photo galleries
Programming languages
RUM
Security
Surveys
Tag managers
Video players
Web frameworks
Web servers
Webmail
Widgets
AI Crawlers
Blocks 8 of 33 AI crawlers we track by name in its robots.txt. Checked Sep 2026. A recent check saw a policy file missing; awaiting confirmation.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
The other 25 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt not found
- ai.txt not found
Content Signals:
search=yes ai-train=no declared in robots.txt
AI Crawlers
8 of 33 AI crawlers blocked
Standards: Content Signals
Open Page Rank
0.46 / 10 · ranked #28,505,175 of all domains
3 referring domains · OpenPageRank
Infrastructure
- Hosted on Cloudflare (104.21.1.85, IPv6)
- DNS: Cloudflare DNS
- Email: no MX record returned
- SSL: Google Trust Services, ECDSA P256, wildcard, expires Oct 2026
- Common Crawl link graph: rank 18,582,360, 2 hosts
DNS records as swept Sep 2026, certificate as seen Sep 2026. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| www.setthesun.com | 51 |
| music.setthesun.com | 22 |
| who.setthesun.com | 6 |