What powers stargazed.net?
Last seen Jun 2024 · 7 technologies across 6 categories
Caching
CMS
Databases
Miscellaneous
Programming languages
Web servers
AI Crawlers
Blocks 7 of 33 AI crawlers we track by name in its robots.txt. Checked Nov 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Claude-SearchBot Allowed
- OAI-SearchBot Allowed
- PerplexityBot Allowed
User-request fetchers
- ChatGPT-User Allowed
- Claude-User Allowed
The other 21 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt not checked
- ai.txt not checked
Content Signals:
search=yes ai-train=no ai-input=yes declared in robots.txt
AI Crawlers
7 of 33 AI crawlers blocked
Standards: Content Signals
Open Page Rank
0.97 / 10 · ranked #13,197,204 of all domains
8 referring domains · OpenPageRank
Infrastructure
- DNS: Cloudflare DNS
- Email: no MX record returned
- Common Crawl link graph: rank 1,528,699
DNS records as swept Oct 2026. How the web is hosted