What powers
uncyc.org?
Last seen Jan 2026 · 12 technologies across 8 categories
Analytics
CDN
JavaScript graphics
JavaScript libraries
Miscellaneous
Performance
Programming languages
Wikis
AI Crawlers
Blocks 13 of 33 AI crawlers we track by name in its robots.txt, restricts 1 more. Checked Nov 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GoogleOther Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
- PetalBot Blocked
- Applebot Restricted
The other 19 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
Content Signals:
search=yes ai-train=no declared in robots.txt
- Oct 2026 cohere-ai added to robots.txt
- Oct 2026 petalbot added to robots.txt
- Oct 2026 applebot-extended added to robots.txt
- Oct 2026 anthropic-ai added to robots.txt
- Oct 2026 google-extended added to robots.txt
- Oct 2026 Content Signals changed
AI Crawlers
13 of 33 AI crawlers blocked
Standards: Content Signals
Open Page Rank
4.74 / 10 · ranked #285,274 of all domains
160 referring domains · OpenPageRank
Infrastructure
- Registered Aug 2006 (20 years) via Dynadot Inc, renews Aug 2027
- Hosted on Cloudflare (104.21.35.42)
- DNS: Cloudflare DNS
- Email: Zoho Mail
- Email security: no SPF record, no DMARC record
- SSL: Google Trust Services, ECDSA P256, wildcard, expires Dec 2026
- Common Crawl link graph: rank 74,137, 11 hosts
DNS records as swept Nov 2026, certificate as seen Nov 2026, registration from the registry's RDAP service. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| mirror.uncyc.org | 12 |
| fa.uncyc.org | 9 |
| www.uncyc.org | 4 |