What powers 
paragraph.xyz?
Last seen Mar 2025 · 17 technologies across 10 categories
Analytics
Issue trackers
JavaScript frameworks
Miscellaneous
PaaS
Performance
Programming languages
Security
UI frameworks
AI Crawlers
Restricts 9 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- ClaudeBot Restricted
- cohere-training-data-crawler Restricted
- GPTBot Restricted
- meta-externalagent Restricted
Search and AI assistants
- Amazonbot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
- YouBot Restricted
User-request fetchers
- ChatGPT-User Restricted
The other 24 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not found
Content Signals:
search=yes ai-train=yes ai-input=yes declared in robots.txt
- Sep 2026 llms-full.txt removed
- Sep 2026 Content Signals changed
- Sep 2026 claude-web added to robots.txt
- Sep 2026 chatgpt-user added to robots.txt
- Sep 2026 claudebot added to robots.txt
- Sep 2026 amazonbot added to robots.txt
AI Crawlers
9 of 33 AI crawlers restricted
Standards: llms.txt, Content Signals
Open Page Rank
6.50 / 10 · ranked #75,708 of all domains
546 referring domains · OpenPageRank
Infrastructure
- Registered May 2020 (6 years) via GoDaddy.com, LLC, renews May 2027
- Hosted on Amazon Web Services (64.239.109.193)
- DNS: Cloudflare DNS
- Email: Google Workspace
- Email security: no SPF record, no DMARC record
- SSL: Google Trust Services, ECDSA P256, wildcard, expires Dec 2026
- Common Crawl link graph: rank 643,010, 8 hosts
DNS records as swept Oct 2026, certificate as seen Oct 2026, registration from the registry's RDAP service. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| paragraph.xyz | 16 |
| docs.paragraph.xyz | 10 |