What powers spiderfan.org?
Last seen Sep 2026 · 6 technologies across 5 categories
Font scripts
JavaScript libraries
Operating systems
UI frameworks
Web servers
AI Crawlers
Blocks 8 of 33 AI crawlers we track by name in its robots.txt. Checked Sep 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
The other 25 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt not found
- ai.txt not found
Content Signals:
search=yes ai-train=no ai-input=no declared in robots.txt
AI Crawlers
8 of 33 AI crawlers blocked
Standards: Content Signals
Audience
- 58% phone
- 38% desktop
- 4% tablet
United States
United Kingdom
Canada
Brazil
Italy
Mexico
Where the site's Chrome visitors come from, largest estimated audience first.
Open Page Rank
3.21 / 10 · ranked #1,257,245 of all domains
69 referring domains · OpenPageRank
Core Web Vitals
| LCP | 1.3 s |
| INP | 50 ms |
| CLS | 0 |
| TTFB | 700 ms |
Real user p75, Chrome UX Report, Sep 2026.
Page
- Language: English
- Weight: 0.5 MB · 37 requests
Homepage as crawled by the HTTP Archive, Oct 2026.
Infrastructure
- Hosted on DigitalOcean (206.189.2.120)
- DNS: domaindiscover.com
- Email: Fastmail
- Email security: SPF (neutral), no DMARC record
- SSL: Let's Encrypt, RSA 2048, expires Dec 2026
- Common Crawl link graph: rank 756,302, 2 hosts
DNS records as swept Sep 2026, certificate as seen Sep 2026. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| spiderfan.org | 6 |
| www.spiderfan.org | 6 |