What powers nicholesliney.com?
Last seen Sep 2026 · 29 technologies across 15 categories
Authentication
CDN
Font scripts
Hosting
JavaScript frameworks
JavaScript graphics
JavaScript libraries
Maps
Miscellaneous
Performance
Programming languages
Security
UI frameworks
Web servers
Webmail
AI Crawlers
Blocks 1 of 33 AI crawlers we track by name in its robots.txt, restricts 14 more. Checked Sep 2026. A recent check saw a policy file missing; awaiting confirmation.
Training crawlers
- Bytespider Blocked
- Applebot-Extended Restricted
- CCBot Restricted
- ClaudeBot Restricted
- Google-Extended Restricted
- GPTBot Restricted
- meta-externalagent Restricted
Search and AI assistants
- Applebot Restricted
- Claude-SearchBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- meta-externalfetcher Restricted
- Perplexity-User Restricted
The other 18 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- llms-full.txt found
- ai.txt found
- Sep 2026 applebot-extended added to robots.txt
- Sep 2026 bytespider: Blocked (was Restricted)
- Sep 2026 meta-externalagent added to robots.txt
- Sep 2026 meta-externalfetcher added to robots.txt
AI Crawlers
1 of 33 AI crawlers blocked
Standards: llms.txt, llms-full.txt, ai.txt
Open Page Rank
0.11 / 10 · ranked #85,198,451 of all domains
0 referring domains · OpenPageRank
Infrastructure
- Hosted on Amazon Web Services (34.210.134.29)
- DNS: GoDaddy DNS
- Email: Google Workspace
- Email security: SPF (soft fail), DMARC monitor only
- SSL: Let's Encrypt, RSA 2048, expires Nov 2026
- Common Crawl link graph: rank 17,004,264, 2 hosts
- Verified with: Google
DNS records as swept Sep 2026, certificate as seen Sep 2026. How the web is hosted
Full technology history →
Report an incorrect detection
Recent changes
- dropped Branch Dec 2025