What powers 
ndcsydney.com?
Last seen Jul 2026 · 20 technologies across 12 categories
Analytics
CDN
CMS
Issue trackers
JavaScript frameworks
JavaScript libraries
Live chat
Marketing automation
Miscellaneous
PaaS
Programming languages
Security
AI Crawlers
Blocks 10 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
- Applebot Allowed
- Claude-SearchBot Allowed
- OAI-SearchBot Allowed
- PerplexityBot Allowed
User-request fetchers
- ChatGPT-User Allowed
- Claude-User Allowed
- Perplexity-User Allowed
The other 16 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- llms-full.txt found
- ai.txt not found
- Oct 2026 anthropic-ai added to robots.txt
- Oct 2026 applebot added to robots.txt
- Oct 2026 applebot-extended added to robots.txt
- Oct 2026 chatgpt-user added to robots.txt
- Oct 2026 ccbot added to robots.txt
- Oct 2026 bytespider added to robots.txt
AI Crawlers
10 of 33 AI crawlers blocked
Standards: llms.txt, llms-full.txt
Open Page Rank
4.45 / 10 · ranked #408,955 of all domains
88 referring domains · OpenPageRank
Infrastructure
- Hosted on Cloudflare (104.21.30.228, IPv6)
- DNS: Cloudflare DNS
- Email: GoDaddy Email
- Email security: no SPF record, no DMARC record
- SSL: Google Trust Services, ECDSA P256, wildcard, expires Dec 2026
- Common Crawl link graph: rank 7,032,629, 2 hosts
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted
Full technology history →
Report an incorrect detection
Recent changes
- dropped Babel Nov 2025
- detected Cloudflare Browser Insights Nov 2025
- dropped HSTS Nov 2025