What powers austinharvest.org?
Last seen Aug 2026 · 20 technologies across 13 categories
CDN
CMS
Databases
Ecommerce
Font scripts
JavaScript frameworks
JavaScript libraries
Miscellaneous
Performance
Programming languages
Security
Widgets
WordPress plugins
AI Crawlers
Blocks 8 of 33 AI crawlers we track by name in its robots.txt. Checked Sep 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
The other 25 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt not found
- ai.txt not found
Content Signals:
search=yes ai-train=no declared in robots.txt
- Sep 2026 bytespider added to robots.txt
- Sep 2026 amazonbot added to robots.txt
- Sep 2026 applebot-extended added to robots.txt
- Sep 2026 meta-externalagent added to robots.txt
- Sep 2026 ccbot added to robots.txt
- Sep 2026 claudebot added to robots.txt
AI Crawlers
8 of 33 AI crawlers blocked
Standards: Content Signals
Open Page Rank
1.01 / 10 · ranked #12,325,039 of all domains
2 referring domains · OpenPageRank
Search traffic
24 est. monthly organic visits (US)
5 keywords in Google's top 30
Infrastructure
- Hosted on Cloudflare (104.18.12.215, IPv6)
- DNS: Cloudflare DNS
- Email: no MX record returned
- SSL: Let's Encrypt, ECDSA P256, wildcard, expires Dec 2026
- Common Crawl link graph: rank 7,825,000, 4 hosts
- Verified with: Google
DNS records as swept Sep 2026, certificate as seen Sep 2026. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| austinharvest.org | 17 |
| fresh.austinharvest.org | 4 |