What powers woof.tech?
Last seen Aug 2026 · 8 technologies across 7 categories
JavaScript frameworks
JavaScript libraries
Message boards
Miscellaneous
Programming languages
Security
Web frameworks
AI Crawlers
Blocks all crawlers by default in robots.txt (User-agent: *). Checked Sep 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- img2dataset Blocked
- meta-externalagent Blocked
- PanguBot Blocked
- SBIntuitionsBot Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Amazonbot Blocked
- Claude-SearchBot Blocked
- DuckAssistBot Blocked
- OAI-SearchBot Blocked
- PerplexityBot Blocked
- PetalBot Blocked
- YouBot Blocked
User-request fetchers
- Claude-User Blocked
- GoogleAgent-Mariner Blocked
- meta-externalfetcher Blocked
- MistralAI-User Blocked
The other 5 AI crawlers we track are not mentioned and are blocked by the catch-all rule (User-agent: *).
- robots.txt found
- llms.txt not checked
- ai.txt not checked
Content Signals:
search=yes ai-train=no ai-input=no declared in robots.txt
AI Crawlers
All crawlers blocked
Standards: Content Signals
Open Page Rank
4.56 / 10 · ranked #392,831 of all domains
108 referring domains · OpenPageRank
Page
- Language: English
- Weight: 16.5 MB · 138 requests
- Structured data: OpenGraph
Homepage as crawled by the HTTP Archive, Aug 2026.
Full technology history →
Report an incorrect detection
Recent changes
- dropped Webpack Nov 2025