What powers negotiateit.ai?
Last seen Aug 2026 · 8 technologies across 7 categories
Analytics
Cloudflare Browser Insights
since Jul 2026
CDN
Cloudflare
since Jul 2026
Miscellaneous
HTTP/3
since Jul 2026
Open Graph
since Jul 2026
PaaS
Fly.io
since Jul 2026
Security
HSTS
since Jul 2026
UI frameworks
Tailwind CSS
since Jul 2026
Webmail
Google Workspace
since Jul 2026
AI Crawlers
Restricts 12 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- Applebot-Extended Restricted
- CCBot Restricted
- ClaudeBot Restricted
- GPTBot Restricted
- meta-externalagent Restricted
Search and AI assistants
- Amazonbot Restricted
- Applebot Restricted
- Claude-SearchBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
The other 21 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not found