What powers professionprompts.com?
Last seen Aug 2026 · 17 technologies across 11 categories
Analytics
Plausible
since Jul 2026
Authentication
Clerk
since Jul 2026
CDN
Cloudflare
since Jul 2026
Netlify
since Jul 2026
Development
Turbopack
since Jul 2026
Ecommerce
Gumroad
since Jul 2026
JavaScript frameworks
Miscellaneous
Performance
Priority Hints
since Jul 2026
Programming languages
Node.js
since Jul 2026
Security
Cloudflare Bot Management
since Jul 2026
HSTS
since Jul 2026
UI frameworks
Tailwind CSS
since Jul 2026
AI Crawlers
Restricts 16 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- Applebot-Extended Restricted
- CCBot Restricted
- ClaudeBot Restricted
- Google-Extended Restricted
- GPTBot Restricted
- meta-externalagent Restricted
Search and AI assistants
- Amazonbot Restricted
- Claude-SearchBot Restricted
- DuckAssistBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- meta-externalfetcher Restricted
- MistralAI-User Restricted
- Perplexity-User Restricted
The other 17 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not found
Page
- Language: English
- CDN: Netlify
- Weight: 1.4 MB · 51 requests
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Aug 2026.