What powers marcusgoll.com?
Last seen Jul 2026 · 18 technologies across 11 categories
Analytics
Authentication
CDN
Development
Issue trackers
JavaScript frameworks
Miscellaneous
Performance
Programming languages
Security
UI frameworks
AI Crawlers
Blocks 9 of 33 AI crawlers we track by name in its robots.txt, restricts 6 more. Checked Aug 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- FacebookBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
- Claude-SearchBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- Perplexity-User Restricted
The other 18 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not found
Content Signals:
search=yes ai-train=no declared in robots.txt
AI Crawlers
9 of 33 AI crawlers blocked
Standards: llms.txt, Content Signals
Open Page Rank
0.99 / 10 · ranked #12,691,570 of all domains
1 referring domains · OpenPageRank
Page
- Language: English
- CDN: Cloudflare
- Weight: 0.8 MB · 51 requests
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Sep 2026.
Full technology history →
Report an incorrect detection
Recent changes
- dropped Cart Functionality Jul 2026
- dropped Ghost Jul 2026
- dropped Google AdSense Jul 2026
- dropped Google Font API Jul 2026
- dropped Gravatar Jul 2026
- dropped jsDelivr Jul 2026
- dropped LazySizes Jul 2026
- dropped Nginx Jul 2026
- dropped reCAPTCHA Jul 2026
- dropped RSS Jul 2026
- dropped Stripe Jul 2026
- dropped Tinybird Jul 2026
- dropped Ubuntu Jul 2026
- dropped Umami Jul 2026
- dropped Express Nov 2025
- detected HTTP/3 Nov 2025
- detected Next.js Nov 2025
- detected Next.js App Router Nov 2025
- detected Priority Hints Nov 2025
- detected Tailwind CSS Nov 2025
- detected Turbopack Nov 2025
- detected Webpack Nov 2025
- detected Tinybird Oct 2025