What powers thagomizer.com?
Last seen Oct 2026 · 11 technologies across 10 categories
Analytics
Databases
Font scripts
JavaScript libraries
Miscellaneous
Programming languages
Security
Static site generator
UI frameworks
Web Servers
AI Crawlers
Restricts 9 of 33 AI crawlers we track by name in its robots.txt. Checked Nov 2026.
Training crawlers
- Applebot-Extended Restricted
- ClaudeBot Restricted
- Google-Extended Restricted
- GPTBot Restricted
Search and AI assistants
- Claude-SearchBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
The other 24 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- llms-full.txt found
- ai.txt not found
Content Signals:
search=yes ai-train=yes ai-input=yes declared in robots.txt
- Oct 2026 llms.txt appeared
- Oct 2026 chatgpt-user added to robots.txt
- Oct 2026 applebot-extended added to robots.txt
- Oct 2026 claude-searchbot added to robots.txt
- Oct 2026 llms-full.txt appeared
- Oct 2026 Content Signals changed
AI Crawlers
9 of 33 AI crawlers restricted
Standards: llms.txt, llms-full.txt, Content Signals
Open Page Rank
3.51 / 10 · ranked #878,564 of all domains
42 referring domains · OpenPageRank
Infrastructure
- Hosted on Fastly (151.101.1.195)
- DNS: dnsimple-edge.com
- Email: no MX record returned
- SSL: Google Trust Services, RSA 2048, expires Jan 2027
- Common Crawl link graph: rank 104,215, 2 hosts
- Verified with: Google
DNS records as swept Nov 2026, certificate as seen Nov 2026. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| thagomizer.com | 9 |
| www.thagomizer.com | 3 |