What powers browsertobuyer.com?
Last seen Aug 2026 · 27 technologies across 16 categories
Analytics
CDN
CMS
Cookie compliance
Databases
Font scripts
JavaScript libraries
Miscellaneous
Programming languages
Security
Tag managers
UI frameworks
Video players
Web servers
Webmail
WordPress plugins
AI Crawlers
Blocks 10 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Diffbot Blocked
- FacebookBot Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- meta-externalagent Blocked
- Webzio-Extended Blocked
- Applebot-Extended Allowed
- Google-Extended Allowed
Search and AI assistants
- Amazonbot Blocked
- Claude-SearchBot Allowed
- OAI-SearchBot Allowed
- PerplexityBot Allowed
User-request fetchers
- ChatGPT-User Allowed
- Claude-User Allowed
- Perplexity-User Allowed
The other 15 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
AI Crawlers
10 of 33 AI crawlers blocked
Open Page Rank
1.68 / 10 · ranked #5,076,301 of all domains
12 referring domains · OpenPageRank
Page
- Language: English (United States)
- Weight: 2.7 MB · 174 requests
- WordPress theme: browse-to-buyer · all themes
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Aug 2026.
Full technology history →
Report an incorrect detection
Recent changes
- dropped Apache HTTP Server Aug 2026
- dropped HSTS Aug 2026
- detected HTTP/3 Aug 2026
- detected LiteSpeed Aug 2026
- dropped Crazy Egg May 2026