What powers pricinglab.org?
Last seen Sep 2026 · 14 technologies across 12 categories
Analytics
CDN
CMS
Databases
Hosting
JavaScript libraries
Miscellaneous
PaaS
Page builders
Performance
Programming languages
Web servers
AI Crawlers
Blocks 8 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
The other 25 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt not found
- ai.txt not found
Content Signals:
search=yes ai-train=no declared in robots.txt
- Sep 2026 bytespider added to robots.txt
- Sep 2026 *: Allowed (was Restricted)
- Sep 2026 amazonbot added to robots.txt
- Sep 2026 applebot-extended added to robots.txt
- Sep 2026 meta-externalagent added to robots.txt
- Sep 2026 ccbot added to robots.txt
AI Crawlers
8 of 33 AI crawlers blocked
Standards: Content Signals
Audience
- 100% desktop
United States
Where the site's Chrome visitors come from, largest estimated audience first.
Open Page Rank
4.62 / 10 · ranked #383,386 of all domains
84 referring domains · OpenPageRank
Core Web Vitals
| LCP | 0.7 s |
| CLS | 0 |
| TTFB | 400 ms |
Real user p75, Chrome UX Report, Sep 2026.
Page
- Language: English
- CDN: Cloudflare
- Weight: 1.3 MB · 22 requests
Homepage as crawled by the HTTP Archive, Sep 2026.
Infrastructure
- Hosted on Cloudflare (104.21.33.169, IPv6)
- DNS: Cloudflare DNS
- Email: no MX record returned
- SSL: Google Trust Services, ECDSA P256, expires Dec 2026
- Common Crawl link graph: rank 2,087,359, 2 hosts
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted