What powers builtbylds.com?
Last seen Jul 2026 · 15 technologies across 12 categories
Analytics
CDN
CMS
IaaS
Issue trackers
JavaScript frameworks
JavaScript libraries
Miscellaneous
Performance
Security
UI frameworks
Webmail
AI Crawlers
Blocks 9 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
- PetalBot Blocked
The other 24 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not checked
Content Signals:
search=yes ai-train=no declared in robots.txt
AI Crawlers
9 of 33 AI crawlers blocked
Standards: llms.txt, Content Signals
Open Page Rank
0.42 / 10 · ranked #32,287,414 of all domains
2 referring domains · OpenPageRank
Full technology history →
Report an incorrect detection
Recent changes
- detected Bootstrap Jul 2026
- detected Cloudflare Jul 2026
- detected Cloudflare Browser Insights Jul 2026
- detected Google Cloud Jul 2026
- detected Google Cloud CDN Jul 2026
- detected Google Workspace Jul 2026
- detected GSAP Jul 2026
- detected HSTS Jul 2026
- detected HTTP/3 Jul 2026
- detected Lodash Jul 2026
- detected Open Graph Jul 2026
- detected Priority Hints Jul 2026
- detected React Jul 2026
- detected Sentry Jul 2026
- detected Wix Jul 2026
- dropped Cart Functionality Jun 2026
- dropped Choices Jun 2026
- dropped core-js Jun 2026
- dropped Google Font API Jun 2026
- dropped Modernizr Jun 2026
- dropped Squarespace Jun 2026
- dropped Squarespace Commerce Jun 2026
- dropped Stimulus Jun 2026
- dropped Typekit Jun 2026
- dropped YouTube Jun 2026
- dropped YUI Jun 2026