What powers aiagentslibrary.com?
Last seen Aug 2026 · 17 technologies across 10 categories
Analytics
CDN
CMS
Databases
Ecommerce
JavaScript libraries
Miscellaneous
Performance
Programming languages
WordPress plugins
AI Crawlers
Blocks 9 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
- PetalBot Blocked
- Claude-SearchBot Allowed
- OAI-SearchBot Allowed
- PerplexityBot Allowed
User-request fetchers
- ChatGPT-User Allowed
- Claude-User Allowed
- meta-externalfetcher Allowed
The other 18 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- ai.txt not found
Content Signals:
search=yes ai-train=no declared in robots.txt
AI Crawlers
9 of 33 AI crawlers blocked
Standards: llms.txt, Content Signals
Audience
- 75% desktop
- 25% phone
United States
India
Germany
Canada
Brazil
United Kingdom
Where the site's Chrome visitors come from, largest estimated audience first.
Open Page Rank
0.28 / 10 · ranked #53,176,542 of all domains
1 referring domains · OpenPageRank
Core Web Vitals
| LCP | 2.7 s |
| INP | 50 ms |
| CLS | 0.05 |
| TTFB | 2400 ms |
Real user p75, Chrome UX Report, Aug 2026.
Page
- Language: English (United States)
- CDN: Cloudflare
- Weight: 0.5 MB · 39 requests
- WordPress theme: hello-elementor · all themes
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Aug 2026.
Full technology history →
Report an incorrect detection
Recent changes
- detected Cart Functionality Aug 2026
- detected core-js Aug 2026
- detected jQuery Aug 2026
- detected jQuery Migrate Aug 2026