What powers 
theaiinsider.tech?
Last seen Sep 2026 · 27 technologies across 13 categories
Analytics
CDN
CMS
Databases
Font scripts
JavaScript libraries
Marketing automation
Miscellaneous
Performance
Programming languages
Security
WordPress plugins
WordPress themes
AI Crawlers
Blocks 4 of 33 AI crawlers we track by name in its robots.txt, restricts 14 more. Checked Oct 2026.
Training crawlers
- Bytespider Blocked
- meta-externalagent Blocked
- CCBot Restricted
- ClaudeBot Restricted
- FacebookBot Restricted
- GPTBot Restricted
Search and AI assistants
- Amazonbot Blocked
- PetalBot Blocked
- Applebot Restricted
- Claude-SearchBot Restricted
- DuckAssistBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- meta-externalfetcher Restricted
- MistralAI-User Restricted
- Perplexity-User Restricted
The other 15 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
- Oct 2026 oai-searchbot: Restricted (was Allowed)
- Oct 2026 claudebot: Restricted (was Allowed)
- Oct 2026 duckassistbot added to robots.txt
- Oct 2026 claude-user: Restricted (was Allowed)
- Oct 2026 applebot: Restricted (was Blocked)
- Oct 2026 ccbot added to robots.txt
Top search keywords
| Keyword | Position | Est. monthly visits |
|---|---|---|
| inceptive | #39 | 770 |
| amazon kindle direct publishing | #76 | 420 |
| kindle direct publishing | #83 | 420 |
| artificial intelligence news | #32 | 130 |
| aka | #48 | 130 |
| global industrial | #28 | 110 |
| rhombus power | #4 | 58 |
| ai insider | #1 | 52 |
| nudge | #70 | 47 |
| c3 ai | #61 | 43 |
| songkick | #21 | 42 |
| venture global stock | #92 | 31 |
| the human protein atlas | #75 | 25 |
| unido | #28 | 25 |
| human protein atlas | #68 | 25 |
| stealth startup | #79 | 21 |
| khosla ventures | #80 | 21 |
| frontier series | #67 | 21 |
| tags hardware | #55 | 14 |
| accio | #60 | 14 |
| capital craft | #53 | 11 |
| r&d foods | #43 | 11 |
| amazon frontier | #78 | 11 |
| nature biotechnology | #43 | 11 |
| lux capital management | #97 | 11 |
The site's top keywords in Google (US), with the visits each one is estimated to bring per month.
Top backlinks
Top links pointing at the site, one per source domain, strongest first. The anchor text opens the page carrying the link.
AI Crawlers
4 of 33 AI crawlers blocked
Audience
- 61% desktop
- 39% phone
United States
India
United Kingdom
Canada
Where the site's Chrome visitors come from, largest estimated audience first.
Open Page Rank
5.74 / 10 · ranked #133,697 of all domains
312 referring domains · OpenPageRank
Search traffic
3,400 est. monthly organic visits (US)
3,664 keywords in Google's top 30
Core Web Vitals
| LCP | 2.2 s |
| INP | 50 ms |
| CLS | 0 |
| TTFB | 900 ms |
Real user p75, Chrome UX Report, Sep 2026.
Page
- Language: English (United States)
- CDN: Cloudflare
- Weight: 1.8 MB · 149 requests
- WordPress theme: hello-elementor (child: hello-theme-child-master) · all themes
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Oct 2026.
Infrastructure
- Registered Apr 2023 (3 years) via NameCheap, Inc., renews Apr 2027
- Hosted on Cloudflare (104.26.12.15, IPv6)
- DNS: Cloudflare DNS
- Email: no MX record returned
- SSL: Google Trust Services, ECDSA P256, wildcard, expires Dec 2026
- Common Crawl link graph: rank 469,389, 2 hosts
- Verified with: Google
DNS records as swept Oct 2026, certificate as seen Oct 2026, registration from the registry's RDAP service. How the web is hosted
Full technology history →
Report an incorrect detection
Recent changes
- dropped HSTS Aug 2026
- dropped HubSpot Chat Aug 2026
- detected Cloudflare Browser Insights Nov 2025