What powers 
tokenomist.ai?
Last seen Oct 2026 · 40 technologies across 19 categories
Advertising
Analytics
Authentication
CDN
Development
Font scripts
Issue trackers
JavaScript frameworks
JavaScript graphics
JavaScript libraries
Miscellaneous
PaaS
Payment processors
Performance
Programming languages
Security
Tag managers
UI frameworks
AI Crawlers
Blocks 5 of 33 AI crawlers we track by name in its robots.txt, restricts 21 more. Checked Oct 2026. A recent check saw a policy file missing; awaiting confirmation.
Training crawlers
- CCBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- ImagesiftBot Blocked
- Webzio-Extended Blocked
- AI2Bot Restricted
- Applebot-Extended Restricted
- Bytespider Restricted
- ClaudeBot Restricted
- Google-CloudVertexBot Restricted
- Google-Extended Restricted
- GoogleOther Restricted
- GPTBot Restricted
- meta-externalagent Restricted
Search and AI assistants
- Amazonbot Restricted
- Claude-SearchBot Restricted
- DuckAssistBot Restricted
- OAI-SearchBot Restricted
- PerplexityBot Restricted
- YouBot Restricted
User-request fetchers
- ChatGPT-User Restricted
- Claude-User Restricted
- GoogleAgent-Mariner Restricted
- meta-externalfetcher Restricted
- MistralAI-User Restricted
- Perplexity-User Restricted
The other 7 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt found
- llms-full.txt found
- ai.txt not found
- Oct 2026 bytespider added to robots.txt
- Oct 2026 ccbot added to robots.txt
- Oct 2026 meta-externalagent added to robots.txt
- Oct 2026 claude-searchbot added to robots.txt
- Oct 2026 chatgpt-user added to robots.txt
- Oct 2026 amazonbot added to robots.txt
AI Crawlers
5 of 33 AI crawlers blocked
Standards: llms.txt, llms-full.txt
Audience
- 57% phone
- 41% desktop
- 2% tablet
India
Indonesia
Germany
Canada
Brazil
United Kingdom
Where the site's Chrome visitors come from, largest estimated audience first.
Open Page Rank
4.56 / 10 · ranked #393,158 of all domains
169 referring domains · OpenPageRank
Core Web Vitals
| LCP | 3.1 s |
| INP | 350 ms |
| CLS | 0 |
| TTFB | 700 ms |
Real user p75, Chrome UX Report, Sep 2026.
Page
- Language: English
- CDN: Vercel
- Weight: 1.3 MB · 81 requests
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Oct 2026.
Organisation
- Tokenomist
From the homepage's own structured data (Oct 2026).
Infrastructure
- Registered Jul 2024 (2 years) via GoDaddy.com, LLC, renews Jul 2028
- Hosted on Cloudflare (104.20.36.234, IPv6)
- DNS: Cloudflare DNS
- Email: Google Workspace
- Email security: SPF (hard fail), DMARC quarantine
- SSL: Google Trust Services, ECDSA P256, wildcard, expires Dec 2026
- Common Crawl link graph: rank 2,645,063, 7 hosts
- Verified with: Google, Stripe
DNS records as swept Oct 2026, certificate as seen Oct 2026, registration from the registry's RDAP service. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| tokenomist.ai | 28 |
| www.tokenomist.ai | 26 |
| docs.tokenomist.ai | 17 |
| listing.tokenomist.ai | 11 |
| enterprise.tokenomist.ai | 9 |
| feedback.tokenomist.ai | 9 |
| api.tokenomist.ai | 8 |
Full technology history →
Report an incorrect detection
Recent changes
- detected Base UI Aug 2026
- detected Twitter Ads Aug 2026
- detected core-js Jul 2026
- dropped shadcn/ui Jun 2026
- dropped Apache HTTP Server May 2026
- dropped Bootstrap May 2026
- dropped GitBook May 2026
- dropped Handlebars May 2026
- dropped jQuery May 2026
- dropped Moment.js May 2026
- dropped PHP May 2026
- dropped Popper May 2026
- dropped RSS May 2026
- dropped Twitter typeahead.js May 2026
- dropped Upvoty May 2026
- dropped Cart Functionality Apr 2026
- detected Google Font API Apr 2026
- detected shadcn/ui Apr 2026
- dropped ID5 Mar 2026
- detected PWA Mar 2026
- detected Amazon CloudFront Feb 2026
- detected Amazon S3 Feb 2026
- detected Amazon Web Services Feb 2026
- detected Element UI Feb 2026
- detected Tailwind CSS Feb 2026
- detected Vue.js Feb 2026
- detected Amplitude Jan 2026
- detected ECharts Jan 2026
- detected Google Analytics Jan 2026
- detected Google Sign-in Jan 2026
- detected Google Tag Manager Jan 2026
- detected Hotjar Jan 2026
- detected ID5 Jan 2026
- detected jsDelivr Jan 2026
- detected Microsoft Clarity Jan 2026
- detected Mixpanel Jan 2026
- dropped Amplitude Dec 2025
- detected Cart Functionality Dec 2025
- dropped ECharts Dec 2025
- dropped Google Analytics Dec 2025
- dropped Google Sign-in Dec 2025
- dropped Google Tag Manager Dec 2025
- dropped Hotjar Dec 2025
- dropped ID5 Dec 2025
- dropped jsDelivr Dec 2025
- dropped Microsoft Clarity Dec 2025
- dropped Mixpanel Dec 2025
- detected RSS Dec 2025