What powers technewsinsight.com?

Last seen Sep 2024 · 20 technologies across 14 categories

Advertising

Google AdSense
since Jul 2021

Analytics

Google Analytics
since Jul 2021

Caching

WP Rocket
since Jul 2021

CDN

Cloudflare
since Jul 2021

CMS

WordPress v6.5.2
since Jul 2021

Databases

MySQL
since Jul 2021

Font scripts

Font Awesome
since Oct 2021
Google Font API
since Jul 2021

JavaScript libraries

jQuery v3.7.1
since Jul 2021
jQuery Migrate v3.4.1
since Oct 2021

Miscellaneous

HTTP/3
since Sep 2022
Open Graph
since Sep 2022
RSS
since Dec 2022

Performance

Priority Hints
since Aug 2023

Programming languages

PHP
since Jul 2021

Security

reCAPTCHA
since Apr 2022

UI frameworks

Bootstrap v4.3.1
since Jul 2021

WordPress plugins

Site Kit v1.134.0
since Aug 2023
Yoast SEO v23.4
since Jul 2021

AI Crawlers

Blocks 13 of 33 AI crawlers we track by name in its robots.txt. Checked Nov 2026.

Training crawlers

  • Applebot-Extended Blocked
  • Bytespider Blocked
  • CCBot Blocked
  • ClaudeBot Blocked
  • cohere-training-data-crawler Blocked
  • Diffbot Blocked
  • Google-CloudVertexBot Blocked
  • Google-Extended Blocked
  • GoogleOther Blocked
  • GPTBot Blocked
  • meta-externalagent Blocked

Search and AI assistants

  • Amazonbot Blocked
  • PetalBot Blocked

The other 20 AI crawlers we track are not mentioned and stay allowed by default.

  • robots.txt found
  • llms.txt not checked
  • ai.txt not checked

Content Signals: search=yes ai-train=no declared in robots.txt

  • Nov 2026 ccbot added to robots.txt
  • Nov 2026 claude-web added to robots.txt
  • Nov 2026 claudebot added to robots.txt
  • Nov 2026 bytespider added to robots.txt
  • Nov 2026 Content Signals changed
  • Nov 2026 amazonbot added to robots.txt

See who blocks each AI crawler across the web

AI Crawlers

13 of 33 AI crawlers blocked

Standards: Content Signals

Full breakdown

Open Page Rank

1.51 / 10 · ranked #6,420,008 of all domains

14 referring domains · OpenPageRank

Infrastructure

  • Hosted on Cloudflare (104.21.17.19, IPv6)
  • DNS: Cloudflare DNS
  • Email: no MX record returned
  • SSL: Let's Encrypt, ECDSA P256, wildcard, expires Dec 2026
  • Common Crawl link graph: rank 7,853,825

DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted

Full technology history →
Report an incorrect detection

Look up any website for free

No paywall, no lead-gen, no account. Paste a domain and see what powers it.

No account neededHistory since 2018