What powers codegyan.in?
Last seen Aug 2026 · 22 technologies across 11 categories
Analytics
CDN
Font scripts
JavaScript frameworks
JavaScript libraries
Marketing automation
Miscellaneous
Programming languages
Security
Tag managers
UI frameworks
AI Crawlers
Blocks 8 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026. A recent check saw a policy file missing; awaiting confirmation.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
The other 25 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
Content Signals:
search=yes ai-train=no declared in robots.txt
AI Crawlers
8 of 33 AI crawlers blocked
Standards: Content Signals
Open Page Rank
1.44 / 10 · ranked #7,123,550 of all domains
5 referring domains · OpenPageRank
Infrastructure
- Hosted on Cloudflare (104.21.43.142)
- DNS: fleshdns.net
- Email: no MX record returned
- Email security: SPF (soft fail)
- SSL: Let's Encrypt, RSA 2048, wildcard, expires Jan 2027
- Common Crawl link graph: rank 27,647,964, 2 hosts
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted