What powers arstidir.com?
Last seen Aug 2026 · 22 technologies across 14 categories
Analytics
Google Analytics
since Feb 2019
CMS
Ecommerce
Font scripts
Google Font API
since Feb 2019
Hosting
Issue trackers
Sentry
since Jan 2023
JavaScript libraries
Miscellaneous
Open Graph
since Nov 2022
RSS
since Dec 2022
Operating systems
CentOS
since Feb 2023
Performance
Priority Hints
since Aug 2025
Security
HSTS
since Nov 2023
Video players
YouTube
since Feb 2019
Web servers
Widgets
SoundCloud
since Nov 2022
Spotify Widgets
since Nov 2022
AI Crawlers
Restricts 16 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- AI2Bot Restricted
- Applebot-Extended Restricted
- Bytespider Restricted
- CCBot Restricted
- ClaudeBot Restricted
- cohere-training-data-crawler Restricted
- FacebookBot Restricted
- Google-Extended Restricted
- GoogleOther Restricted
- GPTBot Restricted
- img2dataset Restricted
- meta-externalagent Restricted
- Webzio-Extended Restricted
Search and AI assistants
- Amazonbot Restricted
- DuckAssistBot Restricted
- YouBot Restricted
The other 17 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
AI Crawlers
16 of 33 AI crawlers restricted
Open Page Rank
3.04 / 10 · ranked #1,523,975 of all domains
69 referring domains · OpenPageRank
Page
- Language: English (United States)
- Weight: 7.3 MB · 235 requests
- Structured data: JSON-LD, Microdata, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Sep 2026.
Subdomains
| Host | Techs |
|---|---|
| www.arstidir.com | 19 |
| arstidir.com | 16 |