What powers dobebe.com?
Last seen Nov 2024 · 18 technologies across 15 categories
Advertising
DoubleClick Ad Exchange (AdX)
since Jan 2019
Google AdSense
since Jan 2019
Analytics
Google Analytics
since Jan 2019
Blogs
Caching
CDN
Cloudflare
since Feb 2021
Databases
MySQL
since Jan 2019
Ecommerce
Cart Functionality
since Feb 2021
Font scripts
Google Font API
since Jan 2019
JavaScript libraries
Miscellaneous
HTTP/3
since Nov 2024
Twitter Emoji (Twemoji)
since Jan 2019
Programming languages
PHP
since Jan 2019
Reverse proxies
Nginx
since Aug 2019
Tag managers
Google Tag Manager
since Feb 2021
UI frameworks
Webmail
Google Workspace
since Nov 2024
AI Crawlers
Blocks 29 of 33 AI crawlers we track by name in its robots.txt. Checked Nov 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- img2dataset Blocked
- meta-externalagent Blocked
- PanguBot Blocked
- SBIntuitionsBot Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Amazonbot Blocked
- Claude-SearchBot Blocked
- DuckAssistBot Blocked
- OAI-SearchBot Blocked
- PerplexityBot Blocked
- YouBot Blocked
User-request fetchers
- ChatGPT-User Blocked
- Claude-User Blocked
- GoogleAgent-Mariner Blocked
- meta-externalfetcher Blocked
- MistralAI-User Blocked
- Perplexity-User Blocked
The other 4 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
- Oct 2026 claude-searchbot added to robots.txt
- Oct 2026 claude-user added to robots.txt
- Oct 2026 claude-web added to robots.txt
- Oct 2026 mistralai-user added to robots.txt
- Oct 2026 cohere-ai added to robots.txt
- Oct 2026 claudebot added to robots.txt
AI Crawlers
29 of 33 AI crawlers blocked
Open Page Rank
0.47 / 10 · ranked #26,303,878 of all domains
3 referring domains · OpenPageRank
Infrastructure
- Hosted on Cloudflare (104.21.22.165, IPv6)
- DNS: Cloudflare DNS
- Email: Google Workspace
- Email security: no SPF record, no DMARC record
- SSL: Google Trust Services, ECDSA P256, wildcard, expires Jan 2027
- Common Crawl link graph: rank 3,716,408, 2 hosts
- Verified with: Google
DNS records as swept Oct 2026, certificate as seen Nov 2026. How the web is hosted
Subdomains
| Host | Techs |
|---|---|
| dobebe.com | 14 |
| www.dobebe.com | 8 |