What powers crcds.edu?
Last seen Sep 2026 · 12 technologies across 8 categories
Analytics
CDN
JavaScript libraries
Miscellaneous
Security
Tag managers
Web frameworks
Webmail
AI Crawlers
Blocks 30 of 33 AI crawlers we track by name in its robots.txt. Checked Oct 2026.
Training crawlers
- AI2Bot Blocked
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- cohere-training-data-crawler Blocked
- Diffbot Blocked
- FacebookBot Blocked
- Google-CloudVertexBot Blocked
- Google-Extended Blocked
- GoogleOther Blocked
- GPTBot Blocked
- ImagesiftBot Blocked
- img2dataset Blocked
- meta-externalagent Blocked
- PanguBot Blocked
- SBIntuitionsBot Blocked
- Webzio-Extended Blocked
Search and AI assistants
- Amazonbot Blocked
- Applebot Blocked
- Claude-SearchBot Blocked
- DuckAssistBot Blocked
- OAI-SearchBot Blocked
- PerplexityBot Blocked
- PetalBot Blocked
- YouBot Blocked
User-request fetchers
- GoogleAgent-Mariner Blocked
- meta-externalfetcher Blocked
- MistralAI-User Blocked
- Perplexity-User Blocked
The other 3 AI crawlers we track are not mentioned and only inherit the catch-all rules that apply to every crawler.
- robots.txt found
- llms.txt not found
- ai.txt not found
- Sep 2026 claude-searchbot added to robots.txt
- Sep 2026 google-cloudvertexbot added to robots.txt
- Sep 2026 googleagent-mariner added to robots.txt
- Sep 2026 mistralai-user added to robots.txt
- Sep 2026 oai-searchbot added to robots.txt
- Sep 2026 sbintuitionsbot added to robots.txt
AI Crawlers
30 of 33 AI crawlers blocked
Audience
- 67% desktop
- 33% phone
United States
Where the site's Chrome visitors come from, largest estimated audience first.
Open Page Rank
3.42 / 10 · ranked #985,981 of all domains
59 referring domains · OpenPageRank
Core Web Vitals
| LCP | 1.4 s |
| CLS | 0 |
| TTFB | 800 ms |
Real user p75, Chrome UX Report, Sep 2026.
Page
- Language: English (United States)
- Weight: 2.3 MB · 64 requests
Homepage as crawled by the HTTP Archive, Sep 2026.
Organisation
- Colgate Rochester Crozer Divinity School
- Founded: 1970
- Sector: higher education
- Country: United States
From Wikidata (CC0).
Infrastructure
- Hosted on Microsoft (40.119.1.254)
- Email: no MX record returned
- SSL: Let's Encrypt, RSA 2048, expires Nov 2026
- Common Crawl link graph: rank 7,874,692, 2 hosts
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted