What powers projectnightcrawler.dev?
Last seen Aug 2026 · 14 technologies across 9 categories
Analytics
CDN
Development
Font scripts
JavaScript libraries
Miscellaneous
Programming languages
Security
Static site generator
AI Crawlers
Blocks 8 of 33 AI crawlers we track by name in its robots.txt. Checked Aug 2026.
Training crawlers
- Applebot-Extended Blocked
- Bytespider Blocked
- CCBot Blocked
- ClaudeBot Blocked
- Google-Extended Blocked
- GPTBot Blocked
- meta-externalagent Blocked
Search and AI assistants
- Amazonbot Blocked
The other 25 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt not found
- ai.txt not found
Content Signals:
search=yes ai-train=no declared in robots.txt
AI Crawlers
8 of 33 AI crawlers blocked
Standards: Content Signals
Audience
- 55% phone
- 45% desktop
United States
India
United Kingdom
Germany
Where the site's Chrome visitors come from, largest estimated audience first.
Open Page Rank
0.44 / 10 · ranked #30,746,127 of all domains
1 referring domains · OpenPageRank
Core Web Vitals
| LCP | 0.9 s |
| INP | 50 ms |
| CLS | 0 |
| TTFB | 700 ms |
Real user p75, Chrome UX Report, Aug 2026.
Page
- Language: English
- CDN: Cloudflare
- Weight: 0.0 MB · 8 requests
Homepage as crawled by the HTTP Archive, Aug 2026.
Subdomains
| Host | Techs |
|---|---|
| blog.projectnightcrawler.dev | 10 |
| git.projectnightcrawler.dev | 10 |
| projectnightcrawler.dev | 4 |