What powers pfblockerng.com?
Last seen Oct 2026 · 9 technologies across 6 categories
Caching
CDN
Miscellaneous
PaaS
Security
Widgets
AI Crawlers
Does not block any of the 33 AI crawlers we track in its robots.txt. Checked Oct 2026.
Training crawlers
- Applebot-Extended Allowed
- Bytespider Allowed
- CCBot Allowed
- ClaudeBot Allowed
- cohere-training-data-crawler Allowed
- Google-Extended Allowed
- GPTBot Allowed
- meta-externalagent Allowed
Search and AI assistants
- Amazonbot Allowed
- Applebot Allowed
- Claude-SearchBot Allowed
- DuckAssistBot Allowed
- OAI-SearchBot Allowed
- PerplexityBot Allowed
User-request fetchers
- ChatGPT-User Allowed
- Claude-User Allowed
- MistralAI-User Allowed
- Perplexity-User Allowed
The other 15 AI crawlers we track are not mentioned and stay allowed by default.
- robots.txt found
- llms.txt found
- ai.txt not found
Content Signals:
search=yes ai-train=yes ai-input=yes declared in robots.txt
AI Crawlers
No AI crawlers blocked
Standards: llms.txt, Content Signals
Open Page Rank
0.51 / 10 · ranked #24,053,105 of all domains
1 referring domains · OpenPageRank
Page
- Language: English
- CDN: Cloudflare
- Weight: 0.2 MB · 8 requests
- Structured data: JSON-LD, OpenGraph, Twitter Cards
Homepage as crawled by the HTTP Archive, Nov 2026.
Organisation
From the homepage's own structured data (Nov 2026).
Infrastructure
- Hosted on Cloudflare (104.21.72.125, IPv6)
- DNS: Cloudflare DNS
- Email: Cloudflare Email Routing
- Email security: SPF (hard fail), DMARC reject, DNSSEC signed
- SSL: Google Trust Services, ECDSA P256, expires Jan 2027
- Common Crawl link graph: rank 2,184,215
- Verified with: Google
DNS records as swept Oct 2026, certificate as seen Oct 2026. How the web is hosted
Full technology history →
Report an incorrect detection