ProjectShield-UrlCheck
recommended: allowProjectShield-UrlCheck is a security scanner that monitors websites protected by Google's Project Shield service, checking for malicious traffic and DDoS attacks to ensure continuous protection.
What it does
ProjectShield-UrlCheck's cadence depends on how the scan is configured. Continuous monitoring may run daily or hourly, while a one-time or internet-wide scan may sweep once and disappear.
How to identify it
User-agent contains any of:
ProjectShield-UrlCheck
robots.txt
Well-behaved crawlers honor robots.txt. To control ProjectShield-UrlCheck:
Allow full access
User-agent: ProjectShield-UrlCheck
Allow: /Block entirely
User-agent: ProjectShield-UrlCheck
Disallow: /
Grey-area scrapers ignore robots.txt. Botscope enforces your policy at the edge or origin regardless —
see how →
See ProjectShield-UrlCheck on your own site
Botscope shows every bot and AI agent hitting your site — and lets you allow, challenge, or block each one. Observe first, enforce when you're ready.
Start free — connect in minutes