CookieHub
recommended: allowCookieHub is a website crawler that scans websites to detect cookies in use, categorizes them, and verifies cookie consent compliance for privacy regulation adherence.
What it does
CookieHub's cadence depends on how the scan is configured. Continuous monitoring may run daily or hourly, while a one-time or internet-wide scan may sweep once and disappear.
How to identify it
User-agent contains any of:
CookieHub
robots.txt
Well-behaved crawlers honor robots.txt. To control CookieHub:
Allow full access
User-agent: CookieHub
Allow: /
Block entirely
User-agent: CookieHub
Disallow: /
Grey-area scrapers ignore robots.txt. Botscope enforces your policy at the edge or origin regardless —
see how →
See CookieHub on your own site
Botscope shows every bot and AI agent hitting your site — and lets you allow, challenge, or block each one. Observe first, enforce when you're ready.
Start free — connect in minutes