HTTrack 3.0
recommended: challengeHTTrack 3.0 is a scraper.
What it does
HTTrack 3.0 behaves according to its operator's configuration, and scrapers are among the least predictable bots on the web. It may range from slow, careful extraction to rapid, aggressive fetching, ignore robots.txt, or change its user-agent string when blocked. Its request volume and speed are more informative than its label.
How to identify it
User-agent contains any of:
HTTrack 3.0
robots.txt
Well-behaved crawlers honor robots.txt. To control HTTrack 3.0:
Allow full access
User-agent: HTTrack 3.0
Allow: /Block entirely
User-agent: HTTrack 3.0
Disallow: /
Grey-area scrapers ignore robots.txt. Botscope enforces your policy at the edge or origin regardless —
see how →
See HTTrack 3.0 on your own site
Botscope shows every bot and AI agent hitting your site — and lets you allow, challenge, or block each one. Observe first, enforce when you're ready.
Start free — connect in minutes