PWABuilder
recommended: observePWABuilder (pwabuilder.com) is a free, open source developer tool from Microsoft that helps developers build progressive web apps and publish them in app stores. PWABuilder tool analyzes their website for Progressive Web App capabilities, such as a web manifest or service worker
How to identify it
User-agent contains any of:
PWABuilderHttpAgent
robots.txt
Well-behaved crawlers honor robots.txt. To control PWABuilder:
Allow full access
User-agent: PWABuilderHttpAgent
Allow: /Block entirely
User-agent: PWABuilderHttpAgent
Disallow: /
Grey-area scrapers ignore robots.txt. Botscope enforces your policy at the edge or origin regardless —
see how →
See PWABuilder on your own site
Botscope shows every bot and AI agent hitting your site — and lets you allow, challenge, or block each one. Observe first, enforce when you're ready.
Start free — connect in minutes