Updated daily
Crawler Catalog
1,876 known bots, crawlers, and AI agents — with UA patterns, verification methods, and recommended access policies.
Not sure what "crawler" vs "scraper" vs "agent" means here? See our terminology guide →
268 results · AI Assistant
um-LN
ai assistant
Unicepta
um-LN
observe
UpContent
ai assistant
UpContent
UpContent
observe
UpContent-QA
ai assistant
UpContent
UpContent-QA
observe
UpContent-Test
ai assistant
UpContent
UpContent-Test
observe
Upstash QStash
ai assistant
Upstash
observe
signed
UseAI
ai assistant
Use AI
UseAI
observe
Ventus Agent
ai assistant
observe
signed
Verity
ai assistant
GumGum
Verity
observe
Viber
ai assistant
Viber
Viber
observe
virustotal
ai assistant
VirusTotal
virustotal
observe
Visually.io Shopify Editor
ai assistant
Visually.io
observe
signed
vkShare
ai assistant
VK
vkShare
observe
WAVE Streaming Platform
ai assistant
observe
signed
weborama-fetcher
ai assistant
Weborama
weborama-fetcher
observe
WebTrackrCrawler
ai assistant
Affsignal
WebTrackrCrawler
observe
webzio
ai assistant
Webz.io
webzio
observe
WhatsApp
ai assistant
Meta
WhatsApp
observe
WireReaderBot
ai assistant
Wire
WireReaderBot
observe
wknd-bot
ai assistant
Wunderkind
wknd-bot
observe
WovnCrawler
ai assistant
WOVN
WovnCrawler
observe
YaDirectFetcher
ai assistant
Yandex
YaDirectFetcher
observe
Yahoo
ai assistant
Yahoo
Yahoo
observe
YaK
ai assistant
Linkfluence
YaK
observe
YelpBot
ai assistant
Yelp
YelpBot
observe
Yext
ai assistant
Yext
Yext
observe
YiyanBot
ai assistant
Baidu
YiyanBot
observe
ZipchatBot
ai assistant
Zipchat Inc
observe
signed
ZoteroTranslationServer
ai assistant
Wikimedia
ZoteroTranslationServer
observe