Updated daily

Crawler Catalog

1,876 known bots, crawlers, and AI agents — with UA patterns, verification methods, and recommended access policies.

Not sure what "crawler" vs "scraper" vs "agent" means here? See our terminology guide →

460

Allowed

1,224

Observed

192

Challenged

0

Blocked

Clear

All 1,876 Search Engine 114 AI Crawler 64 AI Assistant 268 AI Agent 10 AI Coding Agent 75 Browser Automation 3 AI Data Provider 13 AI Scraper 40 SEO Crawler 187 Social Media 73 Security 74 Monitoring 122 Archiver 21 Other 812

122 results · Monitoring

mediaboardbot monitoring

Mediaboard

mediaboardbot

Medialogia Bot monitoring

Medialogia

MedialogiaBot

Monitage monitoring

Monitage

Monitis monitoring

Monitis

Monsidobot monitoring

Acquia

MonSpark monitoring

MonSpark

MontasticMonitor monitoring

Montastic

MontasticMonitor

Netumo monitoring

Netumo

NETVIGIE monitoring

Netvigie

New Relic monitoring

New Relic

NixStatsMonitoringBot monitoring

NixStats

NixStatsMonitoringBot

Nodeping monitoring

Nodeping

Oh Dear monitoring

Oh Dear

Onetrust CMP Scanner monitoring

OneTrust, LLC.

OnlineOrNot Monitor monitoring

OnlineOrNot

OutsellURLValidator monitoring

Outsell Corporation

OutsellURLValidator

PaesslerCloudBot monitoring

Paessler

Panopta monitoring

Panopta

Parse.ly monitoring

Parse.ly

Pingdom monitoring

Pingdom

PingPing monitoring

PingPing

Pulsetic monitoring

Pulsetic

Qualys SSL Scanner monitoring

Qualys

Rackspace monitoring

Rackspace

RetroListeCOM monitoring

Niclas Papst

RetroListeCOM

Robinbot monitoring

Robin Education

SE Ranking Bot monitoring

SE Ranking

Sentry Uptime Monitoring monitoring

Sentry Uptime Bot

SequelWP monitoring

SequelWP

Server Density monitoring

Stackpath

SISTRIX Optimizer monitoring

SISTRIX GmbH

Site24x7 monitoring

Site24x7

SiteUpTimeBot monitoring

SiteUpTime

SolarWinds Observability monitoring

SolarWinds

Spectate monitoring

Spectate

Splunk monitoring

Splunk

Splunk Synthetics monitoring

Splunk

Stape Scanner monitoring

Stape Inc

StatusCake monitoring

StatusCake

Swifteq Link Checker monitoring

Swfiteq Ltd

Synthetic Bot monitoring

DataDog

TermlyBot monitoring

Termly

Thousand Eyes Cloud Agent monitoring

Thousand Eyes

Trendiction Bot monitoring

Trendiction S.A.

trendictionbot

UpDownBot monitoring

Updown

Uptime LLC monitoring

Uptime

Uptime Monitoring monitoring

GoDaddy

UptimeBot monitoring

UptimeBot

UptimeRobot monitoring

Uptimerobot

Uptimia monitoring

Uptimia

UptrendsBot monitoring

Uptrends GmbH

Watchbot monitoring

WatchBot

Watchful monitoring

Watchful LLC

webpagetest monitoring

WebPageTest

WebsitePulseBot monitoring

WebsitePulse

WebsitePulseBot

Webstatus247 monitoring

WebStatus247

WkndHealthCheckBot monitoring

Wunderkind

WormlyBot monitoring

Wormly

WP Umbrella monitoring

WP Umbrella

WPMU DEV Broken Link Checker monitoring

WPMUDEV

← Prev 2 / 3 Next →