YiyanBot
recommended: observeYiyanBot is a web crawler operated by Baidu that fetches web content for the yiyan.baidu.com assistant and related ERNIE-generated answers.
What it does
YiyanBot fetches one page at a time, the moment someone asks a question it can answer, so it never crawls your site. How much you see depends on how many people use YiyanBot and how often they ask about what your site covers. A popular assistant can hit you steadily, while a single user or a niche one stays quiet between occasional spikes.
How to identify it
User-agent contains any of:
YiyanBot
robots.txt
Well-behaved crawlers honor robots.txt. To control YiyanBot:
Allow full access
User-agent: YiyanBot
Allow: /Block entirely
User-agent: YiyanBot
Disallow: /
Grey-area scrapers ignore robots.txt. Botscope enforces your policy at the edge or origin regardless —
see how →
See YiyanBot on your own site
Botscope shows every bot and AI agent hitting your site — and lets you allow, challenge, or block each one. Observe first, enforce when you're ready.
Start free — connect in minutes