Amazon Kendra
recommended: observeAmazon Kendra is a highly accurate intelligent search service that enables your users to search unstructured data using natural language. It returns specific answers to questions, giving users an experience that's close to interacting with a human expert. It is highly scalable and capable of meeting performance demands, tightly integrated with other AWS services such as Amazon S3 and Amazon Lex, and offers enterprise-grade security.
What it does
amazon-kendra works like Googlebot with a less predictable calendar. Expect recurring crawls across your whole site, at a frequency that tracks how often your content changes and how much authority your site carries. Visits can cluster in bursts when its index refreshes.
How to identify it
User-agent contains any of:
amazon-kendra-amazon-kendra
robots.txt
Well-behaved crawlers honor robots.txt. To control Amazon Kendra:
Allow full access
User-agent: amazon-kendra
Allow: /Block entirely
User-agent: amazon-kendra
Disallow: /
Grey-area scrapers ignore robots.txt. Botscope enforces your policy at the edge or origin regardless —
see how →
See Amazon Kendra on your own site
Botscope shows every bot and AI agent hitting your site — and lets you allow, challenge, or block each one. Observe first, enforce when you're ready.
Start free — connect in minutes