AllAfrica NewsBot
recommended: observeAllAfrica NewsBot is a content fetching bot operated by AllAfrica, a pan-African news aggregation service. The bot visits websites to collect and aggregate news content from various sources across the African continent for distribution on their news platform.
What it does
AllAfrica NewsBot usually makes a single request within seconds of a URL being shared, without crawling further. Traffic rises and falls with sharing activity, so a widely circulated link can produce a sharp burst of fetches.
How to identify it
User-agent contains any of:
AllAfrica NewsBot
robots.txt
Well-behaved crawlers honor robots.txt. To control AllAfrica NewsBot:
Allow full access
User-agent: AllAfrica NewsBot
Allow: /Block entirely
User-agent: AllAfrica NewsBot
Disallow: /
Grey-area scrapers ignore robots.txt. Botscope enforces your policy at the edge or origin regardless —
see how →
See AllAfrica NewsBot on your own site
Botscope shows every bot and AI agent hitting your site — and lets you allow, challenge, or block each one. Observe first, enforce when you're ready.
Start free — connect in minutes