Twingly Recon-Sjostrom
recommended: observeTwingly Recon-Sjostrom is a web crawler operated by Twingly, a company that provides social data and news data from millions of online sources including news sites, blogs, forums, and reviews.
What it does
Twingly Recon-Sjostrom usually returns to a small set of pages rather than crawling an entire site. Visits may follow an hourly, daily, or weekly schedule, while websites its clients do not monitor may never encounter it.
How to identify it
User-agent contains any of:
Twingly Recon-Sjostrom
robots.txt
Well-behaved crawlers honor robots.txt. To control Twingly Recon-Sjostrom:
Allow full access
User-agent: Twingly Recon-Sjostrom
Allow: /Block entirely
User-agent: Twingly Recon-Sjostrom
Disallow: /
Grey-area scrapers ignore robots.txt. Botscope enforces your policy at the edge or origin regardless —
see how →
See Twingly Recon-Sjostrom on your own site
Botscope shows every bot and AI agent hitting your site — and lets you allow, challenge, or block each one. Observe first, enforce when you're ready.
Start free — connect in minutes