There's a new Amazon bot launching today: `Amzn-SearchBot`
"...used to improve search experiences in Amazon products and services...such as Alexa and Rufus. Amzn-SearchBot does not crawl content for generative AI model training."
Doc page shows user-agent & links to source IP list.
Looks like it *does* obey `robots.txt` at least.
developer.amazon.com/amazonbot
About AmazonBot
Customer facing page of Amazonbot crawler which all web content publishers can refer to.Developer Portal Master
miki
in reply to Neil Craig • • •miki
in reply to miki • • •Neil Craig
in reply to miki • • •@miki Yeah I agree, they're definitely trying to make a clear distinction.
I suspect orgs are becoming increasingly likely to outright block bots which pull content to train LLMs for whatever reason so perhaps they're trying to avoid that.
Would be nice if they were a bit more open on the detail of what they *are* going to use the bot for though.