About AmazonProductDiscoverybot
AmazonProductDiscoverybot is Amazon's web crawler used to to collect publicly available product details from Amazon Selling Partner websites to help improve the accuracy and completeness of the information available on Amazon. This helps ensure that Amazon customers see correct and complete information to help them in their shopping journey.
How Can I Identify AmazonProductDiscoverybot?
To help website owners identify this bot on their websites, we provide an identification detail as part of our access requests (”AmazonProductDiscovery/1.0”) in the user-agent string. Such identification detail may look like the following:
Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Firefox/38.0 (compatible; AmazonProductDiscovery/1.0; https://vendorcentral.amazon.com/support/amazonproductbot)
How Can I Control What AmazonProductDiscoverybot Crawls on my Site?
Robots.txt: AmazonProductDiscoverybot processes the robots.txt every hour and respects the directives user-agent and the Disallow rule. In the example below, AmazonProductDiscoverybot wouldn't crawl documents that are under /do-not-crawl/ or /not-allowed:
User-agent: AmazonProductDiscoverybot # Amazon's user agent
Disallow: /do-not-crawl/ # disallow this directory
AmazonProductDiscoverybot does not support the directives crawl-delay, nofollow, and noindex in robots.txt.
Contact Us
If you have questions or concerns, please contact us. If you are a content owner, please always include any relevant domain names in your message.
