About AmazonProductDiscoverybot
AmazonProductDiscoverybot is Amazon's web crawler used to collect publicly available product details from Amazon selling partner, brand, and retailer websites to help improve the accuracy and completeness of the information available on Amazon. This helps ensure that Amazon customers see correct and complete information to help them in their shopping journey.
About AmazonSellerInitiatedListing
AmazonSellerInitiatedListing is also to help sellers succeed by giving them the option to provide a URL to a website and create high-quality product pages in Amazon’s store.
How Can I Identify AmazonProductDiscoverybot?
To help website owners identify this bot on their websites, we provide an identification detail as part of our access requests (”AmazonProductDiscovery/1.0”) in the user-agent string. Such identification detail may look like the following:
Mozilla/5.0 (X11; Linux x86_64; rv:38.0) Gecko/20100101 Firefox/38.0 (compatible; AmazonProductDiscovery/1.0; https://vendorcentral.amazon.com/support/amazonproductbot)
Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36 (compatible; AmazonSellerInitiatedListing/1.0; https://vendorcentral.amazon.com/support/amazonproductbot)
How Can I Control What AmazonProductDiscoverybot Crawls on my Site?
Robots.txt: AmazonProductDiscoverybot respects robots.txt, honoring the user-agent and the disallow directives. Any changes to these directives may take up to 24 hours to be updated in our systems. When a file cannot be fetched, we will behave as if it does not exist. AmazonProductDiscoverybot does not support the directives crawl-delay, nofollow, and noindex.
In the example below, AmazonProductDiscoverybot does not crawl documents that are under the disallow path.
User-agent: AmazonProductDiscoverybot # Amazon's user agent
Disallow: / # disallow all directories
Disallow: /do-not-crawl-specific-directory/ # disallow a specific directory
Contact Us
If you have questions or concerns, please contact us. If you are a content owner, please always include any relevant domain names in your message.
