Amazon · AI / assistant crawler
Amazonbot: what it is & how to allow or block it
Amazonbot crawls public web content to support Amazon products and services, including Alexa answers and Amazon's AI features. Amazon documents that Amazonbot honors robots.txt. Disallowing it removes your content from Amazonbot crawls.
- User-agent
Amazonbot- Operator
- Amazon
- Type
- AI / assistant crawler
- robots.txt
- Amazon documents that Amazonbot honors robots.txt. Disallowing it removes your content from Amazonbot crawls.
- Official docs
- developer.amazon.com/amazonbot
What allowing or blocking Amazonbot means
Allowing Amazonbot can help Amazon's assistants answer questions about your domain accurately.
Block Amazonbot (robots.txt)
# Block Amazonbot User-agent: Amazonbot Disallow: /
Allow Amazonbot (robots.txt)
# Allow Amazonbot User-agent: Amazonbot Allow: /
Declare your policy in llms.txt
robots.txt controls access; llms.txt states your intent in a machine-readable way LLMs prefer. Keep them consistent. The llms.txt generator lets you set Amazonbot to allowed or restricted and emits a compliant file.
FAQ
How do I block Amazonbot?
Add a User-agent: Amazonbot block with Disallow: / in robots.txt. Amazon documents that it honors robots.txt.