Anthropic · User-triggered fetcher
Claude-User: what it is & how to allow or block it
Claude-User is the agent Anthropic uses when a Claude user asks Claude to fetch or read a specific URL in real time. Anthropic documents that Claude-User honors robots.txt. Requests are initiated by a human using Claude.
- User-agent
Claude-User- Operator
- Anthropic
- Type
- User-triggered fetcher
- robots.txt
- Anthropic documents that Claude-User honors robots.txt. Requests are initiated by a human using Claude.
- Official docs
- support.anthropic.com/en/articles/8896518
What allowing or blocking Claude-User means
Allowing Claude-User lets Claude users pull your live pages into conversations and cite them — a high-intent visibility channel.
Block Claude-User (robots.txt)
# Block Claude-User User-agent: Claude-User Disallow: /
Allow Claude-User (robots.txt)
# Allow Claude-User User-agent: Claude-User Allow: /
Declare your policy in llms.txt
robots.txt controls access; llms.txt states your intent in a machine-readable way LLMs prefer. Keep them consistent. The llms.txt generator lets you set Claude-User to allowed or restricted and emits a compliant file.
FAQ
Should I allow Claude-User?
Generally yes if you want Claude users to be able to read and cite your pages on request. Blocking it removes you from those user-initiated fetches.