ClaudeBot
ClaudeBot is Anthropic’s crawler for Claude model training; Claude-SearchBot handles search functions. Like their OpenAI counterparts, each is controlled individually via robots.txt.
In practice
The landscape of AI agents shifts quickly; keeping it current is part of technical hygiene. Group sites explicitly welcome these crawlers — user-agents listed, full access granted — because an assistant response that cites primapagina.fr is a position won. Blocking is legitimate for other business models; it should be a deliberate choice, not a default left unchanged.