Definition
GPTBot is OpenAI's crawler for gathering web content. It sits alongside agents with different jobs, including OAI-SearchBot for search indexing and ChatGPT-User for fetches triggered by a user's request, and other vendors run their own set such as PerplexityBot, ClaudeBot and Google-Extended.
Why it matters
Teams routinely block the training crawler and the retrieval agent with one rule, then wonder why they are never cited. The two decisions are separable and usually should be separated.
How to measure it
List every agent your robots.txt names and what each one is for, then confirm the server actually behaves that way for each user agent. Treat unknown agents as a review item, not as a default block.