Short answer: a ChatGPT rank tracker reports a position that ChatGPT answers do not actually have. A search results page is an ordered list of links that stays broadly stable for a query; an answer is generated text in which a brand is recommended, mentioned in passing or absent, and in which its site is, separately, cited or not. The number that looks like a rank is usually the order brands happened to appear in one sampled answer, and that order moves between runs for reasons unrelated to you. Track rates over a fixed question set instead: how often you are mentioned, how often you are recommended, and how many distinct questions cite your site.
This is an opinion piece, but it rests on how answers behave rather than on taste, and every claim below can be checked against your own answers. It also explains what a rank chart is good for, because the honest answer is not "nothing".
Why ChatGPT rank tracking does not transfer from search
Rank tracking works in search because position ten means the same thing today and tomorrow. The page is a list, the list is ordered, and the order for a given query changes slowly enough that a daily reading tells you something. An AI answer breaks that analogy in three separate ways.
- The answer changes between runs. Ask the same question twice and the set of brands, and their order, can change while nothing about those brands has changed. A chart built on one sample per day spends most of its time explaining noise.
- The answer may not be a list at all. Some answers are written as ranked lists; others recommend one option, compare two, or describe a category without naming anyone. "Position" only exists in the first answer form, so a tracker has to either drop the others or invent a position for them.
- Engines name different numbers of brands. In our own benchmark one model named 3.5 providers per answer and another 2.1. Third place in an answer that names three is a different outcome from third place in an answer that names six, and averaging positions across engines hides exactly that difference.
The figure shows why "rank" becomes a noisy series even when nothing happens: the same question produced a list, a longer list and a single recommendation. A tracker that reads the position each time reports a fall from second to fourth and then a gap it has to fill somehow. A rate over the same runs says something calmer and more useful: the brand was named in two answers out of three.
Even Google's own AI surfaces show how weakly AI answers follow ranked positions. Ahrefs analysed 863K keyword results pages and 4M URLs cited in AI Overviews and found that only 37.9% of cited URLs also appeared in the first 10 result blocks; the rest came from positions 11 to 100 or from beyond the top 100. If a search rank explains a minority of what Google's own answer cites, a rank invented inside a chatbot answer explains even less.
What the number in a ChatGPT rank tracker usually measures
Most tools that sell rank in AI answers are doing something reasonable underneath; the problem is the label. Here is what the common displays usually are once you ask how they are computed.
| What the tool shows | What it usually is | Why it misleads |
|---|---|---|
| Your rank today | Your order of appearance in one sampled answer | A single sample of a value that varies between runs |
| Average position | Mean order across the answers where you appeared | Answers where you were absent drop out, so being named rarely but early looks strong |
| Rank among competitors | An ordering by mentions against a fixed competitor list | Only as good as the detection behind it, which is often asymmetric |
| Rank change this week | The difference between two single samples | The noise of two runs added together, presented as movement |
The second row is the subtle one, and it is worth seeing with numbers you can count on your fingers.
An average position that ignores absences rewards the brand that turns up once at the top over the brand that appears in every answer in second place. That is the opposite of what most teams want to know. A buyer who asks the question ten times meets the second brand ten times and the first brand once. Any metric that ranks them the other way round is answering a question nobody asked.
A rank is only as honest as the detection behind it
Ranking brands against each other requires counting every brand the same way, and that is where rank charts most often go wrong. In our own product, asymmetric detection once showed a brand at 31% share of voice and rank two; measured symmetrically it was 0% and last. Nothing about the brand changed between the two numbers, only the counting.
The mechanism is easy to reproduce by accident. Your own brand is matched loosely, with every spelling and product-line name, while competitors are matched only against a short fixed list. Every brand the assistant named that is not on the list simply disappears from the denominator, and your share rises by construction. Three rules prevent it:
- Count every brand an answer names, not only the ones on a list.
- Resolve spelling variants of one brand into one entity before counting. Splitting a competitor into several rows understates it and flatters you; splitting your own brand understates you.
- Show the total number of distinct brands next to any share or rank. Being 1% of 117 brands is a different situation from 1% of five.
Measuring AI share of voice works through the counting in detail, including how to handle answers that name nobody.
What to measure instead of a ChatGPT rank
The replacement is not one number but a small set, each of which survives repetition because it is averaged over many questions rather than read off one answer.
| Metric | Definition | Why it holds up |
|---|---|---|
| Mention rate | Share of a fixed question set where the brand is named | Averaging over many questions absorbs per-run variation |
| Recommendation rate | Share where the answer actively suggests the brand | Separates being referenced from being chosen |
| Citation breadth | Number of distinct questions whose answers cite your domain | Much harder to inflate than a raw count of citations |
| Position among cited sources | Where your domain sits among all domains cited across the question set | An ordinal over a real population of sources, not over one answer |
| Share of voice with brand count | Your share of all brand mentions, shown with the number of brands | The denominator travels with the percentage |
Notice that one ordinal survives on the list. Ranking your domain among every source cited across the whole question set is a real ranking, because the population is real and large; ranking your brand inside one answer is not. Each metric is reported per engine first, and per buyer intent where you have it, before any average. Citation breadth and the position among sources are covered further in citation analysis.
The conditions that make even these trustworthy
Rates are sturdier than ranks, but they can be broken by the same kinds of mistakes. Four conditions have to hold before any of them describes your brand rather than your setup.
- A fixed, versioned question set with no brand names in it. A question containing your name will be answered with your name. One generated question set had the brand name in 13 of 15 questions, and the score read 13% when the honest value was zero.
- The same method on every run. Enabling web search once moved a site from 3% to 13% while the site did nothing. Runs on different methodology versions are not a trend, and a chart that joins them is reporting an internal change as a customer result.
- Missing runs recorded as missing. A run with no collection is not a run of zero visibility; rendering it as 0% turns a flat line into a fake decline.
- Access checked first. If OAI-SearchBot, which builds the index behind ChatGPT's search features according to OpenAI's bot documentation, cannot reach your site, no metric will describe your content. It is also the agent sites most often block by accident while meaning to opt out of training through GPTBot.
If you already pay for a ChatGPT rank tracker
You do not need to throw it away; you need to know what it measures. The questions below separate a tool that is mislabelled from one that is misleading.
| Ask the vendor | Answer you can work with | Answer that should worry you |
|---|---|---|
| How is position defined? | Order within ranked-list answers only, other forms reported separately | A position is assigned to every answer, whatever its form |
| What happens when you are not named? | Counted as absent and visible in a mention rate | Dropped from the average |
| How many runs sit behind each point? | Several, with the spread shown | One |
| Are engines reported separately? | Yes, before any blended figure | Only a blended "AI rank" |
| Can I open the answer behind a number? | Yes, the full answer text | No, only the derived position |
If the answers fall in the middle column, the tool may still be useful as one input, read as "order within lists" rather than as a rank. If they fall in the right-hand column, treat the rank chart as decoration and build the rates above alongside it. The practical setup is in how to track brand mentions in ChatGPT.
A good report ends up looking less exciting than a rank chart: two rates and an ordinal over a question set you can show someone, with failed runs visible rather than hidden. It is also the only version that survives being checked.
Sources
- OpenAI, overview of OpenAI crawlers (GPTBot, OAI-SearchBot, ChatGPT-User).
- Ahrefs, how many AI Overview citations come from the top 10, published March 2026.
- Ahrefs, AI Overviews compared with AI Mode, published December 2025.
- Our own benchmark and measurement incident records (providers per answer, share-of-voice, brand-named questions and web-search changes), all incidents since fixed.