What an AI visibility score hides: mentions, citations, coverage and source evidence are different measurements

A score can be directionally useful and still be operationally incomplete

AI visibility dashboards often compress a complicated observation into one number. That is convenient for a weekly report, but dangerous as a debugging interface.

If a score falls from 62 to 48, what changed?

• Was the brand named less often?
• Did the model cite fewer owned pages?
• Did the prompt set change?
• Did competitors gain mentions while the brand stayed flat?
• Did the answer contain a citation that nobody can inspect?

Those are different questions. A single score cannot answer all of them unless its underlying observations remain available.

The practical distinction is between four measurements: mentions, citations, coverage, and source evidence.

1. Mentions: was the brand named?

A mention is a textual appearance of the brand, product, or organization in an answer. It answers a narrow question: did the answer say our name?

Mentions are useful for tracking recognition, recommendation language, and competitor co-occurrence. But a mention does not prove that the answer used the brand’s website as a source. An answer can name a company from general model knowledge, a directory, a review, or a retrieved page.

At minimum, store the exact answer text, engine, model or surface when available, prompt, run time, and the text span that triggered the mention classification. A percentage without those records is difficult to audit.

2. Citations: what sources did the answer point to?

A citation is a source link, source chip, or named reference attached to the answer. It answers: what did the engine show as grounding material?

Citation and mention are independent:

The third row is easy to miss. A page can be useful evidence for an answer even when the prose never names the company. Conversely, a name can appear without the company’s source supporting the claim.

3. Coverage: how much of the test surface was observed?

Coverage is about the measurement surface, not the answer’s wording. A team might define it as the percentage of prompt-and-engine cells that produced an observation, or as the percentage of relevant prompts where the brand was present. Those denominators must be stated.

For example, “48% visibility” could mean:

• the brand appeared in 48 of 100 prompts;
• the brand was mentioned in 48% of successful runs;
• the brand received 48% of all cited sources;
• 48% of the monitored engines were reachable.

Each is a legitimate metric in the right context. None should be silently substituted for another.

Coverage also exposes sampling bias. A portfolio containing only branded queries will make a brand look visible. A portfolio containing only “best tools” queries may measure category competition instead. Keep the prompt portfolio versioned, and report changes to its size, intent mix, engines, locales, and schedules.

4. Source evidence: can another person re-check the observation?

Evidence is the audit layer. It connects a metric to the answer and the source behind it.

A useful evidence record includes:

1. the exact prompt and portfolio version;
2. the engine and surface used;
3. the timestamp and locale;
4. the raw or preserved answer;
5. extracted mentions and citations;
6. the URL for every cited source;
7. the claim-to-source relationship, where it can be determined;
8. the page snapshot or retrieval result used for review.

This is not the same as storing a screenshot of a dashboard. A screenshot shows a conclusion. Evidence lets a reviewer inspect the observation that produced it.

Why the four measurements should not be collapsed

Imagine two weekly reports:

Report A: mention rate is flat, owned citations rise, and the cited pages now cover more of the answer’s factual claims.

Report B: mention rate rises, but citations shift to third-party pages and the prompt set becomes smaller.

A composite score might rank both weeks as improvements. An operator would make different decisions: Report A suggests stronger source grounding; Report B needs investigation before it is called progress.

The same logic applies to competitors. Share of voice is not the same as citation share. A brand may be named often but receive little of the available source space. A competitor may appear less frequently but own the citations that answer the important questions.

A small data model beats a large mystery number

Teams do not need a perfect universal score to start. They need a stable observation table:

run_id
portfolio_version
prompt_id
engine
surface
locale
observed_at
answer_text_or_artifact
brand_mentioned
brand_recommended
owned_citation_urls
competitor_citation_urls
coverage_status
evidence_links

Derived metrics can then be calculated for a specific purpose. For example:

• mention rate = prompts with a brand mention / eligible prompts;
• owned citation rate = prompts with an owned citation / eligible prompts;
• citation share = owned citations / all counted citations in the answer;
• collection coverage = completed runs / scheduled runs.

The denominator and eligibility rule belong beside the metric. If a number cannot open to the records behind it, treat it as a summary, not as ground truth.

A practical review checklist

Before acting on an AI visibility score, ask:

• What exactly is the numerator?
• What exactly is the denominator?
• Are mentions and citations separate fields?
• Can I see the prompt and answer for a representative result?
• Did the prompt portfolio, engine, locale, or model change?
• Are the cited sources owned, earned, competitor, or unknown?
• Can a colleague reproduce or challenge the classification?
• Does the system preserve history instead of overwriting yesterday’s run?

This is the difference between a score that starts a conversation and a measurement system that supports a decision.

Closing thought

AI visibility is not one property of a brand. It is a set of observations about language, retrieval, source selection, and sampling. Mentions tell you whether the name appeared. Citations tell you what the engine pointed to. Coverage tells you how much of the test surface you actually observed. Source evidence tells you whether the result can be inspected.

Use the score as a summary. Keep the four measurements underneath it.

Disclosure: I work with CiteLadder, an AI-visibility product. The examples above are measurement guidance, not a claim that CiteLadder is the only valid implementation.

Further reading: CiteLadder’s AI visibility overview and FAQ on mentions, citations, and evidence.