AI SEO Projects ·AI Visibility Measurement
Spec-hallucination audit
Last reviewed:
- Owner
- Measurement, with routing to entity/content owners
- Metric
- Count and severity of hallucinated product facts per surface and market, trending down
- Clock
- Retrieval layer —the two clocks
Invented product specifics — wrong battery life, storage, tier contents, compatibility — are the highest-severity AI visibility incident type for a technology catalog, and the tools are weak at catching them: in nine-platform testing, only two consistently flagged errors about a brand’s own pricing or features. This audit is the capability no vendor ships, because only you hold the ground truth.
Why this, mechanically. A model that confidently invents a spec does real commercial damage and shows up in no error log. Diffing assistant answers against your PIM truth, monthly and per market, converts that silent exposure into a routed incident list — and the routing matters: wrong facts usually trace back to an entity or content gap.
Deliverable. A monthly job asking each assistant the top factual questions per flagship product, per market; a per-surface accuracy score; and errors routed to entity or content owners, with pricing and invented-capability errors at the top.
Finish line. Every high-severity wrong answer has a routed owner, and the accuracy score trends down over quarters.
This encodes the truth set only you hold. It pairs with the prompt corpus baseline — the corpus measures presence, this measures accuracy.