LLM brand monitoring
AI Visibility Monitoring: Know What ChatGPT and Google's AI Tell Your Customers
Here is a question no analytics dashboard can answer: when a customer asked ChatGPT for a business like yours this morning, what did it say? Monitoring answers that question on a schedule, with the receipts, and then tells you what to do about it.
October 8, 2026 · 10 min read
The short answer
AI visibility monitoring means asking ChatGPT, Gemini, Perplexity, Claude and Google's AI features the questions your customers ask, on a fixed schedule, and recording every answer: whether you were named, where in the list, who was named instead, what was said about you and which sources were cited. Tracked over months, it shows whether your fixes are working.
On this page
- Your analytics cannot see the conversation
- Seven things we record for every question
- Choosing questions your customers really ask
- AICiteBeam, Delphi and the free consoles
- A thermometer does not lower a fever
- How the engagement runs, month by month
- Inside the monthly report
- Price, and when a tracking tool is enough
Your analytics cannot see the conversation
Most AI answers never send a visitor. The customer reads three names, picks one, and calls. If yours was not one of them, nothing shows up anywhere: no bounce, no lost session, no line on a chart. Owners find out the old way, when a regular mentions that ChatGPT suggested someone else, or when they ask it themselves at midnight and wish they had not.
The free reports help, and we set all of them up, but each one sees a sliver. None of them records the words of the answer, which is the part that decides the call.
| What it counts | What it cannot tell you | |
|---|---|---|
| GA4 AI Assistant channel | Visits referred by assistants such as ChatGPT, Gemini and Copilot, as a default channel since May 13, 2026 | Answers that sent no click; AI Overviews and AI Mode visits, which stay in Organic Search; app visits with no referrer, which land in Direct |
| Search Console Generative AI report | How often links to your site appeared in AI Overviews and AI Mode, by page, country, device and date | Clicks, the questions behind them, and what the answer said about you |
| Bing AI Performance report | Citations in Copilot and Bing's AI summaries, grounding queries, and Citation Share for each query | Clicks, and any data about competitors beyond your own share |
| Merchant Center AI performance | A brand's share of voice for shopping queries in AI Mode and AI Overviews | Anything outside shopping, and anything outside Google |
Google also says plainly that no third-party tool has access to its internal ranking or AI systems. So monitoring does the honest thing: it asks the engines the same questions a customer would and writes down what comes back. If you want to see the GA4 side first, our guide to tracking AI traffic in GA4 builds the channel step by step.
Seven things we record for every question
A single yes or no is not enough. Being named fourth with the wrong phone number is a different problem from being left out, and it gets a different fix. For each question, on each engine, on each run, the record holds:
- Named or not. The headline number, counted across repeated runs rather than one lucky answer.
- Position in the answer. First of three reads differently from a footnote under five rivals.
- What it said about you. Hours, phone, prices, services, service area and claims, checked against your real facts so errors surface before customers repeat them.
- Who was named instead. The competitors that appear, how often, and on which questions.
- The sources it cited. The directories, articles, review sites and pages the engine leaned on, which become the to-do list.
- The tone. Whether the description is neutral, glowing, or built around a complaint.
- Engine, date and wording. So a change can be tied to a fix, an engine update or plain variation.
Rolled up, the named-or-not column becomes your AI share of voice: the share of answers that name you, set against the same figure for each competitor. It is the closest thing this field has to a ranking, and we report it with the sample size attached so nobody mistakes noise for news.
Choosing questions your customers really ask
The prompt set is where most monitoring goes wrong. Track vanity questions and you get vanity results. Say a roofer in Boerne tracks "best roofing company" with no town attached: the answers will be national brands and roofing blogs, and the chart will be flat forever. The questions have to sound like the people who pay you.
- Service and place: "Who installs metal roofs near Boerne?" and its neighbors in the suburbs you serve.
- Problem first: "My roof is leaking after hail, who should I call?" Customers describe symptoms, not services.
- Comparisons: "Is a local roofer better than a national chain?" and head-to-head questions naming you and a rival.
- Your name: "What are the hours for your company?" and "Is your company any good?" These catch wrong facts and bad summaries.
- Spanish: where your customers ask in Spanish, the same questions in Spanish, because the answers can differ.
Each question is asked more than once per cycle, because AI answers vary from one asking to the next. We revisit the set whenever services, seasons or competitors change. The method is laid out in full in our prompt tracking guide, and you can try a single question today with the free AI visibility check.
AICiteBeam, Delphi and the free consoles
We did not want to rent our core instrument, so we built it. Monitoring at DataCram runs on three kinds of tools that check one another.
AICiteBeam
Our own GEO tracking platform. It runs your question set through ChatGPT, Claude, Gemini, Perplexity and Google's AI Overviews automatically, tracks competitor share of voice and the sources each engine cites, and sends an alert by email or Slack when visibility moves. The build is described in the AICiteBeam case study.
Delphi, inside Athena CMS
On sites we build, the Delphi agent in Athena CMS asks the engines what they say about the business, flags wrong hours, prices or claims, and drafts the facts and FAQs AI engines tend to cite. It sends a weekly report, and nothing goes live without your approval.
Google and Bing's own reports
Search Console's Generative AI report, Bing's AI Performance report and GA4's AI Assistant channel add the first-party view: impressions, citations and visits the engines themselves count.
A person reading the answers
Numbers miss tone. Someone reads the answers each month, because "named, but described as hard to reach" is a finding no counter catches.
A thermometer does not lower a fever
Plenty of dashboards will tell you that your AI visibility is 23, down from 26, with a small red arrow. Very few tell you why, and fewer still do anything about it. Monitoring on its own is a thermometer. It is worth having, and it is worth nothing if nobody treats the patient.
A chart that only moves when the engines update is a weather report, not a marketing program.
That is why our monitoring is part of the monthly SEO program, not a separate subscription. The answers feed the work: the cited sources become a list of directories and articles to earn a place in, the wrong facts become listing corrections, the competitor gaps become pages. When an answer goes wrong, the matching guide in AI search fixes becomes the playbook, whether the problem is a competitor named in your place or wrong business details.
How the engagement runs, month by month
- 1
Free GEO audit
We run a first set of your customers' questions through the engines, check the site and listings, and show you where you stand. The free GEO audit ends with a fix list and a fixed monthly quote.
- 2
Agree the questions and the rivals
Together we settle the question set, the towns or regions, the languages and the competitors worth tracking. You know who takes your jobs better than any tool does.
- 3
Record a baseline
Before anything changes, every question is run on every engine more than once. This is the before photo, and it keeps everyone honest later.
- 4
Fix, then watch
The program works through the fix list: crawlability, listings, reviews, content and mentions. Alerts flag sharp moves between reports so a wrong fact gets caught between reports, not at the next meeting.
- 5
Report and reset
Each month you get the answers, the trend and the next fixes. When the business changes, we prune questions that no longer matter and add new ones.
Inside the monthly report
| What you see | Why it is there | |
|---|---|---|
| The answers | Excerpts of what each engine said for your most important questions | So you read the words, not just a score |
| Share of voice | How often you and each competitor were named, with the number of runs | The trend that shows whether the work is compounding |
| Cited sources | The pages each engine leaned on, and whether you appear on them | The to-do list for mentions and listings |
| Accuracy | Every wrong fact found, where it likely came from, and its status | Errors fixed at the source, not argued with |
| First-party data | Search Console AI impressions, Bing citations and GA4 AI Assistant visits | What the engines themselves count |
| Work done and next | The fixes shipped this month and the plan for next month | So the report leads to action |
If you are comparing agencies, our page on what a GEO report should show lists the red flags, starting with any single "AI score" nobody can define.
Price, and when a tracking tool is enough
Monitoring comes inside our monthly programs, which start at $625 a month; most local businesses land between $625 and $2,250, depending on how competitive the questions are and how much needs fixing. There is no long contract, the scope is written down, and the tier is set after the free audit. The SEO pricing page and GEO pricing explain what moves the number, and SEO financing is available.
Now the part most agencies leave out. If you have someone in-house who will act on the numbers, a tool alone may be enough. As of October 2026, Otterly.AI's Lite plan is $29 a month for 15 prompts, Semrush's AI Visibility Toolkit is $99 a month per domain billed annually, and Ahrefs' Brand Radar AI starts at $199 a month. Our GEO tools comparison covers the rest. If your team wants a plan and a second opinion rather than a managed program, GEO consulting is the better fit. And if your customers never ask an AI about businesses like yours, monitoring is money better spent on local marketing.
Questions owners ask us about AI search
Rank tracking records a position on a list of links that is mostly the same for everyone. AI answers are generated fresh, vary between runs and often name only a few businesses, so there is no stable rank to record. Monitoring asks each question several times and counts how often you are named, what was said and which sources were cited. The idea is explained in there is no number one in an AI answer.
AICiteBeam tracks ChatGPT, Claude, Gemini, Perplexity and Google's AI Overviews. Copilot citations come from Bing Webmaster Tools' AI Performance report, and AI Mode and AI Overview impressions from Search Console's Generative AI report. For retailers, Merchant Center's AI performance report adds shopping share of voice. Each engine's quirks are covered in its own guide, starting with ChatGPT.
Because the engines change constantly. Models are updated, search indexes refresh, competitors publish, and the same question can produce different answers minutes apart. That is why we ask each question several times per cycle and report the trend with the sample size. A one-month dip on a handful of runs is usually noise; a three-month slide across many questions is a signal.
Close, not identical. Automated checks do not carry a real person's history, location or settings, and answers fetched through an API can differ a little from the consumer apps. Google's AI Mode, for example, personalizes some results using past conversations and places. Treat the results as a careful sample of what a typical customer sees.
Our monitoring is part of the monthly SEO program because tracking without fixing rarely pays for itself. If you only want the numbers and have someone to act on them, a tracking tool is the cheaper route, and we will say so. The GEO tools comparison shows published prices as of October 2026.
There is no universal benchmark, and anyone quoting one is guessing. The useful comparisons are against your own past and against the competitors named for the same questions. A business named in a third of answers where rivals sit at a tenth is doing well; the same third where one rival appears in nearly every answer means there is work to do.
Keep reading
- Choosing the questionsPrompt Tracking for AI Search: Which Questions to MonitorWhich questions to track in ChatGPT, AI Mode and Perplexity, how many, how often and from where. A practical method for a prompt set that holds up over time.
- Reading the monthly reportWhat a GEO Report Should Show, and the Red Flags in Bad OnesA monthly GEO report should show real AI answers, sources, fixes and first-party data from Search Console and Bing. A sample outline plus agency red flags.
- Plans, training, second opinionsGEO Consulting: A Generative Engine Optimization Consultant for Teams That Do the WorkGEO consulting for in-house teams and agencies: a written AI search plan, a prompt set, a fix list and a measurement setup your own people can run.
- When the answer is fictionAI Made Up Facts About My Business: How to Trace, Report and Replace the FictionAn AI invented a service, a price, an owner or a review for your business. Save the evidence, find the cause, report it to each engine and fill the gap.
- Engine guide: GeminiHow to Get Recommended by Gemini: Maps Data, One Robots.txt Token and Your Own SiteHow the Gemini app picks businesses: Google Maps data, the Google-Extended token, Business Profile and your site. Steps to check, fix and track Gemini.
- Everything in AI Visibility MonitoringSee the section
See what the AI engines say about you
Tell us your business and the questions customers ask. We will run them through the engines, show you the answers and the sources behind them, and quote a monthly program if you want help.
Which of these sounds like you? (pick any)
Rather talk now? Call (210) 346-0848.