AI Search · How-to / Tutorial

How to Measure AI Search Visibility

You cannot look up a ranking in ChatGPT. There is no position one, no results page and no report that says where you stand. The same question can produce a different answer an hour later.

That does not make AI search unmeasurable. It makes it a sampling problem. You ask a fixed set of buyer questions, in the same way, often enough to see a pattern, and you count how often your company is named.

This guide gives the method in five steps, with a recording sheet you can download and the sample sizes you need before a number means anything. It takes about half a day to set up and a few hours a month to run.

Measure AI search visibility by running a fixed set of 20 to 30 buyer prompts on the same AI engines every month, three times each, and recording how often your brand is named, cited and described correctly. Report the result as a share of answer with its sample size beside it. Then add first-party data from Bing Webmaster Tools, Search Console and analytics, and keep all of it next to your pipeline figures.

Step 1: Build a Fixed Prompt Set

A prompt set is a list of questions a real buyer would ask an AI assistant. Take them from sales calls, enquiry forms and support tickets, not only from a keyword tool. Write them the way a buyer talks, in full sentences.

Sort them into four groups, because each group tells you something different.

Four groups of buyer prompts
GroupExample wordingWhat it shows
Shortlist "Which companies supply [product] for [use] in [country]?"Whether you are considered at all
Comparison "How do [supplier A] and [supplier B] compare for [need]?"How you are described next to a rival
Problem "How do I fix [problem your product solves]?"Whether your content is used as a source
Brand "What does [your company] do, and is it reliable?"Whether what AI says about you is accurate

How many prompts? Start with 20 to 30, spread across the four groups. That is enough to see large differences and small enough to run every month without giving up. Once the routine is settled, grow the set to 40 to 60, the range we use in our guide to AI SEO. Beyond that you add work faster than you add accuracy.

Two rules keep the set useful. Leave your own brand name out of the shortlist and problem prompts, so the question does not lead the answer. And freeze the set. If you change the questions every month, you can no longer compare one month with the next, which is the whole purpose.

Step 2: Run It the Same Way Every Month

AI answers vary far more than search results do. In January 2026, SparkToro published a study, run with the AI tracking company Gumshoe, in which 600 volunteers ran 12 prompts nearly 3,000 times across ChatGPT, Claude and Google's AI features. The chance of getting the same list of brands twice was less than 1 in 100. The chance of the same list in the same order was about 1 in 1,000.

The same study found something steadier underneath. How often a brand appeared across many runs was fairly consistent. Its authors concluded that the share of answers naming a brand is a reasonable thing to track, and that position within an answer is not. The study is not peer reviewed, and one of its authors sells tracking software, but the finding matches what anyone sees who runs the same prompt twice.

So the method has to control what it can and repeat what it cannot.

  1. Use the same engines each month. For most B2B companies that means ChatGPT, Gemini, Perplexity, Copilot and Google's AI Overviews or AI Mode. Drop any your buyers do not use.
  2. Start clean. Use a signed-out window or a temporary chat where the product has one, so earlier conversations do not shape the answer. Start a new chat for every prompt.
  3. Paste the prompt exactly. Copy it from your sheet. Small changes in wording change the answer.
  4. Run every prompt three times on each engine. One run is an anecdote. Three give you a rate.
  5. Note the date and the country you ran from. Answers differ by location, and you will want to know later which run was which.

Thirty prompts, three runs and four engines come to 360 answers, at about a minute each to run and record. That is roughly six hours a month, and it can be split between two people. If it is too much, keep the two engines your buyers use most.

Step 3: Record the Same Six Things for Every Answer

Decide what to record before you start, and record the same things every time. Six columns are enough.

What to record for each answer
ColumnWhat to writeWhy it matters
Named Yes or no: does the answer mention your company?This is the count behind share of answer
Cited Yes or no: does it link to one of your pages?A citation can send a visit. A mention cannot
Page cited The address it linked toShows which pages AI systems treat as sources
Other brands named Every other company in the answerShows who you are being compared with
Accurate Yes, partly or noWrong facts point to weak or conflicting information about you
What was wrong The incorrect statement, copied outThis becomes your list of things to fix

Do not record your position in the answer as a score. The study above found it close to random from one run to the next.

The accuracy columns are the ones people skip, and they are often the most useful. If three assistants say you are based in the wrong city, or list a service you stopped offering, that is not an AI problem. It is a sign that your own pages, your listings and the sites that mention you disagree with each other.

Free download

The Recording Sheet

A spreadsheet with the columns above, plus the date, engine, prompt group and run number, and one example row. It opens in Excel, Google Sheets or Numbers.

No sign-up. The file is a plain CSV with no tracking in it.

Step 4: Add the Data You Own

Prompt sampling is an estimate. Four first-party sources sit beside it, and each one counts something different.

First-party sources for AI visibility, and what each one counts
SourceWhat it countsWhat it leaves out
Bing Webmaster Tools, AI Performance Citations of your pages in Copilot, Bing's AI summaries and some partner services, with a sample of the queries behind themClicks. Microsoft does not list click data in the report
Search Console, Generative AI report Impressions of your pages in Google's AI Overviews and AI ModeClicks, queries and position
Analytics, AI Assistant channel Visits that arrive from assistants such as ChatGPTVisits that arrive without a referrer, which show as direct
Server logs Requests from AI crawlers and fetchersPeople. A crawler request is not a visit

All three reports are recent. Microsoft launched AI Performance as a public preview in February 2026. Google announced the Generative AI performance report in June 2026, and it shows impressions only. Google Analytics added an AI Assistant channel to its default channel group in May 2026.

These numbers do not add up to one total, and they should not be forced to. A citation is not a visit, and a visit is not an enquiry. Our article on AI citations vs website traffic explains what each one proves and how to set up the tracking. If the crawlers are not reaching you at all, start with the six access checks instead.

Step 5: Report a Rate, With Its Sample Size

The headline number is share of answer: the answers that named you, divided by the answers you counted. Report it for each engine separately before you give a total, because engines disagree and the differences are informative.

Always put the sample size next to the rate. A percentage from a small sample moves a long way by chance.

How far a share of answer can move by chance

Approximate 95 percent margin of error, in points either way, for a rate near 50 percent

  1. 30 answers About 18 points About 18 points30 answers
  2. 60 answers About 13 points About 13 points60 answers
  3. 90 answers About 10 points About 10 points90 answers
  4. 180 answers About 7 points About 7 points180 answers
  5. 360 answers About 5 points About 5 points360 answers
The same figures as a table
Answers countedMargin either way
30 answersAbout 18 points
60 answersAbout 13 points
90 answersAbout 10 points
180 answersAbout 7 points
360 answersAbout 5 points
Worked out from the standard formula for a proportion: 1.96 times the square root of p times (1 minus p), divided by n, with p at 0.5. Repeated runs of one prompt are related to each other, so treat these as minimums.

Ninety answers is 30 prompts run three times on one engine. At that size, a share of answer of 42 percent one month and 47 percent the next is not a change. It is the same number measured twice. A move from 42 to 60 is worth acting on.

A monthly report needs four lines:

  • Share of answer for each engine, with the number of answers beside it.
  • The trend over at least three months, not month on month.
  • What AI got wrong about you, and whether last month's errors have gone.
  • Three fixes for the coming month.

Leadership will ask how you compare with competitors. The same sheet answers that, with some extra care about fairness and sample size. See how to benchmark competitors in AI search.

What This Method Cannot Tell You

It is better to state the limits yourself than to have a finance lead find them.

  • It is a sample. Your prompts are a few dozen of the thousands of ways buyers ask. Share of answer describes your prompt set, not the market.
  • It is not a market share. Being named in 40 percent of answers does not mean 40 percent of buyers choose you.
  • It does not explain why. You can see that a rival is named more often. The sheet will not tell you the reason, only which pages were cited.
  • It does not measure revenue. Keep it beside your pipeline figures, never in place of them.

Asked by readers

Questions People Ask

What is share of answer?

The percentage of AI answers, from a fixed set of buyer questions, that name your brand. It is an estimate from a sample, so always quote it with the number of answers it is based on. It is not a market share.

How many prompts do I need to track?

Start with 20 to 30 buyer questions and run each one three times on every engine you track. That gives 60 to 90 answers per engine, which is enough to see large differences. Grow the set to 40 to 60 prompts once the routine is running.

How often should I measure AI search visibility?

Monthly is enough for most businesses. Run the same prompts, on the same engines, in the same way each time, so that a change in the number reflects a change in the answers and not in your method.

Why do AI answers change between runs?

Each answer is generated afresh, so the brands named and their order vary. A study published by SparkToro in January 2026 found that the same prompt almost never returned the same list of brands twice. How often a brand appears across many runs is far steadier, which is why you record a rate.

Can Google Search Console show AI Overview traffic separately?

Partly. Search Console now has a Generative AI performance report that shows impressions in AI Overviews and AI Mode by page, country and device. It does not show clicks, queries or position, and the same impressions are already counted in the main Performance report.

Treat It as a Sample, and Say How Big

AI visibility can be measured well enough to manage, as long as you treat it as a sample and say how big the sample is. Fixed prompts, repeated runs, six columns and a rate with its margin are the whole method.

The first month gives you a baseline and a list of things AI gets wrong about you. Fix those first. They are usually the cheapest improvements you will find, and they are the ones that cost you buyers who never visit your site.

Related service AI SEO services is where we put this to work for clients.

Let's Talk Possibilities.

Whether you're scaling your brand, launching a new product, or reimagining your digital presence: we're here to listen, think, and build with you.

Drop Your Enquiry
Get a Free Quote