1001 SEO Media
All posts
By 1001 SEO Mediaprompt trackingai search analyticsagency workflowpromptwatch

What's the best way to track and analyze prompts in AI search engines?

How we track and analyze prompts in AI search engines for clients: prompt design, daily runs, source analysis and the Promptwatch features that make it repeatable.

The honest answer is that the best way to track prompts is a routine, not a tool. A tool just makes the routine repeatable. We have set this up for enough client programs to know which parts matter and which parts people skip.

Here is the routine, in the order we do it.

Start with a prompt set that looks like real buying

Most first prompt sets are written by the marketing team in a meeting, and it shows. They are too clean, too brand-heavy, and they ask questions nobody types. We build from evidence instead.

We pull queries from Search Console, People Also Ask and the pages a client already ranks for. In Promptwatch, Prompt Explorer does this: it suggests prompts from Search Console, ranking keywords, People Also Ask or any page we point it at. Prompt Volumes add search volumes and difficulty scores, so we can tell the client which prompts deserve attention first.

Then we organize. Every prompt gets a topic, a tag, a type (organic, brand or competitor comparison) and an intent. Where it matters, we add personas and countries. Persona stacking lets us run the same question as different buyers, which often surfaces different brands in the answer. The aim is a set where a result can be sliced by topic, persona or market, because a single blended number hides everything useful.

A starting set of 30 to 50 prompts is plenty. A client who starts with 500 will not read the results.

AI answers vary from run to run. One answer is an anecdote, so we track daily per model, country and language and look at movement over weeks. A single-day drop is not a story. A three-week slide is.

We explain this to clients early. It prevents panic over noise, and it makes the later good news more credible.

Measure four things, then read the answers

For each prompt we look at visibility, Share of Voice, Position in Answer and Sentiment. Promptwatch reports all four, plus a heatmap that compares any two dimensions and A/B period comparison for before and after.

Then we read the actual responses. Every week, a sample. Aggregates hide a surprising amount: a mention that is really a throwaway reference, a product name the tracker did not recognize, a competitor described in glowing terms in the same answer. The Brand Book, with its analysis instructions, and brand aliases are how we teach the platform what counts as a mention. Getting that right early saves arguments later.

Analyze the sources, not just the answers

An answer is built from sources, and that is where we find most of the actionable work. Citation analytics show page and domain level citations, URL positions and a Page Tracker for specific URLs, ours or a competitor's. Reddit, YouTube and LinkedIn citation reports show whether the engines lean on communities and video. Offsite mentions find brand mentions on third-party pages without a link.

Query fan-outs are the other half. They show the sub-queries each model runs before answering, which tells us what the engine was really looking for. We often find the client's pages answer the question the user typed but not the questions the model asked behind the scenes.

Connect it to the site

Two links turn analysis into action. First, crawler access. Agent Analytics shows IP-verified AI crawler logs for bots such as GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot and PerplexityBot, with error tracking and a crawl-to-citation path per page. If a bot cannot read a page, no amount of content work will help, and we would rather know first. Crawler logs start on the Professional plan.

Second, outcomes. Visitor analytics attribute AI-referred visits and conversions, through a lightweight script, a Google Tag Manager template or the WordPress plugin. That lets us tell a client whether the prompts we won produced a visit that mattered.

Turning analysis into a to-do list

The Action Board collects prioritized GEO to-dos, and its Discovery agent investigates the data weekly and suggests up to five evidence-backed actions per run. We assign them and review them weekly. Agent Chat helps with ad hoc questions on live data, and can generate a PDF report when a client wants one.

What we say about limits

No tracking method can guarantee a recommendation. The prompt set is a sample. And the data tells you where to look, while the improvement still comes from fixing access, publishing better pages and earning mentions on the sources engines trust.

For the routine above, Promptwatch is the platform we run, because the prompt data, the sources, the crawler logs and the conversions are in one place. Start small, read the answers, and let the trend tell you what to do next.