1001 SEO Media
All posts
By 1001 SEO MediaGEOprompt trackingmaintenance

When to Drop a Prompt: Pruning Low-Volume Prompts From Tracking

Prompt lists grow by default and shrink only on purpose. The rules we use to retire low-volume prompts, the ones we never drop, and how pruning keeps AI visibility reports honest.

Every prompt list we inherit from a client's previous setup has the same problem. It only ever grew. Somebody added a prompt after a board meeting, somebody else added twenty from a keyword export, and nobody ever took anything out.

A bloated list does more than waste slots. It distorts every number built on it. Share of voice averages across prompts nobody asks. Visibility trends get dragged by questions that don't matter. And the team spends review time on rows that will never be worth acting on.

So pruning is part of our quarterly routine. Here's how we decide what goes.

Why quarterly

We prune once a quarter because that's how often the demand data can change. In Promptwatch, the platform we run client programs on, a prompt's volume comes from the keywords attached to it, and those keyword volumes refresh at most every three months. Pruning more often means making decisions on data that hasn't moved.

Difficulty uses a rolling 30-day window, so it can shift between reviews. We note those changes monthly but don't drop prompts on difficulty alone.

The three questions

For each prompt, we ask three things in order.

Does it have volume? Promptwatch shows volume as a band of one to five bars, or "No data" if no attached keyword has measured demand. A no-data prompt gets a second look before anything else: often the problem is that nobody attached sensible keywords. If adding broader keywords that describe the same need gives it a band, it stays.

Does it do a job volume can't measure? Some prompts exist for reasons other than reach. These stay regardless of volume (more on them below).

Has it told us anything in the last quarter? If a prompt has volume but we haven't acted on it, haven't reported on it, and it hasn't changed, it's a candidate for replacement by something more useful.

A prompt that fails all three goes.

Prompts we never drop for low volume

Brand accuracy checks. Prompts that ask about the client's pricing, integrations, or compliance status exist to catch AI getting the facts wrong. Promptwatch's fact-check feature compares claims about the brand against the knowledge base and shows how often a wrong claim appears. That's valuable even if three people a month ask.

Competitor comparisons the sales team hears. "Is [client] better than [rival] for agencies?" might never register as a measurable keyword. If it comes up on discovery calls every week, it stays.

Emerging topics. The Promptwatch Academy recommends tracking new topics early, before competitors build visibility around them. A prompt about a regulation that takes effect next year can have no volume today and be one of the most important prompts in a year. We tag these as emerging so they're reviewed on a different basis.

What we do instead of just deleting

Dropping a prompt is rarely the whole story. Three alternatives come up often.

Merge. Two low-volume prompts asking the same thing in slightly different words are often better as one prompt with stronger keywords attached.

Replace. If a prompt is a weak version of a real question, we swap it for the version with demand. Prompt Explorer suggestions from Search Console, People Also Ask, and ranking keywords are where we look for the replacement.

Move. A prompt that matters for one product line or market but not the main monitor goes into a narrower monitor rather than out entirely.

Keeping history

When we retire a prompt, we export its history first. Promptwatch exports prompts, responses, and citations to CSV, so the record survives even after the prompt stops running. If a client asks about it next year, we can show what it looked like.

What pruning does to the numbers

Expect the headline metrics to move after a prune. Removing prompts where the client was always mentioned (often brand-heavy ones misfiled as organic) can drop share of voice. Removing prompts where they never appeared can raise it. We tell clients this before the report lands, and we annotate the date in the trend chart so the step change doesn't look like a performance swing.

That's also why we keep segments separate. Promptwatch tags prompts by type (organic, brand specific, competitor comparison) and intent, so a prune in one segment doesn't muddy the others.

The habit

Most teams treat a prompt list as something you build once. We treat it like a keyword portfolio: reviewed quarterly, cut on purpose, with a reason written next to every prompt that stays despite low volume. If you'd like us to audit an existing prompt list, get in touch.