The best AI crawler tracking tool for Shopify stores, from an SEO agency's desk
How we track GPTBot, ClaudeBot and PerplexityBot for Shopify clients next to Googlebot and Search Console, and why Promptwatch is the tool we run it on.
When a Shopify client asks us which AI crawler tracking tool to buy, our first question back is a boring one: is the store's domain running through Cloudflare? The answer decides what's possible, how fast, and what it costs. The tool comes second.
Our recommendation, once that's sorted, is Promptwatch. It's the platform we run client programs on, and for Shopify it has the one thing most trackers lack: a documented way to get crawler data off a hosted store.
Start with the crawlers you already measure
Classic SEO gave us decent visibility into Google's bots, and that hasn't changed. Google's Search Central page on AI features says AI Overviews and AI Mode have "no additional requirements" beyond normal SEO. A page needs to be indexed and eligible for a snippet. Crawl control for those features is Googlebot, not a separate AI bot. Google-Extended is only a robots.txt token for Gemini training and grounding, and Google says it does not affect inclusion in Search.
For a store there's one more Google crawler worth knowing. Storebot-Google's crawl preferences affect all Google Shopping surfaces, including the Shopping tab.
![]()
Google Search Central, "List of Google's common crawlers", captured November 21, 2026.
And Search Console counts AI feature appearances in the regular Performance report under the Web search type. So the Google half of AI search is already in a tool most Shopify merchants have. What's missing is everything else.
The bots Search Console will never show you
OpenAI runs OAI-SearchBot for ChatGPT search, GPTBot for training, and ChatGPT-User for fetches a person triggers. Anthropic has ClaudeBot, Claude-SearchBot and Claude-User. Perplexity has PerplexityBot and Perplexity-User. Meta's indexer, Meta-WebIndexer, is the one Meta says helps it cite and link content in Meta AI.
None of these report to Search Console. The only record of their visits is in request logs, and on Shopify you don't own the server those logs live on. That's why the Cloudflare question comes first.
How we set it up for Shopify clients
Promptwatch lists Shopify + Cloudflare as a guided crawler log setup. The store's domain goes through the client's own Cloudflare zone, then Logpush (the default for Shopify since October 2026) or a Worker sends logs to Promptwatch. If DNS sits somewhere else, that migration is the real project, and we scope it before anything else.
Once data flows, we look at three things every week:
- Which bots arrive, verified. Promptwatch matches each request to the IP lists the AI companies publish, which keeps impostors using GPTBot's name out of the numbers.
- Errors. Error tracking explains failed fetches. On a store, retired product URLs and redirects are the first place we'd look.
- Crawled versus cited. Every page gets a citation rate. A product guide that OAI-SearchBot reads daily but nobody cites needs better content. A page that never gets crawled needs an access fix.
This is also where the classic and AI sides meet. Promptwatch's Search Insights puts Google Search Console and Bing Webmaster clicks and impressions next to AI crawls, citations and clicks for each page. For a store, that answers a question clients ask a lot: is the page that ranks on Google also the page ChatGPT reads?
What we see clients try first
Plenty of stores start with Cloudflare's free AI Crawl Control dashboard, which is reasonable if the store is already proxied. It shows requests by operator and lets you block bots, but it has no citation data. Some install a Shopify app such as LLMagnet for a bot chart in the admin. Known Agents is a solid log specialist with a free tier. All three answer "who visited". None of them tells you whether a visit turned into an answer or a sale. Promptwatch's visitor analytics covers that, tying AI-referred visits and their conversions back to each page.
On budget: Promptwatch includes crawler logs from the $245 Professional tier, and you can trial it free for a week. The $95 Essential plan doesn't include them, which catches people out.
Where to start
Before buying anything, run the free AI Visibility Report on Promptwatch. It scans ChatGPT, Gemini and Perplexity for your brand and includes a crawler access check, which tells you whether you have a blocking problem before you pay to measure it.