explainx.ai350K+ learn from us
TrendingAI News TodayExplainx for Business
Pricing
explainx.ai

Upskill in AI — 16 free pathways, live workshops & bootcamps, and 50+ courses from practitioners. Plus the skills, tools, and MCP servers to practice on.

follow us

follow on google

Add explainx.ai as a preferred source

corporate training

support@explainx.ai

get started

Find your pathTake Free Evaluation

community

Join the community

learn

mind: share how you thinkpathways — start freeworkshopsbootcampscoursescompare Explainxcertificationsmock testsexplainx universitycorporate traininglearn skills & mcp

discover

skillsmcp serversexplainx mcpestacktoolsmdx readeragentsllmsdesignsdictionarypeopleagi trackerfelony benchranks

company

aboutvisionmissionteaminstructorsteach on explainxpartnershipscommunityhackathonscareers

content

daily AI newsstate of AI — live resultsblogreleasespromptsgeneratorsresource libraryfor LLMsexplainx.ai kids

solutions

all solutionsdeveloper upskillingmarketing upskillingproduct manager upskillingleadership upskilling

newsletter · weekly

Get AI news, tools, and insights in your inbox.

supportcontactprivacytermsdata rightshow we create contentsubmission guidelines

© 2026 AISOLO Technologies Pvt Ltd

explainx.ai

On this page

  • Headline numbers
  • Worked example: CRM query in AI Mode
  • Implications for builders and marketers
  • Per-engine patterns Supercite reports
  • Category stability
  • Method limits Supercite discloses
  • What to do this week
  • Connection to Supercite's listicle paper
  • Enterprise procurement and compliance angles
  • Engineering teams shipping RAG shopping bots
  • Statistical cautions Supercite acknowledges
  • Competitive intelligence ethics
  • Table: rank stability vs rank value
  • Workshop exercise for marketing teams
  • When drift helps you
  • Search ads versus AI answers
  • Deep dive: interpreting "84% changed"
  • Deep dive: cited-page half-life
  • Builder takeaway for eval harnesses
  • Legal and disclosure
  • Sample weekly scorecard format
  • Related reading
← Back to blog

explainx / blog

Supercite Study: 84% of AI Shopping Answers Change in One Day

GEO, Google AI, ChatGPT

Part of Google Gemini and DeepMind

Supercite asked ChatGPT, Gemini, AI Overviews and AI Mode the same 210 buying questions on two days. 84% of brand lists changed. Method, limits, and what builders should measure.

Nov 18, 2026·8 min read·Yash Thakker
add explainx.ai
go deep
Supercite Study: 84% of AI Shopping Answers Change in One Day

Eighty-four percent of AI shopping answers changed brand lists overnight in a Supercite study published November 18, 2026. The team repeated 210 buying questions on ChatGPT, Gemini, Google AI Overviews, and AI Mode on November 17 and 18, comparing 839 answers.

The result challenges one-screenshot GEO audits. If your dashboard shows a single day's recommendation, you may be measuring noise as much as position.

Daily briefFrom Yash · 350K+ students taught

Catch up on AI

One AI story explained in plain English, plus one thing to try. Every day, free. Unsubscribe anytime.

Headline numbers

Supercite reports:

table · 2 cols
MetricValue
Answers with different brand sets84% (701/839)
Brands named day one but not day two27%
Rank #1 named again next day90% (still #1 only 63%)
Rank #6+ named again61%
Category leaders keeping spots73% vs 51% for smaller brands
Same cited pages both days42%

Gemini changed most (95% of questions). Google AI Overviews changed least (67%) but still moved two thirds of lists.

Worked example: CRM query in AI Mode

Speech bubble linked to source cards, for answers built from whichever listicles load that daySpeech bubble linked to source cards, for answers built from whichever listicles load that day

Supercite contrasts Google AI Mode answers for "easiest CRM for a team that has never used one":

  • November 17: Less Annoying CRM ranked first after reading Zapier's listicle.
  • November 18: HubSpot ranked first after reading Slack's guide and HubSpot's product page; Less Annoying CRM disappeared.

Nothing about the CRM products changed overnight. The pages the engine read changed, so the summary changed.

That matches Supercite's earlier finding that ~90% of recommended brands appeared on cited listicles—this follow-up shows which listicles load is unstable.

Implications for builders and marketers

Single checks lie. If you ask "does ChatGPT recommend us?" once, tomorrow may disagree. Measure frequency across samples, as we argued when covering Berlin's AI Overviews traffic loss.

Leaders enjoy structural advantage. Brands that appear on many listicles survive page rotation; niche brands drop when the engine picks different articles.

Source monitoring beats answer monitoring. With only 42% page overlap, track which URLs AI cites, not only whether your name appears.

Consumer privacy modes do not fix GEO. Google's temporary threads in AI Mode detach history for a user session but do not stabilize global grounding corpora.

Per-engine patterns Supercite reports

table · 3 cols
EngineAnswers changedSame #1 brand
ChatGPT88%71%
Gemini95%57%
AI Overviews67%66%
AI Mode84%58%

ChatGPT kept top picks more often; Supercite hypothesizes shortlist-from-memory before browsing. Gemini rotated hardest—relevant as Gemini 4 Hydrogen expands Search fan-out.

Category stability

Accounting software barely moved (79% same brands). Running shoes and AI search visibility tools moved most. New categories without settled canonical lists drift by design.

Method limits Supercite discloses

  • Two days, one sample per day—includes model stochasticity.
  • Automated brand matching with noise from platform names filtered.
  • Vendor Supercite sells monitoring; treat numbers as reproducible claims, not independent academia.

Hacker News discussion on item 50549677 includes questions about temperature settings and query wording. Supercite should disclose engine configs in their weekly update; until then, rerun critical queries yourself.

What to do this week

  1. Pick 10 revenue-critical questions buyers actually type.
  2. Sample each on four surfaces daily for seven days.
  3. Log brands, ranks, and cited URLs.
  4. Map listicles you are not on; pursue placement, not prompt hacks.
  5. For API products, compare drift to Perplexity Monitor-style alerting.

Connection to Supercite's listicle paper

Supercite's November 17 study argued that most recommended brands came from cited listicles. This November 18 follow-up shows those listicles rotate daily.

Together the two posts imply a two-layer GEO model:

  1. Inclusion layer: Are you named on the listicles engines tend to read?
  2. Sampling layer: Which listicles did today's run actually fetch?

You can pass layer one and still fail layer two if your placements sit on pages the model did not retrieve that day.

Enterprise procurement and compliance angles

Procurement teams increasingly ask vendors whether "the AI recommended us." Supercite's data suggests the honest answer is "it depends on the day and engine."

For RFPs, report distributions—for example, named in 6 of 8 daily samples—not yes/no. That aligns with how reliability engineering reports uptime, not single ping results.

Engineering teams shipping RAG shopping bots

If you ship your own buyer assistant, you inherit the same instability unless you fix retrieval corpora. Consumer engines refresh web results per query; your bot will too unless you pin sources.

Mitigations:

  • Curated allowlists of review sites for shopping categories.
  • Versioned snapshot corpora refreshed on a schedule you control.
  • Explicit citations so users see which list moved the answer.

See also RAG trenchcoat memory patterns for lightweight state without over-fetching.

Statistical cautions Supercite acknowledges

Two days cannot separate model randomness from true ranking policy changes. Supercite promises a full-week update; until then, treat percentages as directional.

When reproducing internally, fix locale, account, and IP variables. Supercite used US English consumer surfaces; enterprise tenants may differ.

Competitive intelligence ethics

Tracking competitor mentions in AI answers is legitimate market research. Scraping competitor sites to poison their SEO is not. Supercite's lesson is about measuring public answers, not manipulating rivals.

Table: rank stability vs rank value

table · 3 cols
Rank on day oneNamed again next dayStill same rank
#190%63%
#2–379%(not split in post)
#4–566%—
#6+61%—

Being mentioned matters for awareness; holding exact rank matters for default-choice psychology. Both decay overnight.

Workshop exercise for marketing teams

Run a 48-hour drill:

  1. Agree on five buyer questions that matter to revenue.
  2. Assign one teammate per engine to screenshot answers morning and evening.
  3. Diff brand sets and cited URLs in a spreadsheet.
  4. Present share-of-voice distributions, not winner-take-all narratives.

If your team cannot sustain the drill manually, that is the business case for monitoring tools—Supercite sells one; build internal or buy, but do not skip measurement.

When drift helps you

Not every change is bad. If you improved listicle placement or shipped a comparison page engines newly cite, overnight rank jumps are positive signal.

Track whether cited URLs include properties you control. A jump tied to your domain is strategy working; a jump tied to random affiliate blogs is volatility.

Search ads versus AI answers

Paid search teams already know auction volatility. AI answer drift is organic analogue: multiple winners per query class, rotating sources.

Blend teams: SEO, paid, and GEO sampling should share one question list.

Deep dive: interpreting "84% changed"

"Changed" in Supercite's methodology means the set of brand names was not identical day to day, not that every rank permuted. Overlap metrics in the post separate brand disappearance from rank churn.

When you replicate internally, store full answer text, not only brand extractions, so you can audit false positives from generic nouns misclassified as brands.

Deep dive: cited-page half-life

Search bar feeding one answer with source markers, for GEO teams tracking citation churnSearch bar feeding one answer with source markers, for GEO teams tracking citation churn

Forty-two percent page overlap implies median citation half-life under one day for shopping queries—roughly similar to fresh news SERPs, unlike stable Wikipedia slots.

Content strategists should invest in evergreen comparison pages on your domain plus credible third-party lists, not only blog spam, if you want AI surfaces to find you on more random draws.

Builder takeaway for eval harnesses

If you benchmark shopping assistants, freeze retrieval sets during A/B tests. Otherwise you are measuring Google's crawl lottery alongside your prompt changes—exactly the confound Supercite highlights.

Legal and disclosure

If public claims say "#1 in ChatGPT," substantiate with dated samples or soften language. Regulators and competitors increasingly care about AI visibility marketing the way they cared about search ranking guarantees a decade ago.

Sample weekly scorecard format

table · 7 cols
QuestionEngineDayBrands listedYour brand named?RankTop cited URL
Best CRM for startupsAI ModeMon6Yes3example.com/list
Best CRM for startupsAI ModeTue5No—other.com/guide

After seven rows per question, compute mention rate and average rank when mentioned. That single table communicates volatility to executives better than anecdotes.

Add a citation churn column tracking whether the top URL changed. That isolates source instability from brand instability when diagnosing a sudden drop.

Finally, compare engines on the same question within one hour. Supercite's design used day boundaries, which already showed high churn; intraday checks may be needed for launch windows when models update silently, as we track for GPT-6.2 power-user reviews. Treat weekly rollups as the minimum reporting period for leadership.

Product teams shipping comparison landing pages should time publication before major model updates when possible, then watch whether AI citations pick up the new URL within Supercite's typical 42% day-over-day page retention band. Log model version notes when vendors ship silent updates. Archive screenshots with timestamps always.

Related reading

  • Google AI Mode temporary threads
  • Gemini Hydrogen Search upgrade context
  • Perplexity orchestrator multi-model API
  • Replica skill GEO impressions
  • OpenAI GPT-6.2 launch week

Sources: Supercite, November 18 study and Supercite listicle study.

Spotted something out of date? Let us know.
Daily briefFrom Yash · 350K+ students taught

Catch up on AI

One AI story explained in plain English, plus one thing to try. Every day, free. Unsubscribe anytime.

  • ✓ Free
  • ✓ One email a day, no spam
  • ✓ Unsubscribe anytime
Yash Thakker

Written by

Yash Thakker

Yash is an AI expert with over 300K learners. Join his workshops →

View Yash Thakker in People in AI →

Related posts

Oct 27, 2026

ChatGPT Gives Partner Publishers a Priority Lane: What Is Claimed and What Is Verified

A researcher at Peec AI reports that content from OpenAI licensing partners reaches ChatGPT as ready-made summaries placed ahead of ordinary web results. We separate what he measured from what OpenAI has confirmed, and what it means for publishers and anyone optimizing for AI search.

Oct 5, 2026

ChatGPT Visual Ads: OpenAI Will Show Ads While You Generate Images

OpenAI announced a visual ad format for ChatGPT, first tested during image generation for a small group of US advertisers later in October 2026. It also expanded its measurement partner list and published first advertiser results. Here is what is confirmed, what is not, and what to do about it.

Sep 26, 2026

ChatGPT Maps: Dedicated Local Search at chatgpt.com/maps

OpenAI rolled out ChatGPT Maps as its own web destination: conversational restaurant, attraction, and trip planning with pins on a map, reachable from the sidebar or directly at chatgpt.com/maps. The map widgets inside ChatGPT Search are not new; the product change is starting in Maps instead of a general chat — and it sits upstream of August's in-chat restaurant bookings.