AI Commerce Research™ · Research Map

How AI Decides

AI does not simply see a brand and recommend it. Somewhere between discovery, retrieval, understanding, evaluation and selection, a decision gets made. Atom Foundry is researching what happens at each stage, one study at a time.

What we know. What we have measured. What we still don't understand.

This page is not a claim that Atom Foundry has solved AI recommendation. It is the opposite. Here is the system we are trying to understand. Here is the evidence we have collected so far. Here are the questions we have not solved yet. Every new study we publish becomes a new piece of this map, not just a new article.

The Decision Path

One possible path from memory to purchase

This is a working research model, not a claim about a fixed AI pipeline. Real systems may skip stages, run several at once, or loop back before answering.

1
Memory
What the model already knows before the conversation starts.
2
Retrieval
What live information the model finds and pulls in.
3
Understanding
What the model concludes your brand actually is.
4
Candidacy
Whether your brand enters the consideration set at all.
5
Evaluation
How the model compares the candidates against each other.
6
Recommendation
Which brand the model actually chooses to say out loud.
7
Stability
Whether the same answer holds up on the next run.
8
Confidence
How certain the model actually is behind that answer.
9
Purchase
Whether the recommendation ever turns into a transaction.
1 · Memory
Partially Measured

What does AI already know?

Before a shopping question is ever asked, a language model already carries some notion of which brands exist and how they tend to be positioned. That prior knowledge comes from training, not from the live conversation, and it can shape an answer before retrieval or evaluation even begin.

What we've found

Brand prominence appears to matter, a little. Wikipedia fame alone explains 1.2% of recommendation frequency. Widening to four public signals, cross-lingual reach, domain age, and recent media volume, raises that to just 11.2% combined, still far under the 61.4% the model's own past behavior explains about itself. Measured store quality explains almost none of it. A separate test asked directly what a model claims to know about a brand, then checked whether any of it shows up in a real recommendation: 75.8% of possessed facts never appear (95% CI 69.9-81.6%, n=1,392 fact checks across 9 brands). Knowing about a brand and using what it knows are two different things, and that gap does not shrink for brands that already win more often (r=-0.04, n=9). A causal follow-up tested whether that gap is fixable: inject one real, verified fact directly into context for 4 brands that barely get recommended today, as if retrieval had just succeeded. Average mention-rate lift across the cohort was 77.9 percentage points, but every brand showed the lift outpacing the rate the specific fact actually got cited, a Linkage Gap signature, more evidence the bottleneck is getting information in front of the model at generation time, not whether the model is capable of reasoning with it once it's there.

What we don't know

What exactly enters a model's memory, how strongly a brand is represented there, and why a possessed fact gets pulled into one generated answer but not another. Four easily-measurable public-footprint signals, and simple win-rate, have now been ruled out as the main answer; the actual retrieval-at-generation-time mechanism remains genuinely open. The fact-injection test simulates a successful retrieval step rather than measuring how often real retrieval actually surfaces the right fact, that's a separate, harder question.

2 · Retrieval
Measured

What information does AI find?

When a model has live web access, it can supplement whatever it already knows with real time retrieval. A single switch, search on or off, turns out to matter more than almost anything else we have tested.

What we've found

77% of product recommendations changed when web search was switched on, same model, same questions, the only change was retrieval.

What this tells us

Retrieval is not a minor adjustment to AI recommendations. In many categories, it can fundamentally change the answer, and how much it changes the answer differs by category.

3 · Understanding
Measured

What does AI think your brand actually is?

There is a difference between AI being able to read your information and AI understanding what that information means. A store may clearly describe itself as a performance running brand, while a model interprets it primarily as a fashion brand.

What we measure

Category understanding, product understanding, attribute understanding, brand positioning, intent alignment, and the semantic relationships between them.

4 · Candidacy
Measured

Does your brand enter the consideration set?

A brand cannot be recommended if it never becomes a candidate.

Getting considered and getting selected are different problems, governed by different things. Our full population study identified one store factor that consistently separates brands that are ever recommended from brands that never are, and it holds up under every check we ran.

What we've found

We went further and tested it causally. A brand with zero history, zero reviews, and zero press was invented from scratch and pitted against an entrenched category leader across 36 shopping intents. It won 0 of 360 runs. Giving it a review score changed that immediately, it started winning 53.1% of comparisons. Press mentions and sales-volume claims barely moved the needle, 1.9% and 0.3%. A separate causal test manipulated hidden upstream context instead of store-side evidence: a single fabricated line in the system message, invisible to the shopper, claiming they'd just seen an ad for a brand. Candidacy jumped to 97-100% under nearly any hidden-context condition, but winner rate depended heavily on which one, topping out at 88% for the fabricated ad-exposure claim, ahead of a condition that combined that same claim with a real, verified product fact.

5 · Evaluation
Measured

How does AI compare the candidates?

Once a handful of candidates are inside the consideration set, the model has to compare them somehow. By price? By quality signals? By reviews? By authority? By familiarity? By product fit? By evidence? By category relevance?

What we've found

We handed the model one comparison fact at a time between two genuinely close brands. A better star rating decided the pick in 160 of 160 runs, 100%, zero exceptions across 16 contested pairs. A longer, more specific spec list won 81.9% of runs. A lower price and faster availability won only 60.6%, barely above a coin flip.

What we don't know

How these signals interact when they conflict, for example a cheaper product with a worse rating, and whether the same hierarchy holds across categories.

6 · Recommendation
Measured

Which brand does AI actually choose?

This is where Recommendation Intelligence™ begins. We measure Recommendation Frequency™, Recommendation Share™, Recommendation Position™, the reasons a model gives for its pick, and the differences between the brand that wins and the brands that don't.

The open part

We can measure who gets recommended and how often. The mechanism behind the selection itself is not fully explained.

We can also measure what reasons a model gives for its recommendation. We do not yet know whether those stated reasons are the actual causal drivers of the selection, or a justification constructed after the fact.

The Winner vs The Loser
Partially Measured

We know who won. Now we want to know why.

Every recommendation has a winner and, quietly, a brand that lost. We can already observe both sides of that outcome. A first, direct test of three of the candidate signals below, rating, specificity, and message format, together in the same comparison, found rating alone decides the winner 90.8% of the time. A named follow-up isolated authority: alone, a disclosed third-party mention decided the winner 85.2% of the time, the second-strongest single signal measured in this series, but crossed against rating in the same comparison its own lift shrank to about 1.5 points, a same-direction point estimate too small for the sample to call statistically confirmed. A sibling study then isolated brand familiarity, a bare, unsourced claim of broad recognition with no named source: alone it decided the winner 79.8% of the time, but crossed against rating its own lift shrank to just 0.2 points, smaller still and equally unconfirmed. Neither residual effect survives a properly clustered significance test at the level of independent purchase intents, so both are best read as small, consistent directions worth more data, not settled findings. Which of the remaining signals matter, and how they interact with rating, is still open.

Shopping intent: "Best waterproof running shoe for wide feet under $200"
Winner
Brand A
Last place
Brand B
Compare
PriceProduct attributesReviewsContentAuthorityBrand familiaritySemantic positioningEvidenceStructured informationAI understandingOther observable signals

What separates the brand AI selects from the brand it leaves behind?

7 · Stability
Emerging

Does the decision persist?

A model might recommend a brand today, but will it recommend the same brand again tomorrow, in the next run of the same question, or even three questions later in the same conversation? We measure recommendation stability across two different axes: between sessions, whether the same winner keeps winning weeks apart, and within a single conversation, whether an early mention survives to the final answer.

What we've found so far

Between sessions, recommendation behavior is more stable than expected, even in places where drift would seem likely. Within a single conversation, it's much less stable: an explicitly favorable introduction survives to the final pick only 49.5% of the time across 200 four-turn conversations, ranging from 100% for the strongest brands down to 0% for the weakest, and a brand's real-world baseline recommend rate only loosely predicts which group it falls into.

8 · Confidence
Partially Measured

How certain is AI about the recommendation?

A model can say it recommends Brand A. But how strong are the reasons behind that pick? How much would the answer change with slightly different phrasing? How close are the alternatives, and what is the actual margin between the first choice and the second?

Seven independent methods now test one piece of this: whether the model's hedged-vs-assertive language tracks its real internal confidence. It mostly doesn't (r=0.03), and for the most-confident pick type, the language runs backwards. Recommendation Confidence™ is the metric we expect to keep growing out of answering the rest.

9 · Purchase
Open Research

Does recommendation actually influence the transaction?

Recommendation is not purchase.

A model may recommend a brand, and the person on the other end might still click somewhere else, change their mind, compare more options, abandon the purchase entirely, or buy from a competitor anyway. How an AI recommendation translates into actual commercial behavior is the final, and least understood, link in this chain.

10 · What We Know, What We Don't

The map so far

Memory
Prominence and fame appear to matter more than measured store quality; injecting a missing fact directly can lift mention rate 77.9pp.
Partially Measured
Retrieval
Search access can dramatically change which brand gets recommended.
Measured
Understanding
Semantic understanding of a brand can be measured directly.
Measured
Candidacy
Zero-history brands lose every run until reviews appear; hidden ad-exposure framing alone can push winner rate to 88%.
Measured
Evaluation
A better rating decides the comparison almost every time; price barely moves it.
Measured
Recommendation
We can measure who wins, and describe why they are described as winning.
Measured
Stability
Stable between sessions, much less stable within one: only 49.5% of favorable introductions survive to a forced final pick.
Emerging
Confidence
Hedged language barely tracks real model confidence (r=0.03), and runs backwards for the most-confident pick type.
Partially Measured
Purchase
The relationship between recommendation and transaction remains open.
Open Research
11 · The Open Questions

What we still don't know

Why does AI select one candidate over another?
What determines entry into the consideration set?
How much of recommendation behavior comes from training data provenance?
How does AI weigh evidence against familiarity?
What creates recommendation confidence?
When does a recommendation actually change purchasing behavior?

Every unanswered question is a research opportunity.

12 · Research Library

Research behind the map

Grouped by which stage of the decision path each study speaks to, not by publish date.

Candidacy
Mechanism Study · CandidacyMeasured
Candidacy vs Selection
One store factor gets you in. It predicts nothing about who wins once you're there.
Read report
Mechanism Study · CandidacyMeasured
A Bad Rating Barely Touches Candidacy. It Wrecks the Final Round.
Negative reputation does not filter a brand out of consideration, candidacy rose 39.0% to 54.5% (3 of 4 brands). It craters selection instead, win rate fell 83.5% to 24.3%.
Read report
Mechanism Study · CandidacyMeasured
We Invented a Brand With Zero History. Reviews Got It Picked Anyway
A brand with no evidence at all won 0 of 360 runs. Reviews were the one signal that changed that.
Read report
Mechanism Study · CandidacyMeasured
Tell the Model You Saw an Ad. It Recommends That Brand 88% of the Time
A fabricated ad-exposure claim in hidden context beat a combined brand+real-fact condition for winner-rate lift.
Read report
Mechanism Study · CandidacyMeasured
We Described One Brand to the Model, Real or Invented. It Recommended That Brand Anyway.
Clearer framing barely moved candidacy for 12 of 13 brands, even a fully invented one hit the same near-100% ceiling.
Read report
Mechanism Study · CandidacyMeasured
Ask Like You're Googling It, and the AI Recommends the Brand 15.6 Points Less
Same facts, same brand, only the question's wording changes. Bare-keyword phrasing loses to a full natural-language question by 15.6 points, found independently twice.
Read report
Mechanism Study · CandidacyMeasured
Rank First in the Cited Source, and the Model Always Agrees. Fourth Place Wins 1.2% of the Time.
Candidacy barely drops with source position (100% to 40% to 35.2%). Selection collapses to almost nothing past rank 1 (100% to 1.2% to 0%).
Read report
Mechanism Study · CandidacyMeasured
Under 4.1 Stars, the Model Ignores an Unknown Brand. At 4.9 Stars It Picks It 85% of the Time.
Review rating is the lever and has a threshold (0% at 3.8 stars, 18.1% at 4.4, 84.7% at 4.9). The review count decides whether the model believes it (2.8% at 5 reviews, 52.5% at 100).
Read report
Mechanism Study · CandidacyMeasured
In a Ranked Source, the Higher-Ranked Brand Wins 100% of the Time, Even Against the Model's Favorite.
Rank beats brand: an unknown brand at #1 of a ranked source wins 100%, one place lower 0%, with no gradient. Instruction, placement and real brands change nothing; an unordered list gives 0.8%.
Read report
Mechanism Study · CandidacyMeasured
Press Coverage Moves the Model Only When It Answers the Exact Question Asked. Generic: 1.9%. Matching: 80.6%.
A press mention counts only if it answers the exact question asked (80.6% vs 1.9% generic) or carries verifiable facts (52.8%). The same endorsement for an adjacent use case wins 0%.
Read report
Mechanism Study · CandidacyMeasured
Describe a Company by Its Side Feature and It Falls Off the AI Shortlist: 82.8% to 24.0%. The Model Still Names Its Category Correctly.
A company described mostly by a side feature falls off the shortlist (82.8% to 24.0%) though the model still names its category correctly. Stating the primary category does not repair it.
Read report
Mechanism Study · CandidacyMeasured
Reviews Four Years Old Count as No Reviews at All: 0%. Five Hundred Fresh Ones Beat Thirty Thousand Old Ones, 72.8% to 1.4%.
Reviews posted four years ago count as no evidence (0%), even 30,000 of them (1.4%). 500 reviews from the last 3 months win 72.8%. A recent drop in rating overrides the overall score.
Read report
Evaluation
Mechanism Study · EvaluationMeasured
Hand It a Rating, and It Follows Every Single Time
A better star rating decided the pick 160 of 160 times. Price barely moved it at all.
Read report
Mechanism Study · EvaluationMeasured
Say It Yourself, and the Model Picks You 67.5% of the Time. A Third Party Only Gets 51.1%.
Same fact, same length, only who appears to be saying it changes. Self-claim beats third-party beats a source-free neutral statement, in every brand, across 3,200 calls in two rounds.
Read report
Mechanism Study · EvaluationMeasured
Specific Claims Add 15.7 Points in Spec Driven Categories. They Cost Nearly 5 in Trust Driven Ones.
Same real facts, rewritten as vague marketing copy or concrete PDP style claims. 8 brands, 3 rounds, 3,600 calls: specificity helps in functional categories and stops helping, or reverses, in trust sensitive ones.
Read report
Mechanism Study · EvaluationMeasured
Give It the Better Rating, and It Wins 91% of the Time
Rating, specificity, and format tested together for the first time, competitor also carrying real information. 4 brands, 2 rounds, 6,400 calls: rating decides the winner 90.8% of the time regardless of the other two.
Read report
Mechanism Study · EvaluationMeasured
Mention It Was Featured Somewhere, and It Wins 85% of the Time. Bring In a Rating, and It Nearly Disappears.
Winner vs Loser's named follow-up: a disclosed third-party mention, tested alone then crossed against rating. 4 brands, 2 phases, 2 rounds, 4,800 calls: strong alone, almost swamped once rating is in the room.
Read report
Mechanism Study · EvaluationMeasured
Claim the Brand Is Widely Known, and It Wins 80% of the Time. Bring In a Rating, and the Edge Is Nearly Gone.
Authority's direct sibling: a bare, unsourced familiarity claim, no named source, tested the same two-phase way. 4 brands, 2 phases, 2 rounds, 4,800 calls: strong alone, the most completely swamped signal measured against rating so far.
Read report
Mechanism Study · EvaluationMeasured
Two Signals Get You Most of the Way There. A Third Barely Helps, Format Doesn't Move It at All.
Synthesizes the four studies above: authority, familiarity, specificity, and format tested against each other with rating removed entirely. 12 conditions, 2 rounds, 9,600 calls: specificity leads, format's own effect rounds to zero.
Read report
Mechanism Study · EvaluationMeasured
We Turned the Same Facts Into Bullets. The Model Cited Fewer of Them.
A third, more direct test of format, shifting the outcome from winning a comparison to citation fidelity and vocabulary reuse. 4 brands, 2 rounds, 1,600 calls: structured format cites fewer facts than prose, not more.
Read report
Mechanism Study · EvaluationMeasured
Authority Adds 9 Points in Trust Categories. Familiarity Adds 14.
Signal Hierarchy's direct extension: does category type change which signal wins. 8 brands, 4 functional and 4 trust sensitive, 6,400 calls: authority and familiarity move the brand more in trust sensitive categories, the opposite pattern from specificity.
Read report
Mechanism Study · EvaluationMeasured
Mark the Listing Sponsored, and It Loses 18.4 Points in a Head-to-Head Pick
Adjudicates two conflicting outside numbers on paid placement. Same 4 brands, one label swapped: organic won 74.2%, sponsored won 55.8%, an 18.4pp penalty on all 4 brands.
Read report
Mechanism Study · EvaluationMeasured
Match the Sponsored Listing to the Search Term, and the Penalty Overshoots by 21 Points
Direct follow-up to Sponsored Tag Penalty. One sentence echoing the exact search term into a sponsored listing didn't just recover the 18.4pp penalty, it beat the organic baseline outright: 95.2%.
Read report
Recommendation & Stability
Flagship · RecommendationMeasured
The State of AI Recommendations Across Commerce 2026
20,000 recommendations, five categories. The study that started this series.
Read report
Mechanism Study · RecommendationMeasured
The Model Predicts Itself
Nothing about your brand predicts recommendation as well as the model's own past behavior.
Read report
Mechanism Study · RecommendationMeasured
The Model Confabulates Its Reasons
Almost every reason the model gives for a pick is unique. It rarely repeats itself.
Read report
Mechanism Study · StabilityMeasured
Two Months Later, the Model Still Agrees With Itself
50 intents, six sweeps across two months. 43 kept the exact same #1 brand every single time.
Read report
Mechanism Study · StabilityEmerging
AI Knows Your Website
Recall accuracy holds steady across recommendation stability bands.
Read report
Mechanism Study · StabilityEmerging
It Recommends You First. By Turn Four, It's Moved On
49.5% of favorable brand introductions survive a 4-turn conversation. One brand with a solid baseline survived just 5% of the time.
Read report
Mechanism Study · StabilityMeasured
The Cited Source Changes. The Winner Almost Never Does.
Live Retrieval's direct follow-up: real categories, live search on, does the winner move when the cited source does. 8 categories, 2 rounds, 320 calls: winner stability held near 90% even as source stability ranged from 2% to 80%.
Read report
Mechanism Study · StabilityMeasured
Reword the Question Three Ways. The Winner Mostly Stays the Same.
Source Stability's direct follow-up: same categories, three different wordings per question, same buying intent. 8 categories, 240 live calls, 2 rounds: the winner mostly held even when the question was reworded, combined effect borderline at p=0.063.
Read report

The map is incomplete.

We're still discovering what happens between being seen and being chosen.