Neuromarketing and AI image analysis, and how we weight the score.
Eye tracking research has shown for more than a century that the eye picks what to look at before the viewer starts thinking, and that the job in hand changes where it goes. This is the research our image analysis is built on, the path we've taken since 2019 and the rule we use to weight the score.
What neuromarketing measures
Neuromarketing studies how people's eyes and brains respond to marketing. For product images most of what's useful comes from one method, eye tracking, which records where people look, in what order and for how long.
The finding we rely on most is old and well replicated. The eye picks what to look at before the viewer starts thinking, and the job they're doing changes where it goes. A shopper flicking through search results on a phone and a shopper reading a comparison table are doing different jobs, so their images shouldn't be judged the same way.

The research we build on
Our framework rests on more than a century of work. A few of these dates are often misquoted, so we've checked them against the original papers.
| Year | Who | What it showed |
|---|---|---|
| 1879 | Javal | Named the jumps the eye makes when reading saccades, from observations made in his lab |
| 1898 | Huey and Delabarre | Early eye trackers, attached to the eye to record its movements while reading |
| 1935 | Buswell | Photographed 200 people looking at pictures and found their instructions changed where they looked |
| 1967 | Yarbus | Eye Movements and Vision, published in English, showed the viewer's task steers the eye |
| 1980 | Treisman and Gelade | Simple features such as colour and orientation register early and all at once, before attention |
| 1998 | Itti, Koch and Niebur | The first working computer model of visual saliency |
| 2004 | Pieters and Wedel | Eye tracked more than 3.6k consumers looking at 1,363 magazine ads |
| 2006 | Nielsen Norman Group | The F shaped pattern people use to scan web pages |
| 2009 | Judd and colleagues, MIT | 1,003 images eye tracked by 15 viewers, the start of the MIT saliency benchmark |
| 2012 | Pieters and Wedel | People get the gist of an ad in a single glance of a tenth of a second |
| 2019 | HTC and Tobii | The Vive Pro Eye goes on sale with eye tracking built into a VR headset |
| 2022 | Jiang and colleagues | The first eye tracking dataset of ecommerce images |
| 2025 | Hosseini and colleagues | SUM, a saliency model with separate modes for photos, ecommerce images and interfaces |
Two lessons run through all of it. Each step made attention data bigger and cheaper, which is what made prediction possible. And from Buswell to Yarbus to Pieters and Wedel, the viewer's task keeps deciding where the eye goes.
Our path since 2019
We started with headsets. In 2019 we built VR eye tracking for J&J, the same year HTC put eye tracking into the Vive Pro Eye. It showed us how people actually take in content and products, rather than how they say they do.
Since then most of what we make for brands has moved to the phone, on Amazon, in social feeds and on product pages. So we turned what eye tracking taught us into a framework of five measures, and we use it to brief, check and fix ecommerce images before they go live. The next step was scale. Neural networks trained on eye tracking data can predict a heatmap in seconds, so every image can be scored rather than a sample. This year we're building the framework into Freak Lab as an image analyser that gives every image a score out of 100.
The five measures
- Visual saliency. What grabs the eye before the viewer starts thinking.
- Three second rule. Whether the main benefit lands at a glance, at the size the shopper actually sees it.
- Trust anchors. Faces, hands, numbers and proof that pull the eye and reassure.
- Reading pattern. The order the eye takes across the image.
- Colour. Whether the colours fit the category, the brand and the message.
How we weight the score
Each measure is scored out of 100, and how much it counts towards the overall score depends on where the image will be seen. These are our starting weights.
| Measure | Main image in mobile search | Gallery images and infographics | A+ modules |
|---|---|---|---|
| Visual saliency | 35 | 15 | 10 |
| Three second rule | 40 | 30 | 25 |
| Trust anchors | 5 | 25 | 30 |
| Reading pattern | 5 | 20 | 25 |
| Colour | 15 | 10 | 10 |
| Total | 100 | 100 | 100 |
Main image in mobile search. The tile is around 150 - 200 pixels wide on a phone and gets a fraction of a second next to its competitors. When people choose that fast, what stands out can outweigh what they'd normally prefer, and the gist of an image is taken in within a single glance. So the three second rule and saliency carry 75 of the 100 points. Amazon doesn't allow text, badges or graphics on the main image, and the first look at a single product goes to the centre whatever the layout, so trust anchors and reading pattern only get a token weight.
Gallery images and infographics. Shoppers open the gallery on purpose, and Baymard found 56% start a product page by exploring the images. Grabbing the eye matters less here than what the eye finds, so saliency drops and trust anchors and reading pattern rise. The three second rule stays the biggest single weight, because text that reads well on a desktop often can't be read on a phone, and an infographic nobody can read fails at everything else.
A+ modules. A+ sits lower on the page in front of shoppers who are already considering the product. Its job is to persuade and reassure, so trust anchors and reading pattern carry the most weight. Comparison tables are read row by row, and a stack of modules needs a clear place to start.
Colour. It gets less than people expect. Most of colour's pull on the eye comes from contrast, and contrast is already part of saliency, so counting it twice would reward loud images. Research on what individual colours mean is also weaker than marketing folklore suggests, and the popular claim that up to 90% of snap judgements come down to colour has no source behind it. We score colour on fit with the category and the brand, and on how much the product's own colour helps it be recognised in a small, blurry thumbnail.
The rules on top of the weights
A simple weighted average can reward images that are eye catching and confusing at the same time. Five rules stop that.
- Amazon's rules come first. A main image that breaks them, with a background that isn't pure white, a product filling well under 85% of the frame or text on the image, is flagged and its score capped however well it does elsewhere.
- Saliency counts in full only when the image is understood. Attention amplifies how shoppers already feel about a product rather than creating liking on its own. An image that grabs the eye but isn't understood keeps as little as half its saliency points.
- Text only counts if it can be read. Claims, numbers and reading order on gallery and A+ images are only credited when the text is legible at the size it appears on a phone.
- Each signal is scored once. Contrast and the pull of faces and text belong to saliency. What a face or claim does next belongs to trust anchors. One strong feature can't score in three places.
- Main images are judged against their neighbours. Every compliant main image is a product on white, so we score saliency inside a simulated mobile results page, against the tiles around it.
Inside trust anchors, a face looking towards the product or the claim earns credit, and one staring out of the image can take it away by holding the eye. Badges help up to a point, and more than two count against an image.
What the models can and can't do
On photos, the best saliency models now predict where people look almost as well as real eye tracking does. On product images they're weaker. Models lose around 40% of their accuracy when they're moved to a new kind of image, and on ecommerce images a model trained for them matches real eye tracking with a correlation of 0.79, against 0.56 for a leading model trained on photos. Text explains much of the gap, as it draws about five times the attention of objects on some ecommerce images.
Predicted eye paths are much less reliable than heatmaps, so we treat them as a guide to the first few looks. A heatmap also shows what gets seen, which isn't the same as what persuades. That's why saliency is one measure of five, and why our scoring engine grades each image from the measured data against the framework rather than reading meaning into a heatmap.
How the weights will change
No published study links all five measures to Amazon sales, and none of the attention tools we've looked at publish how their overall scores are weighted. So these weights are our expert starting point, built from the research above, and we're publishing them so clients can see what drives a score.
They'll be tuned against real results. Amazon's Manage Your Experiments splits shoppers between two versions of an image or A+ module, so every finished test tells us which image won with everything else held still. We'll fit the weights to those results for each use case, alongside a small eye tracking study on each image type and the judgement of our own designers, and only move them once enough tests have landed to justify it.
- Shoppers judge a product image at a glance, and what they're doing changes where they look
- Our score weights five measures differently for search, gallery and A+ images
- An image has to be understood before its attention counts in full
- The weights are a starting point, refined with real A/B test results
Sources
- Did Javal measure eye movements during reading?, Wade and Tatler, Journal of Eye Movement Research, 2009
- A model of saliency based visual attention for rapid scene analysis, Itti, Koch and Niebur, IEEE, 1998
- Ad gist, ad communication in a single eye fixation, Pieters and Wedel, Marketing Science, 2012
- The stopping power of advertising, measures and effects of visual complexity, Pieters, Wedel and Batra, Journal of Marketing, 2010
- Relative visual saliency differences induce sizable bias in consumer choice, Milosavljevic, Navalpakkam, Koch and Rangel, Journal of Consumer Psychology, 2012
- The visual environment and attention in decision making, Orquin, Lahm and Stojić, Psychological Bulletin, 2021
- The buffer effect, the role of color when advertising exposures are brief and blurred, Wedel and Pieters, Marketing Science, 2015
- The central fixation bias in scene viewing, Tatler, Journal of Vision, 2007
- The influence of banner advertisements on attention and memory, human faces with averted gaze can enhance advertising effectiveness, Sajjacholapunt and Ball, Frontiers in Psychology, 2014
- Does text attract attention on e-commerce images, Jiang and others, CVPR, 2022
- SUM, saliency unification through Mamba for visual attention modeling, Hosseini and others, WACV, 2025
- Modeling saliency dataset bias, Kümmerer and others, ICCV, 2025
- VIVE Pro Eye launches today in North America, HTC, 2019
- Handbook on constructing composite indicators, OECD and JRC, 2008
Questions clients ask us.
What is neuromarketing?
Neuromarketing studies how people's eyes and brains respond to marketing, using methods such as eye tracking. For product images it tells us what a shopper notices first, in what order and whether they understand it.
Why does the weighting change from one image to another?
Because shoppers are doing different things. A main image in search gets a fraction of a second next to its competitors, gallery images are opened on purpose and A+ is read by people already considering the product. The measures that predict success are different in each case.
Why does colour count for less than saliency?
Most of colour's pull on the eye comes from contrast, and saliency already measures contrast. We score colour on how well it fits the category and the brand, so the same contrast isn't counted twice.
How accurate is AI at predicting where people look?
On photos the best saliency models now come close to real eye tracking. On product images they're weaker unless they've been trained on ecommerce images, which is why we tune them with eye tracking on each image type and treat predicted eye paths as a guide to the first few looks.
Does a high score mean more sales?
A high score means an image is likely to be seen and understood, which is the first step to a click or a sale. Price, reviews and rank matter too, which is why we test the winning images with Amazon's own A/B tests.
More from the Resource Centre.

How we score Amazon images before shoppers ever see them.
The five measures behind our neural marketing framework, what each one tests and how we use them to fix Amazon images before they go live.

Amazon A+ content that sells, and what we changed for Feliway.
How we plan A+ content and the image stack above it, from search research to testing, with the changes that doubled Feliway's monthly sales.

Brand value, not compliance, is the biggest AI risk.
What our impact assessments found when real content carried a made with AI label, the rules now in force and six steps to use AI without hurting the brand.
Got a brief like this?
Tell us where you want to grow, and we'll show you how we'd get there.

















