What eBay learned when it switched off its brand ads
Most of the money spent on brand keywords buys clicks you were going to get anyway. eBay checked, and then published the result.
In a field experiment published in Econometrica in 2015, eBay stopped paying for search ads on queries containing its own name, and the sales moved to the free listing. The authors found no measurable short-term benefit from the brand ads. The lesson is not to switch ads off, but to test which of your ads are doing work before you believe the platform report.
What did eBay switch off?
Three researchers, Thomas Blake, Chris Nosko and Steven Tadelis, asked eBay a plain question: what happens to sales if the search ads stop? They answered it by stopping them. The paper, Consumer Heterogeneity and Paid Search Effectiveness, appeared in Econometrica in January 2015.
The first result is the one worth remembering. When eBay stopped paying for ads on searches that contained its own name, the sales didn't go away. People clicked the free listing instead. The authors report no measurable short-term benefit from the brand ads.
Put plainly, the ads were being credited with sales that would have happened anyway. The ad platform's report would have said otherwise, because a report counts a purchase that follows a click as a purchase the ad made. That is the gap the ROAS reality check describes, shown at the scale of one of the largest advertisers online.
What about the other keywords?
The team also paused bidding on non-brand keywords, the generic searches, for 60 days across a 30 percent sample of eBay's US traffic. They report that the measured returns were a fraction of what a standard, non-experimental estimate suggested. The reason is plain once you see it: people who search for a product are, more often than not, people who were already inclined to buy it. One version of the abstract adds that new and infrequent users were positively influenced by the ads. Read that as a clue about where ads do work, not as a rule.
What does it mean for you?
Concede the obvious first. eBay is one of the best known names on the internet, and a brand nobody has heard of will see something different. The authors say as much: ads reach people who don't know you yet. So this isn't a case for turning your ads off. It's a case for knowing which of them are working.
The useful split is the one in branded and category search. Brand searches are people who already know you. Category searches are people who don't. They deserve different budgets and different tests.
Run the test yourself
- Pick two cities that behave alike, with similar sales and similar search volume for your brand.
- Pause brand ads in one of them for four to six weeks and leave the other alone.
- Judge by total conversions from brand searches, paid and free together. The platform's own number will always say the ads worked.
- Check who else bids on your name. If a rival buys it, their ad may sit above your free listing, and pausing could cost you sales. That's our reasoning, not a finding of the paper, which is why you test it.
- Move the saving to something that reaches people who don't know you yet, and measure that the same way. The mechanics of the account are in Google Ads account structure, and the same logic applies to retargeting.
The paper's value isn't the result. It's the habit: switch something off, in a small place, for a short time, and look at what really happens.
Sources
- Consumer Heterogeneity and Paid Search Effectiveness: A Large Scale Field Experiment (Blake, Nosko and Tadelis), Econometrica 83(1), January 2015
- Consumer Heterogeneity and Paid Search Effectiveness: A Large Scale Field Experiment (working paper w20171), National Bureau of Economic Research, 2014
Questions we get asked
Do brand keyword ads work?
In eBay's field experiment, stopping ads on searches containing its own name produced no measurable short-term loss, because sales moved to the free listing. A lesser known brand may see different results, so test your own.
How do I test whether my brand ads are incremental?
Pause them in one of two similar cities for four to six weeks and compare total conversions from brand searches, paid and free combined, not the ad platform's own figure.
Does this mean paid search does not work?
No. The authors report returns from non-brand keywords were a fraction of non-experimental estimates, and that new and infrequent users were positively influenced by ads. The point is to measure, not to stop.
Test your brand keyword spend
We design a holdout for your brand campaigns, run it in two matched markets, and report the total, not the platform's number.
Ask for a scoped auditWhat we do · How we produce it · Who we do it for · Talk to us