Does Advertising Serve as a Signal? Evidence from a Field Experiment in Mobile Search

We develop a field experiment that assesses whether advertising can serve as a signal that enhances consumers’ evaluations of advertised goods. We implement the experiment on a mobile search platform that provides listings and reviews for an archetypal experience good, restaurants. In collaboration with the platform, we randomize about 200,000 users in 13 Asian cities into exposure of ads for about 600+ local restaurants. Within the exposure group, we randomly vary the disclosure to the consumer of whether a restaurant’s listing is a paid-ad. This enables isolating the effect on outcomes of a user knowing that a listing is sponsored—a pure signalling effect. We find that this disclosure increases calls to the restaurant by 77%, holding fixed all other attributes of the ad. The disclosure effect is higher when the consumer uses the platform away from his typical city of search, when the uncertainty about restaurant quality is larger, and for restaurants that have received fewer ratings in the past. On the supply side, newer, higher rated and more popular restaurants are found to advertise more on the platform; and ratings of those that advertised during the experiment are found to be higher two years later. Taken together, we interpret these results as consistent with a signalling equilibrium in which ads serve as implicit signals that enhance the appeal of the advertised restaurants to consumers. Both consumers and advertisers seem to benefit from the signalling. Consumers shift choices towards restaurants that are better rated (at baseline) in the disclosure group compared to the no disclosure group, and advertisers gain from the improved outcomes induced by disclosure.

[1]  Harikesh S. Nair,et al.  Sponsorship Disclosure and Consumer Deception: Experimental Evidence from Native Advertising in Mobile Search , 2018, Mark. Sci..

[2]  Steven Tadelis,et al.  On the Empirical Content of Cheap-Talk Signaling: An Application to Bargaining , 2019, Journal of Political Economy.

[3]  Raluca M. Ursu The Power of Rankings: Quantifying the Effect of Rankings on Online Consumer Search and Purchase Decisions , 2018, Mark. Sci..

[4]  Harikesh S. Nair,et al.  Native Advertising, Sponsorship Disclosure and Consumer Deception: Evidence from Mobile Search-Ad Experiments , 2017 .

[5]  Steven Tadelis,et al.  Consumer Heterogeneity and Paid Search Effectiveness: A Large-Scale Field Experiment: Paid Search Effectiveness , 2015 .

[6]  Sridhar Narayanan,et al.  Position Effects in Search Advertising and their Moderators: A Regression Discontinuity Approach , 2015, Mark. Sci..

[7]  J. Carlin,et al.  Beyond Power Calculations , 2014, Perspectives on psychological science : a journal of the Association for Psychological Science.

[8]  David H. Reiley,et al.  Online ads and offline sales: measuring the effect of retail advertising via a controlled experiment on Yahoo! , 2014 .

[9]  Navdeep S. Sahni Effect of temporal spacing between advertising exposures: Evidence from online field experiments , 2015 .

[10]  Greg Taylor,et al.  Search Quality and Revenue Cannibalization by Competing Search Engines , 2013 .

[11]  Garrett A. Johnson The Impact of Privacy Policy on the Auction Market for Online Display Advertising , 2013 .

[12]  Peng Liu,et al.  Rational Herding in Microloan Markets , 2012, Manag. Sci..

[13]  Ying Xie,et al.  Measuring the Lifetime Value of Customers Acquired from Google Search Advertising , 2011, Mark. Sci..

[14]  Oliver J. Rutz,et al.  From Generic to Branded: A Model of Spillover in Paid Search Advertising , 2011 .

[15]  Avi Goldfarb,et al.  Search Engine Advertising: Channel Substitution when Pricing Ads to Context , 2010, Manag. Sci..

[16]  Song Yao,et al.  A Dynamic Model of Sponsored Search Advertising , 2010, Mark. Sci..

[17]  Greg M. Allenby,et al.  The Effect of Media Advertising on Brand Consideration and Choice , 2009, Mark. Sci..

[18]  Anindya Ghose,et al.  Analyzing the Relationship Between Organic and Sponsored Search Advertising: Positive, Negative, or Zero Interdependence? , 2010, Mark. Sci..

[19]  M. S. Goeree,et al.  LIMITED INFORMATION AND ADVERTISING IN THE U.S. PERSONAL COMPUTER INDUSTRY , 2008 .

[20]  Glenn Ellison,et al.  Position Auctions with Consumer Search , 2007 .

[21]  Baohong Sun,et al.  The impact of advertising on consumer price sensitivity in experience goods markets , 2006 .

[22]  Juliet Popper Shaffer,et al.  Recent developments towards optimality in multiple hypothesis testing , 2006, math/0610841.

[23]  Pradeep K. Chintagunta,et al.  The Effect of Banner Advertising on Internet Purchasing , 2006 .

[24]  K. Bagwell The Economic Analysis of Advertising , 2005 .

[25]  M. Shum Does Advertising Overcome Brand Loyalty? Evidence from the Breakfast-Cereals Market , 2004 .

[26]  Sridhar Moorthy,et al.  Advertising Spending and Quality for Services: The Role of Capacity , 2003 .

[27]  Ignatius J. Horstmann,et al.  Is advertising a signal of product quality? Evidence from the compact disc player market, 1983–1992 , 2003 .

[28]  Ron Shachar,et al.  Advertising , the Matchmaker ¤ , 2001 .

[29]  Ram Orzach,et al.  Modest Advertising Signals Strength , 2002 .

[30]  Daniel A. Ackerberg Empirically Distinguishing Informative and Prestige Effects of Advertising , 2001 .

[31]  Richard J. Murnane,et al.  Estimating the Labor Market Signaling Value of the GED , 2000 .

[32]  A. Rao,et al.  No Pain, No Gain: A Critical Review of the Literature on Signaling Unobservable Product Quality , 2000 .

[33]  Scott Shane,et al.  An empirical examination of advertising as a signal of product quality , 1998 .

[34]  Amna Kirmani Advertising Repetition as a Signal of Quality: If It's Advertised So Much, Something Must Be Wrong , 1997 .

[35]  R. Caves,et al.  Brands' quality levels, prices, and advertising outlays: empirical evidence on signals and information costs , 1996 .

[36]  P. Homer Ad Size as an Indicator of Perceived Advertising Costs and Effort: The Effects on Memory and Perceptions , 1995 .

[37]  Andrew M Weiss Human Capital vs. Signalling Explanations of Wages , 1995 .

[38]  Glenn M. MacDonald,et al.  When Is Advertising a Signal of Product Quality , 1994 .

[39]  Mark N. Hertzendorf I'm Not a High-Quality Firm -- But I Play One on TV , 1993 .

[40]  M. L. Samuels,et al.  Sample Size Requirements for the Back-of-the-Envelope Binomial Confidence Interval , 1992 .

[41]  Amna Kirmani,et al.  The Effect of Perceived Advertising Costs on Brand Perceptions , 1990 .

[42]  C. Fornell,et al.  The Relationship between Advertising and Product Quality over the Product Life Cycle: A Contingency Theory , 1988 .

[43]  Paul R. Milgrom,et al.  Price and Advertising Signals of Product Quality , 1986, Journal of Political Economy.

[44]  P. Holland Statistics and Causal Inference , 1985 .

[45]  R. Kihlstrom,et al.  Advertising as a Signal , 1984, Journal of Political Economy.

[46]  John E Kwoka,et al.  Advertising and the Price and Quality of Optometric Services , 1984 .

[47]  Carlisle E. Moody,et al.  Quality, Price, Advertising, and Published Quality Ratings , 1983 .

[48]  C. Blyth,et al.  Binomial Confidence Intervals , 1983 .

[49]  P. Nelson Advertising as Information , 1974, Journal of Political Economy.

[50]  P. Nelson Information and Consumer Behavior , 1970, Journal of Political Economy.

[51]  L. Festinger,et al.  A Theory of Cognitive Dissonance , 2017 .