The effect of ad rank on the performance of keyword advertising campaigns

The goal of this research is to evaluate the effect of ad rank on the performance of keyword advertising campaigns. We examined a large‐scale data file comprised of nearly 7,000,000 records spanning 33 consecutive months of a major US retailer's search engine marketing campaign. The theoretical foundation is serial position effect to explain searcher behavior when interacting with ranked ad listings. We control for temporal effects and use one‐way analysis of variance (ANOVA) with Tamhane's T2 tests to examine the effect of ad rank on critical keyword advertising metrics, including clicks, cost‐per‐click, sales revenue, orders, items sold, and advertising return on investment. Our findings show significant ad rank effect on most of those metrics, although less effect on conversion rates. A primacy effect was found on both clicks and sales, indicating a general compelling performance of top‐ranked ads listed on the first results page. Conversion rates, on the other hand, follow a relatively stable distribution except for the top 2 ads, which had significantly higher conversion rates. However, examining conversion potential (the effect of both clicks and conversion rate), we show that ad rank has a significant effect on the performance of keyword advertising campaigns. Conversion potential is a more accurate measure of the impact of an ad's position. In fact, the first ad position generates about 80% of the total profits, after controlling for advertising costs. In addition to providing theoretical grounding, the research results reported in this paper are beneficial to companies using search engine marketing as they strive to design more effective advertising campaigns.

[1]  Amanda Spink,et al.  A temporal comparison of AltaVista Web searching , 2005, J. Assoc. Inf. Sci. Technol..

[2]  Amanda Spink,et al.  Real life information retrieval: a study of user queries on the Web , 1998, SIGF.

[3]  B. Ratchford,et al.  Consumer information search revisited: Theory and empirical analysis , 1997 .

[4]  Jim Jansen,et al.  Understanding Sponsored Search: Core Elements of Keyword Advertising , 2011 .

[5]  David A. Hull Using statistical testing in the evaluation of retrieval experiments , 1993, SIGIR.

[6]  Bernard J. Jansen,et al.  An examination of searcher's perceptions of nonsponsored and sponsored links during ecommerce Web searching , 2006, J. Assoc. Inf. Sci. Technol..

[7]  Amanda Spink,et al.  An analysis of document viewing patterns of Web search engine users , 2005 .

[8]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[9]  Hermann Ebbinghaus (1885) Memory: A Contribution to Experimental Psychology , 2013, Annals of Neurosciences.

[10]  Matthew Richardson,et al.  Predicting clicks: estimating the click-through rate for new ads , 2007, WWW '07.

[11]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[12]  Ophir Frieder,et al.  Automatic classification of Web queries using very large unlabeled query logs , 2007, TOIS.

[13]  Peter S. Fader,et al.  On the Depth and Dynamics of Online Search Behavior , 2004, Manag. Sci..

[14]  N. Anderson Integration theory and attitude change. , 1971 .

[15]  Newton Lee,et al.  MISINFORMATION AND DISINFORMATION , 2021, The Digital Environment.

[16]  Eysenck Keane Cognitive Psychology, 6 , 2012 .

[17]  Anindya Ghose,et al.  An Empirical Analysis of Search Engine Advertising: Sponsored Search in Electronic Markets , 2009, Manag. Sci..

[18]  K. A. Coney,et al.  Order-Bias: The Special Case of Letter Preference , 1977 .

[19]  Larry Press,et al.  Commercialization of the Internet , 1994, CACM.

[20]  Ingoo Han,et al.  The Different Effects of Online Consumer Reviews on Consumers' Purchase Intentions Depending on Trust in Online Shopping Mall: An Advertising Perspective , 2011, Internet Res..

[21]  Amanda Spink,et al.  Investigating customer click through behaviour with integrated sponsored and nonsponsored results , 2009 .

[22]  M L Dean,et al.  Presentation order effects in product taste tests. , 1980, The Journal of psychology.

[23]  Nick Craswell,et al.  An experimental comparison of click position-bias models , 2008, WSDM '08.

[24]  Peiling Wang,et al.  Mining longitudinal web queries: Trends and patterns , 2003, J. Assoc. Inf. Sci. Technol..

[25]  Xavier Drèze,et al.  Measurement of online visibility and its impact on Internet traffic , 2004 .

[26]  C. I. Hovland The Order Of Presentation In Persuasion , 1966 .

[27]  S. L. Andersen,et al.  Permutation Theory in the Derivation of Robust Criteria and the Study of Departures from Assumption , 1955 .

[28]  Jaime Teevan,et al.  How people recall, recognize, and reuse search results , 2008, ACM Trans. Inf. Syst..

[29]  H. Lindman Analysis of variance in complex experimental designs , 1974 .

[30]  George Kingsley Zipf,et al.  Human behavior and the principle of least effort , 1949 .

[31]  Carl F. Mela,et al.  E-Customization , 2003 .

[32]  R. Bjork,et al.  Recency-sensitive retrieval processes in long-term free recall☆ , 1974 .

[33]  Amanda Spink,et al.  Classifying the user intent of web queries using k-means clustering , 2010, Internet Res..

[34]  Bob T. W. Wu,et al.  Evaluating the Significance of Placement on Recall of Advertisements during the Super Bowl , 2003 .

[35]  Bernard J. Jansen,et al.  Sponsored search: an overview of the concept, history, and technology , 2008, Int. J. Electron. Bus..

[36]  Ophir Frieder,et al.  Hourly analysis of a very large topically categorized web query log , 2004, SIGIR '04.

[37]  Tammo H. A. Bijmolt,et al.  Consumer Memory for Television Advertising: A Field Study of Duration, Serial Position, and Competition Effects , 1997 .

[38]  Christine L. Borgman,et al.  All users of information retrieval systems are not created equal: An exploration into individual differences , 1989, Inf. Process. Manag..

[39]  J. Deese,et al.  Serial effects in recall of unorganized and sequentially organized verbal material. , 1957, Journal of experimental psychology.

[40]  Daniel C. Fain,et al.  Sponsored search: A brief history , 2006 .

[41]  Michael J. A. Berry,et al.  Data Mining Techniques: For Marketing, Sales, and Customer Relationship Management , 2004 .

[42]  Bernard J. Jansen,et al.  An examination of searcher's perceptions of nonsponsored and sponsored links during ecommerce Web searching , 2006, J. Assoc. Inf. Sci. Technol..

[43]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[44]  Peter A. Tucker,et al.  Primary Memory , 1965, Encyclopedia of Database Systems.

[45]  S. Asch Forming impressions of personality. , 1946, Journal of Abnormal Psychology.

[46]  Olivier Chapelle,et al.  A dynamic bayesian network click model for web search ranking , 2009, WWW '09.

[47]  Bernard J. Jansen,et al.  Factors relating to the decision to click on a sponsored link , 2007, Decis. Support Syst..

[48]  F. Craik,et al.  Levels of Pro-cessing: A Framework for Memory Research , 1975 .

[49]  Reid Hastie,et al.  Order in Choice , 2009, Psychological science.

[50]  Gerald L. Lohse,et al.  An Information Search Cost Perspective for Designing Interfaces for Electronic Commerce , 1999 .

[51]  Nicholas Epley,et al.  When the best appears to be saved for last: Serial position effects on choice , 2009 .

[52]  W. Scott Terry,et al.  Serial Position Effects in Recall of Television Commercials , 2005, The Journal of general psychology.

[53]  Robert H. Logie,et al.  Recency, Primacy, and Memory: Reappraising and Standardising the Serial Position Curve , 1992, Cortex.