Raising the BAR: Bias Adjustment of Recognition Tests in Advertising

Advertising recognition tests use advertisements as visual retrieval cues; they require consumers to report which advertisements they remember having seen earlier and whether they noticed the advertised brand and read most of the text at the time. Using a heterogeneous randomly stopped sum model, the authors establish the relationship between consumers' actual attention to print advertisements, as measured through eye tracking, and subsequent ad recognition measures. They find that ad recognition measures are systematically biased because consumers infer prior attention from the ad layout and their familiarity with the brands in the advertisements. Such biases undermine the validity of recognition tests for advertising practice and theory development. The authors quantify the positive and negative diagnostic value of ad recognition for prior attention and demonstrate how these diagnostic values can be used to develop bias-adjusted recognition (BAR) scores that more accurately reflect prior attention. Finally, the authors show that differences in the scores from ad recognition tests based on in-home versus lab exposure attenuate when the bias-adjustment procedure is applied.

[1]  Matthew S. Fritz,et al.  Mediation analysis. , 2019, Annual review of psychology.

[2]  Rik Pieters,et al.  Attention Capture and Transfer in Advertising: Brand, Pictorial, and Text-Size Effects , 2004 .

[3]  Andrew J. Stewart,et al.  Integrating text and pictorial information: eye movements when looking at print advertisements. , 2001, Journal of experimental psychology. Applied.

[4]  S. Ghaemi,et al.  Improving the diagnosis of bipolar disorder: predictive value of screening tests. , 2006, Journal of affective disorders.

[5]  Sunil Gupta,et al.  The Shopping Basket: A Model for Multicategory Purchase Incidence Decisions , 1999 .

[6]  H. Arkes.  Costs and benefits of judgment errors: Implications for debiasing. , 1991 .

[7]  Stefano Puntoni,et al.  Social Context and Advertising Memory , 2007 .

[8]  Michel Wedel,et al.  Sales Effects of Attention to Feature Advertisements: A Bayesian Mediation Analysis , 2009 .

[9]  N. Charness,et al.  The perceptual aspect of skilled performance in chess: Evidence from eye movements , 2001, Memory & cognition.

[10]  Greg M. Allenby,et al.  Multivariate Analysis of Multiple Response Data , 2003 .

[11]  Henry L. Roediger,et al.  Distortions of memory , 2000 .

[12]  S. Chib,et al.  Markov Chain Monte Carlo Analysis of Correlated Count Data , 2001 .

[13]  Dipankar Chakravarti,et al.  Memory Measures for Pretesting Advertisements: An Integrative Conceptual Framework and a Diagnostic Template , 1999 .

[14]  Michel Wedel,et al.  Eye Fixations on Advertisements and Memory for Brands: A Model and Findings , 2000 .

[15]  Peter E. Rossi,et al.  Bayesian Statistics and Marketing: Rossi/Bayesian Statistics and Marketing , 2006 .

[16]  Recall, Recognition and the Measurement of Memory for Print Advertisements: A Reassessment , 1992 .

[17]  H C van Houwelingen,et al.  The (in)validity of sensitivity and specificity. , 2000, Statistics in medicine.

[18]  Gillian Z. Heller,et al.  Mean and dispersion modelling for policy claims costs , 2007 .

[19]  The heuristic basis of remembering and classification: fluency, generation, and resemblance. , 2000, Journal of experimental psychology. General.

[20]  Marcia K. Johnson,et al.  Source monitoring. , 1993, Psychological bulletin.

[21]  Naveen Donthu,et al.  Improving the effectiveness of outdoor advertising: lessons from a study of 282 campaigns , 1994 .

[22]  David H. Annis.  Bayesian Statistics and Marketing. Peter Rossi, Greg Allenby, and Rob McCulloch , 2006 .

[23]  Russell I. Haley,et al.  The missing measures of copy testing , 1994 .

[24]  M. Pepe,et al.  Regression modelling of diagnostic likelihood ratios for the evaluation of medical diagnostic tests. , 1998, Biometrics.

[25]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[26]  D G Altman,et al.  Statistics Notes: Diagnostic tests 3: receiver operating characteristic plots , 1994, BMJ.

[27]  Peter E. Rossi,et al.  Bayesian Statistics and Marketing , 2005 .

[28]  J. Henderson.  Object identification in context: the visual processing of natural scenes. , 1992, Canadian journal of psychology.

[29]  Laurent Itti,et al.  Models of Bottom-up Attention and Saliency , 2005 .

[30]  Richard P. Bagozzi,et al.  Recall, Recognition, and the Measurement of Memory for Print Advertisements , 1983 .

[31]  Christopher M. Harris,et al.  The distribution of fixation durations in infants and naive adults , 1988, Vision Research.

[32]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[33]  Steven Goodman.  Toward Evidence-Based Medical Statistics. 2: The Bayes Factor , 1999, Annals of Internal Medicine.

[34]  Peter E. Rossi,et al.  Marketing models of consumer heterogeneity , 1998 .

[35]  John M. Olin.  Markov Chain Monte Carlo Analysis of Correlated Count Data , 2003 .

[36]  Scott C. Purvis,et al.  Reconsidering Recall and Emotion in Advertising , 2006, Journal of Advertising Research.

[37]  D. Altman,et al.  Statistics Notes: Diagnostic tests 2: predictive values , 1994, BMJ.

[38]  M. Kendall,et al.  Kendall's advanced theory of statistics , 1995 .

[39]  C. Smith.  Diagnostic tests (1) – sensitivity and specificity , 2012, Phlebology.

[40]  Antonio Torralba,et al.  Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. , 2006, Psychological review.

[41]  Larry L. Jacoby,et al.  Recollection and familiarity , 2000 .

[42]  R. Pieters,et al.  A Review of Eye-Tracking Research in Marketing , 2008 .

[43]  William J. Havlena,et al.  Decay Effects in Online Advertising: Quantifying the Impact of Time Since Last Exposure on Branding Effectiveness , 2004, Journal of Advertising Research.

[44]  A. Yonelinas.  The Nature of Recollection and Familiarity: A Review of 30 Years of Research , 2002 .

[45]  Erik D. Reichle,et al.  The E-Z Reader model of eye-movement control in reading: Comparisons to other models , 2003, Behavioral and Brain Sciences.

[46]  Stefan Mihalas,et al.  Interesting locations in natural scenes draw eye movements , 2010 .

[47]  Chris Janiszewski,et al.  The Influence of Display Characteristics on Visual Exploratory Search Behavior , 1998 .

[48]  S. Chib,et al.  Marginal Likelihood From the Metropolis–Hastings Output , 2001 .

[49]  Gilbert A. Churchill,et al.  Recognition versus Recall as Measures of Television Commercial Forgetting , 1988 .

[50]  T. Mills Shepard.  The Starch Application of the Recognition Technique , 1942 .

[51]  Bruce A. Huhmann,et al.  Combinatory and Separative Effects of Rhetorical Figures on Consumers' Effort and Focus in Ad Processing , 2002 .

[52]  S. Chib.  Marginal Likelihood from the Gibbs Output , 1995 .

[53]  Adam Finn,et al.  Print Ad Recognition Readership Scores: An Information Processing Perspective , 1988 .

[54]  Dominique M. Hanssens,et al.  The Effectiveness of Industrial Print Advertisements across Product Categories , 1980 .

[55]  A. Nairn,et al.  Measuring Affective Advertising: Implications of Low Attention Processing on Recall , 2005, Journal of Advertising Research.