Reflections on the replication corner: In praise of conceptual replications

We contrast the philosophy guiding the Replication Corner at IJRM with replication efforts in psychology. Psychology has promoted “exact” or “direct” replications, reflecting an interest in statistical conclusion validity of the original findings. Implicitly, this philosophy treats non-replication as evidence that the original finding is not “real” — a conclusion that we believe is unwarranted. In contrast, we have encouraged “conceptual replications” (replicating at the construct level but with different operationalization) and “replications with extensions”, reflecting our interest in providing evidence on the external validity and generalizability of published findings. In particular, our belief is that this replication philosophy allows for both replication and the creation of new knowledge. We express our views about why we believe our approach is more constructive, and describe lessons learned in the three years we have been involved in editing the IJRM Replication Corner. Of our thirty published conceptual replications, most found results replicating the original findings, sometimes identifying moderators.

[1]  Simone Schnall,et al.  With a Clean Conscience , 2008, Psychological science.

[2]  M. Lepper,et al.  The Construction of Preference: When Choice Is Demotivating: Can One Desire Too Much of a Good Thing? , 2006 .

[3]  D. Ariely,et al.  “Coherent Arbitrariness”: Stable Demand Curves Without Stable Preferences , 2003 .

[4]  K. Gergen Social Psychology as History , 1973 .

[5]  M. Sarstedt,et al.  The time vs. money effect. A conceptual replication , 2013 .

[6]  I. Simonson Vices and Virtues of Misguided Replications: The Case of Asymmetric Dominance , 2014 .

[7]  H. Pashler,et al.  Editors’ Introduction to the Special Section on Replicability in Psychological Science , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[8]  The partitioning paradox: The big bite around small packages , 2015 .

[9]  J. Peck,et al.  The Effect of Mere Touch on Perceived Ownership , 2009 .

[10]  Carolyn E. Gibson,et al.  A Replication Attempt of Stereotype Susceptibility (Shih, Pittinsky, & Ambady, 1999) , 2014 .

[11]  Jonas Holmqvist,et al.  The impact of an exciting store environment on consumer pleasure and shopping intentions , 2015 .

[12]  Arul Mishra,et al.  The Influence of Price Discount versus Bonus Pack on the Preference for Virtue and Vice Foods , 2010 .

[13]  David Brinberg,et al.  Hypothesized and Confounded Explanations in Theory Tests: A Bayesian Analysis , 1992 .

[14]  A. Diamantopoulos,et al.  The impact of perceived brand globalness on consumers' willingness to pay , 2015 .

[15]  Vanessa M. Patrick,et al.  Psychological Distancing: Why Happiness Helps You See the Big Picture , 2009 .

[16]  B. Parguel,et al.  The impact of visual exposure to a physically attractive other on self-presentation , 2014 .

[17]  Jase R. Ramsey,et al.  Severe service failure recovery revisited: Evidence of its determinants in an emerging market context , 2015 .

[18]  Sara Valentini,et al.  A meta-analysis of satisfaction with complaint handling in services , 2010 .

[19]  Tina M. Lowrey,et al.  Sound symbolism effects across languages: Implications for global brand names , 2012 .

[20]  Merrill Warkentin,et al.  Fear Appeals and Information Security Behaviors: An Empirical Study , 2010, MIS Q..

[21]  Axel Cleeremans,et al.  Behavioral Priming: It's All in the Mind, but Whose Mind? , 2012, PloS one.

[22]  Colin Camerer,et al.  Pavlovian Processes in Consumer Choice: The Physical Presence of a Good Increases Willingness-to-Pay , 2010 .

[23]  D. Kahneman,et al.  Experimental Tests of the Endowment Effect and the Coase Theorem , 1990, Journal of Political Economy.

[24]  S. Frederick,et al.  The Limits of Attraction , 2014 .

[25]  Peter S. H. Leeflang,et al.  Satisfaction as a predictor of future performance: A replication , 2013 .

[26]  J. Schooler Unpublished results hide the decline effect , 2011, Nature.

[27]  Hung-Ming Lin Does container weight influence judgments of volume , 2013 .

[28]  Davide C. Orazi,et al.  Revisiting fear appeals: A structural re-inquiry of the protection motivation model , 2015 .

[29]  P. Verlegh,et al.  The Impact of Cultural Symbols and Spokesperson Identity on Attitudes and Intentions , 2013 .

[30]  Eric T. Bradlow Teacher’s Corner: Negative Information and The Three-Parameter Logistic Model , 1996 .

[31]  Eugene Y. Chan Endowment effect for hedonic but not utilitarian goods , 2015 .

[32]  J. Lynch On the External Validity of Experiments in Consumer Research , 1982 .

[33]  N. Ambady,et al.  Stereotype Susceptibility: Identity Salience and Shifts in Quantitative Performance , 1999 .

[34]  Leif D. Nelson,et al.  False-Positive Psychology , 2011, Psychological science.

[35]  K. Reynolds,et al.  Hedonic shopping motivations , 2003 .

[36]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[37]  L. Cronbach Beyond the Two Disciplines of Scientific Psychology. , 1975 .

[38]  F. Reichheld The one number you need to grow. , 2003, Harvard business review.

[39]  A. Gelman,et al.  The statistical crisis in science , 2014 .

[40]  Leif D. Nelson,et al.  Specification Curve: Descriptive and Inferential Statistics on All Reasonable Specifications , 2015 .

[41]  Stephen M. Nowlis,et al.  The Effects of Reduced Food Size and Package Size on the Consumption Behavior of Restrained and Unrestrained Eaters , 2008 .

[42]  Neil A. Morgan,et al.  The Value of Different Customer Satisfaction and Loyalty Metrics in Predicting Business Performance , 2006 .

[43]  Barton A. Weitz,et al.  When Should a Retailer Create an Exciting Store Environment , 2006 .

[44]  Christina Kuehnl,et al.  Same sound, same preference? Investigating sound symbolism effects in international brand names , 2013 .

[45]  A. Krishna,et al.  The Interaction of Senses: The Effect of Vision versus Touch on the Elongation Bias , 2006 .

[46]  A. Tversky,et al.  Choice in Context: Tradeoff Contrast and Extremeness Aversion , 1992 .

[47]  D. Simons The Value of Direct Replication , 2014, Perspectives on psychological science : a journal of the Association for Psychological Science.

[48]  D. Ariely,et al.  When Do Losses Loom Larger than Gains? , 2005 .

[49]  J. Bargh,et al.  Automaticity of social behavior: direct effects of trait construct and stereotype-activation on action. , 1996, Journal of personality and social psychology.

[50]  Eric Yorkston,et al.  A Sound Idea: Phonetic Effects of Brand Names on Consumer Judgments , 2004 .

[51]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[52]  Leif D. Nelson,et al.  Anchoring is Not a False-Positive: Maniadis, Tufano, and List's (2014) 'Failure-to-Replicate' is Actually Entirely Consistent with the Original , 2014 .

[53]  Monya Baker,et al.  First results from psychology’s largest reproducibility test , 2015, Nature.

[54]  D. Fernandes The 1/N Rule Revisited: Heterogeneity in the Naïve Diversification Bias , 2013 .

[55]  R. Thaler,et al.  Naive Diversification Strategies in Defined Contribution Saving Plans , 2001 .

[56]  R. Deshpandé,et al.  What We See Makes Us who We are: Priming Ethnic Self-Awareness and Advertising Response , 2001 .

[57]  David L. Mothersbaugh,et al.  How Procedural, Financial and Relational Switching Costs Affect Customer Satisfaction, Repurchase Intentions, and Repurchase Behavior: A Meta-Analysis , 2015 .

[58]  John A. List,et al.  One swallow doesn’t make a summer: new evidence on anchoring effects , 2014 .

[59]  Heiner Evanschitzky,et al.  Hedonic shopping motivations in collectivistic and individualistic consumer cultures , 2014 .

[60]  H. Pashler,et al.  Is the Replicability Crisis Overblown? Three Arguments Examined , 2012, Perspectives on psychological science : a journal of the Association for Psychological Science.

[61]  Holger Müller,et al.  Prize Decoys at Work - New Experimental Evidence for Asymmetric Dominance Effects in Choices on Prizes in Competitions , 2014 .

[62]  Holger M. Müller The real-exposure effect revisited — How purchase rates vary under pictorial vs. real item presentations when consumers are allowed to use their tactile sense , 2013 .

[63]  Christian Brock,et al.  Satisfaction with complaint handling: A replication study on its determinants in a business-to-business context , 2013 .

[64]  Revisiting the automaticity of phonetic symbolism effects , 2014 .

[65]  Tina M. Lowrey,et al.  Examining children's preference for phonetically manipulated brand names across two English accent groups , 2014 .

[66]  F. Kardes,et al.  If it tastes bad it must be good: Consumer naïve theories and the marketing placebo effect , 2013 .

[67]  Marcel Zeelenberg,et al.  Flying under the radar: Perverse package size effects on consumption self-regulation , 2008 .

[68]  Matthew J. Salganik,et al.  Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market , 2006, Science.

[69]  A. Casadevall,et al.  Misconduct accounts for the majority of retracted scientific publications , 2012, Proceedings of the National Academy of Sciences.

[70]  F. Strack,et al.  Does merely going through the same moves make for a “direct” replication? Concepts, contexts, and operationalizations. , 2014 .

[71]  S. Roeder,et al.  A Secondary Replication Attempt of Stereotype Susceptibility (Shih, Pittinsky, & Ambady, 1999) , 2014 .

[72]  Gráinne M. Fitzsimons,et al.  Dogs on the Street, Pumas on Your Feet: How Cues in the Environment Influence Product Evaluation and Choice , 2008 .

[73]  John T. Gourville,et al.  Overchoice and Assortment Type: When and Why Variety Backfires , 2005 .

[74]  A. Muthukrishnan,et al.  The effect of physical possession on preference for product warranty , 2013 .

[75]  The Effect of Cultural Orientation on Persuasion , 1997 .

[76]  J. Lynch The Role of External Validity in Theoretical Research , 1983 .

[77]  Eugene Y. Chan Attractiveness of options moderates the effect of choice overload , 2015 .

[78]  R. Hyman Quasi-Experimentation: Design and Analysis Issues for Field Settings (Book) , 1982 .

[79]  Tina M. Lowrey,et al.  Phonetic Symbolism and Brand Name Preference , 2007 .

[80]  Mark Heitmann,et al.  Charts and demand: Empirical generalizations on social influence , 2013 .

[81]  Joseph Cesario Priming, Replication, and the Hardest Science , 2014, Perspectives on psychological science : a journal of the Association for Psychological Science.

[82]  W. Stroebe,et al.  The Alleged Crisis and the Illusion of Exact Replication , 2014, Perspectives on psychological science : a journal of the Association for Psychological Science.

[83]  J. Aaker,et al.  'The Time vs. Money Effect': Shifting Product Attitudes and Decisions through Personal Connection , 2008 .

[84]  M. Donnellan,et al.  Does Cleanliness Influence Moral Judgments , 2014 .

[85]  On Amir,et al.  Placebo Effects of Marketing Actions: Consumers May Get What They Pay For , 2005 .

[86]  Michael A. Jones,et al.  The impact of service failure severity on service recovery evaluations andpost‐recovery relationships , 2004 .

[87]  Donald R. Lehmann,et al.  Designing the Next Study for Maximum Impact , 1998 .

[88]  Klaus Wertenbroch,et al.  The Value Heuristic in Judgments of Relative Frequency , 2008, Psychological science.

[89]  Judy K. Frels,et al.  Consumer switching costs: A typology, antecedents, and consequences , 2003 .

[90]  J. Brooks Why most published research findings are false: Ioannidis JP, Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, Ioannina, Greece , 2008 .

[91]  Rohit Deshpandé,et al.  A Tale of Two Cities: Distinctiveness Theory and Advertising Effectiveness , 1994 .

[92]  G. Alexander,et al.  Associations Among Gender-Linked Toy Preferences, Spatial Ability, and Digit Ratio: Evidence from Eye-Tracking Analysis , 2006, Archives of sexual behavior.

[93]  Christopher K. Hsee,et al.  Music, Pandas, and Muggers: On the Affective Psychology of Value , 2004, Journal of experimental psychology. General.

[94]  P. Meehl Theory-Testing in Psychology and Physics: A Methodological Paradox , 1967, Philosophy of Science.

[95]  Nivriti Chowdhry,et al.  Not All Negative Emotions Lead to Concrete Construal , 2015 .

[96]  Jonathan Hasford,et al.  Thinking, feeling, and giving: The effects of scope and valuation on consumer donations , 2015 .

[97]  James R Roney Effects of Visual Exposure to the Opposite Sex: Cognitive Aspects of Mate Attraction in Human Males , 2003, Personality & social psychology bulletin.

[98]  A. V. Kerckhove,et al.  Can fat taxes and package size restrictions stimulate healthy food choices , 2013 .

[99]  J. Goldenberg,et al.  The chilling effects of network externalities , 2010 .

[100]  Reginald B. Adams,et al.  Investigating Variation in Replicability: A “Many Labs” Replication Project , 2014 .

[101]  Bruce Cooil,et al.  A Longitudinal Examination of Net Promoter and Firm Revenue Growth , 2007 .

[102]  Jeffrey R. Spies,et al.  The Replication Recipe: What Makes for a Convincing Replication? , 2014 .

[103]  Prithwiraj Mukherjee How chilling are network externalities? The role of network structure , 2014 .

[104]  R. Batra,et al.  How perceived brand globalness creates brand value , 2002 .

[105]  Does exposure to dogs (cows) increase the preference for Puma (the colour white)? Not always☆ , 2014 .

[106]  Michael C. Frank,et al.  Estimating the reproducibility of psychological science , 2015, Science.

[107]  J. Aspara,et al.  Naturally Designed for Masculinity vs. Femininity? Prenatal Testosterone Predicts Male Consumers' Choices of Gender-Imaged Products , 2014 .