Field Experimentation in Marketing Research

Despite increasing efforts to encourage the adoption of field experiments in marketing research (e.g., Campbell 1969; Cialdini 1980; Li et al. 2015), the majority of scholars continue to rely primarily on laboratory studies (Cialdini 2009). For example, of the 50 articles published in Journal of Marketing Research in 2013, only three (6%) were based on field experiments. The goal of this article is to motivate a methodological shift in marketing research and increase the proportion of empirical findings obtained using field experiments. The author begins by making a case for field experiments and offers a description of their defining features. She then demonstrates the unique value that field experiments can offer and concludes with a discussion of key considerations that researchers should be mindful of when designing, planning, and running field experiments.

[1]  Leif D. Nelson,et al.  Commitment and Behavior Change: Evidence from the Field , 2013 .

[2]  Alice M. Tybout,et al.  The Concept of External Validity , 1982 .

[3]  Robert S. Goldfarb,et al.  Does Studying Economics Discourage Cooperation? Watch What We Do, Not What We Say or How We Play , 1996 .

[4]  Leif D. Nelson,et al.  Pay-what-you-want, identity, and self-signaling in markets , 2012, Proceedings of the National Academy of Sciences.

[5]  G. W. Lewin,et al.  Problems of Research in Social Psychology (1943-44). , 1997 .

[6]  Michael A. Kuhn,et al.  Journal of Economic Behavior & Organization Experimental Methods: Extra-laboratory Experiments-extending the Reach of Experimental Economics , 2022 .

[7]  K. Sudhir Editorial - The Exploration-Exploitation Tradeoff and Efficiency in Knowledge Production , 2016, Mark. Sci..

[8]  Sterling A. Bone,et al.  “Mere Measurement Plus”: How Solicitation of Open-Ended Positive Feedback Influences Customer Purchase Behavior , 2017 .

[9]  Valerie Purdie-Vaughns,et al.  Journal of Experimental Psychology : General Breaking the Cycle of Mistrust : Wise Interventions to Provide Critical Feedback Across the Racial Divide , 2013 .

[10]  Leslie K. John,et al.  Does “Liking” Lead to Loving? The Impact of Joining a Brand's Social Network on Marketing Outcomes , 2017 .

[11]  Ayelet Gneezy,et al.  Procrastination of Enjoyable Experiences , 2010 .

[12]  Noah J. Goldstein,et al.  A Room with a Viewpoint: Using Social Norms to Motivate Environmental Conservation in Hotels , 2008 .

[13]  John N. Tsitsiklis,et al.  The Value of Field Experiments , 2015, Manag. Sci..

[14]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[15]  Leif D. Nelson,et al.  Anchoring in Payment: Evaluating a Judgmental Heuristic in Field Experimental Settings , 2016 .

[16]  Leif D. Nelson,et al.  Shared Social Responsibility: A Field Experiment in Pay-What-You-Want Pricing and Charitable Giving , 2010, Science.

[17]  L. Peracchio,et al.  Building Bridges for an Interconnected Field of Consumer Research , 2014 .

[18]  Leon Mann,et al.  THE LOST-LETTER TECHNIQUE: A TOOL OF SOCIAL RESEARCH , 1965 .

[19]  J. Lynch Theory and external validity , 1999 .

[20]  Aviv Nevo Measuring Market Power in the Ready-to-Eat Cereal Industry , 1998 .

[21]  Russell S. Winer,et al.  Experimentation in the 21st century: The importance of external validity , 1999 .

[22]  Robert B. Cialdini,et al.  Full-cycle social psychology. , 1980 .

[23]  J. Riis,et al.  “Yes/No/Not Right Now”: Yes/No Response Formats Can Increase Response Rates Even in Non-Forced-Choice Settings , 2016 .

[24]  Eric T. Anderson,et al.  Research Note - Does Demand Fall When Customers Perceive That Prices Are Unfair? The Case of Premium Pricing for Large Sizes , 2008, Mark. Sci..

[25]  U. Gneezy,et al.  A Reference-Dependent Model of the Price–Quality Heuristic , 2014 .

[26]  Theory-Oriented Research in Natural Settings: The Best of Both Worlds for Social Psychology , 2017 .

[27]  Mathew Cherian,et al.  Do Sympathy Biases Induce Charitable Giving? The Effects of Advertising Content , 2016, Mark. Sci..

[28]  George Loewenstein,et al.  Advance Ordering for Healthier Eating? Field Experiments on the Relationship between the Meal Order–Consumption Time Delay and Meal Content , 2016 .

[29]  James N Rosse,et al.  ESTIMATING COST FUNCTION PARAMETERS WITHOUT USING COST DATA: ILLUSTRATED METHODOLOGY , 1970 .

[30]  Ann Kronrod,et al.  Does Sparing the Rod Spoil the Child? How Praising, Scolding, and an Assertive Tone Can Encourage Desired Behaviors , 2016 .

[31]  Eric T. Anderson,et al.  Effects of $9 Price Endings on Retail Sales: Evidence from Field Experiments , 2003 .

[32]  D. Campbell Reforms as experiments , 1969 .

[33]  Leif D. Nelson,et al.  Paying More When Paying for Others , 2013, Journal of personality and social psychology.

[34]  Nathan M. Fong,et al.  Geo-Conquesting: Competitive Locational Targeting of Mobile Promotions , 2014 .

[35]  Sendhil Mullainathan,et al.  What's Advertising Content Worth? Evidence from a Consumer Credit Marketing Field Experiment , 2009 .

[36]  C. Dweck,et al.  Motivating voter turnout by invoking the self , 2011, Proceedings of the National Academy of Sciences.

[37]  Jeffrey T. Hancock,et al.  Experimental evidence of massive-scale emotional contagion through social networks , 2014, Proceedings of the National Academy of Sciences.

[38]  R. Cialdini Influence: Science and Practice , 1984 .