The Short-Run and Long-Run Effects of Behavioral Interventions: Experimental Evidence from Energy Conservation

We document three remarkable features of the Opower program, in which social comparison-based home energy reports are repeatedly mailed to more than six million households nationwide. First, initial reports cause high-frequency “action and backsliding,” but these cycles attenuate over time. Second, if reports are discontinued after two years, effects are relatively persistent, decaying at 10–20 percent per year. Third, consumers are slow to habituate: they continue to respond to repeated treatment even after two years. We show that the previous conservative assumptions about post-intervention persistence had dramatically understated cost effectiveness and illustrate how empirical estimates can optimize program design.(JEL D12, D83, L94, Q41)

[1]  R. F. Thompson,et al.  Habituation: a model phenomenon for the study of neuronal substrates of behavior. , 1966, Psychological review.

[2]  R. Shiffrin,et al.  Controlled and automatic human information processing: I , 1977 .

[3]  Walter Schneider,et al.  Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention. , 1977 .

[4]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[5]  B. Harper,et al.  What's in a Grade?. , 1983 .

[6]  Kevin M. Murphy,et al.  A Theory of Rational Addiction , 1988, Journal of Political Economy.

[7]  Carl A. Kallgren,et al.  A focus theory of normative conduct: Recycling the concept of norms to reduce littering in public places. , 1990 .

[8]  L. Argote,et al.  The persistence and transfer of learning in industrial settings , 1990 .

[9]  Kevin M. Murphy,et al.  A Simple Theory of Advertising as a Good , 1993 .

[10]  R B Haynes,et al.  An overview of interventions to improve compliance with appointment keeping for medical services. , 1992, JAMA.

[11]  R. Pieters,et al.  Working Paper , 1994 .

[12]  D. Rubin,et al.  One Hundred Years of Forgetting : A Quantitative Description of Retention , 1996 .

[13]  Wendy Wood,et al.  Habit and intention in everyday life: The multiple processes by which past behavior predicts future behavior. , 1998 .

[14]  C. L. Benkard Learning and Forgetting: the Dynamics of Aircraft Production , 1999 .

[15]  Alan D. Mathios,et al.  The Impact of Mandatory Disclosure Laws on Product Choices: An Analysis of the Salad Dressing Market* , 2000, The Journal of Law and Economics.

[16]  Sendhil Mullainathan,et al.  A Memory Based Model of Bounded Rationality , 2000 .

[17]  M.D. Anderson,et al.  Dynamic pricing [of electricity] , 2000, IEEE Potentials.

[18]  David I. Laibson,et al.  A Cue-Theory of Consumption , 2001 .

[19]  E. Duflo,et al.  How Much Should We Trust Differences-in-Differences Estimates? , 2001 .

[20]  E. Duflo,et al.  How Much Should We Trust Differences-in-Differences Estimates? , 2001 .

[21]  Wayne A. Morrissey The National Oceanic and Atmospheric Administration (NOAA) , 2002 .

[22]  E. Duflo,et al.  The Role of Information and Social Interactions in Retirement Plan Decisions: Evidence from a Randomized Experiment , 2002 .

[23]  Gary Solon,et al.  The impact of health plan report cards on managed care enrollment. , 2002, Journal of health economics.

[24]  D. Green,et al.  Voting May Be Habit-Forming: Evidence from a Randomized Field Experiment , 2003 .

[25]  Avery Comarow,et al.  America's best hospitals. , 2003, U.S. news & world report.

[26]  Luis C. Corchón,et al.  Addiction and Cue-Triggered Decision Processes. , 2004, The American economic review.

[27]  B. Frey,et al.  Social Comparisons and Pro-social Behavior: Testing "Conditional Cooperation" in a Field Experiment , 2004 .

[28]  M. E. Lucas,et al.  What's in a Grade? School Report Cards and the Housing Market , 2004 .

[29]  Michael Greenstone,et al.  Mandated Disclosure, Stock Returns, and the 1964 Securities Acts Amendments , 2005 .

[30]  R Perera,et al.  Competitions and incentives for smoking cessation. , 2005, The Cochrane database of systematic reviews.

[31]  C. Vlek,et al.  A review of intervention studies aimed at household energy conservation , 2005 .

[32]  Ulrike Malmendier,et al.  Paying Not to Go to the Gym , 2006 .

[33]  J. List,et al.  Putting Behavioral Economics to Work: Testing for Gift Exchange in Labor Markets Using Field Experiments , 2006 .

[34]  Alan T. Sorensen,et al.  Information and Consumer Choice: The Value of Publicized Health Plan Ratings , 2005, Journal of health economics.

[35]  Brad J. Sagarin,et al.  Managing social norms for persuasive impact , 2006 .

[36]  Noah J. Goldstein,et al.  The Constructive, Destructive, and Reconstructive Power of Social Norms , 2007, Psychological science.

[37]  S. van Dulmen,et al.  Patient adherence to medical treatment: a review of reviews , 2007, BMC Health Services Research.

[38]  C. Hansen,et al.  Table 2 , 2002, Equality and Non-Discrimination under the European Convention on Human Rights.

[39]  Justine S. Hastings,et al.  Information, School Choice, and Academic Achievement: Evidence from Two Experiments , 2007 .

[40]  G. Charness,et al.  Incentives to Exercise , 2008 .

[41]  Lucas W. Davis Durable goods and residential demand for energy and water: evidence from a field trial , 2008 .

[42]  Katherine L. Milkman,et al.  Harnessing Our Inner Angels and Demons: What We Have Learned About Want/Should Conflicts and How That Knowledge Can Help Us Reduce Short-Sighted Decision Making , 2008, Perspectives on psychological science : a journal of the Association for Psychological Science.

[43]  P. Reiss,et al.  What changes energy consumption? Prices and public pressures , 2008 .

[44]  David I. Laibson,et al.  Learning in the Credit Card Market , 2013 .

[45]  R. Perera,et al.  Competitions and incentives for smoking cessation. , 2008, The Cochrane database of systematic reviews.

[46]  David Dranove,et al.  Start spreading the news: a structural estimate of the effects of New York hospital report cards. , 2008, Journal of health economics.

[47]  Noah J. Goldstein,et al.  Normative Social Influence is Underdetected , 2008, Personality & social psychology bulletin.

[48]  Michael K. Price,et al.  Is a Donor in Hand Better than Two in the Bush? Evidence from a Natural Field Experiment , 2008 .

[49]  Jonathan Zinman,et al.  Put Your Money Where Your Butt is: A Commitment Contract for Smoking Cessation , 2009 .

[50]  Jen Shang,et al.  A Field Experiment in Charitable Contribution: The Impact of Social Information on the Voluntary Provision of Public Goods , 2009 .

[51]  Raj Chetty,et al.  Salience and Taxation: Theory and Evidence , 2009 .

[52]  Donald A. Wilson,et al.  Habituation revisited: An updated and revised description of the behavioral characteristics of habituation , 2009, Neurobiology of Learning and Memory.

[53]  Kevin G Volpp,et al.  A randomized, controlled trial of financial incentives for smoking cessation. , 2009, The New England journal of medicine.

[54]  Devin Pope Reacting to rankings: evidence from "America's Best Hospitals". , 2009, Journal of health economics.

[55]  Brigitte C. Madrian,et al.  How Does Simplified Disclosure Affect Individuals' Mutual Fund Choices? , 2009 .

[56]  Leila C. Kahwati,et al.  The effectiveness of worksite nutrition and physical activity interventions for controlling employee overweight and obesity: a systematic review. , 2009, American journal of preventive medicine.

[57]  Sendhil Mullainathan,et al.  What's Advertising Content Worth? Evidence from a Consumer Credit Marketing Field Experiment , 2009 .

[58]  Jennifer Spaeth,et al.  Task Force on Community Preventive Services , 2009 .

[59]  Todd Rogers,et al.  Descriptive Social Norms and Motivation to Vote: Everybody's Voting and so Should You , 2009, The Journal of Politics.

[60]  I. Ayres,et al.  Evidence from Two Large Field Experiments that Peer Comparison Feedback Can Reduce Residential Energy Usage , 2009 .

[61]  S. Mullainathan,et al.  Behavior and Energy Policy , 2010, Science.

[62]  C. Jackson A Little Now for a Lot Later: A Look at a Texas Advanced Placement Incentive Program , 2010 .

[63]  Matthew E. Kahn,et al.  Energy Conservation "Nudges" and Environmentalist Ideology: Evidence from a Randomized Residential Electricity Field Experiment , 2010 .

[64]  D. Dranove,et al.  Quality Disclosure and Certification: Theory and Practice , 2010 .

[65]  Leslie K. John,et al.  Financial Incentives for Extended Weight Loss: A Randomized, Controlled Trial , 2011, Journal of General Internal Medicine.

[66]  Sendhil Mullainathan,et al.  Behavioral Science and Energy Policy , 2010 .

[67]  Robert T. Jensen,et al.  The (Perceived) Returns to Education and the Demand for Schooling , 2010 .

[68]  Alan T. Sorensen,et al.  Calorie Posting in Chain Restaurants , 2010 .

[69]  Michael K. Price,et al.  The Persistence of Treatment Effects with Norm-Based Policy Instruments: Evidence from a Randomized Environmental Policy Experiment , 2011 .

[70]  H. Allcott,et al.  Social Norms and Energy Conservation , 2011 .

[71]  U. Gneezy,et al.  Journal of Economic Perspectives—Volume 25, Number 4—Fall 2011—Pages 191–210 When and Why Incentives (Don’t) Work to Modify Behavior , 2022 .

[72]  Gregory M. Walton,et al.  A Brief Social-Belonging Intervention Improves Academic and Health Outcomes of Minority Students , 2011, Science.

[73]  Xavier Gabaix,et al.  A Sparsity-Based Model of Bounded Rationality , 2011 .

[74]  Katherine L. Milkman,et al.  The Effect of Providing Peer Information on Retirement Savings Decisions , 2011 .

[75]  M. Sevick,et al.  Using mHealth technology to enhance self-monitoring for weight loss: a randomized trial. , 2012, American journal of preventive medicine.

[76]  Peter Fishman,et al.  The Impact of Personal Experience on Behavior: Evidence from Video-Rental Fines , 2012, Manag. Sci..

[77]  Sendhil Mullainathan,et al.  Energy Policy with Externalities and Internalities , 2012 .

[78]  Sendhil Mullainathan,et al.  Site Selection Bias in Program Evaluation , 2012 .

[79]  Sendhil Mullainathan,et al.  Comparison Friction: Experimental Evidence from Medicare Drug Plans , 2011, The quarterly journal of economics.

[80]  Kira Ashby,et al.  Green with Envy: Neighbor Comparisons and Social Norms in Five Home Energy Report Programs , 2012 .

[81]  Mark Stehr,et al.  Incentives, Commitments and Habit Formation in Exercise: Evidence from a Field Experiment with Workers at a Fortune-500 Company , 2012 .

[82]  Todd Rogers,et al.  How Long Do Treatment Effects Last? Persistence and Durability of a Descriptive Norms Intervention's Effect on Energy Conservation , 2012 .

[83]  J. List,et al.  Testing for Altruism and Social Pressure in Charitable Giving , 2009, The quarterly journal of economics.

[84]  Michael Greenstone,et al.  Is There an Energy Efficiency Gap , 2012 .

[85]  S. Mullainathan,et al.  Externalities, Internalities, and the Targeting of Energy Policy , 2012 .

[86]  Paul L. Joskow,et al.  Creating a Smarter U.S. Electricity Grid , 2012 .

[87]  Hermann Ebbinghaus (1885) Memory: A Contribution to Experimental Psychology , 2013, Annals of Neurosciences.

[88]  Paul J. Ferraro,et al.  Heterogeneous treatment effects and mechanisms in information-based environmental policies: Evidence from a large-scale field experiment , 2013 .

[89]  Michael K. Price,et al.  Using Nonpecuniary Strategies to Influence Behavior: Evidence from a Large-Scale Field Experiment , 2011, Review of Economics and Statistics.

[90]  Paul Dolan,et al.  Neighbors, Knowledge, and Nuggets: Two Natural Field Experiments on the Role of Incentives on Energy Conservation , 2013 .

[91]  Justin Gallagher,et al.  Learning About an Infrequent Event: Evidence from Flood Insurance Take-Up in the US , 2013 .

[92]  Koichiro Ito Asymmetric Incentives in Subsidies: Evidence from a Large-Scale Electricity Rebate Program , 2013 .

[93]  J. Graff Zivin,et al.  Dynamic Salience with Intermittent Billing: Evidence from Smart Electricity Meters , 2013 .

[94]  Katherine L. Milkman,et al.  Holding the Hunger Games Hostage at the Gym: an Evaluation of Temptation Bundling , 2013, Manag. Sci..

[95]  Dmitry Taubinsky,et al.  From Intentions to Actions: A Model and Experimental Evidence of Inattentive Choice , 2014 .

[96]  Dan York,et al.  SAVING ENERGY COST-EFFECTIVELY: A NATIONAL REVIEW OF THE COST OF ENERGY SAVED THROUGH UTILITy-SECTOR ENERGY EFFICIENCY PROGRAMS , 2014 .

[97]  James M. Sallee,et al.  Rational Inattention and Energy Efficiency , 2013, The Journal of Law and Economics.

[98]  Todd Rogers,et al.  Changing Behavior Beyond the Here and Now , 2014 .