Neural basis of the undermining effect of monetary reward on intrinsic motivation

Contrary to the widespread belief that people are positively motivated by reward incentives, some studies have shown that performance-based extrinsic reward can actually undermine a person's intrinsic motivation to engage in a task. This “undermining effect” has timely practical implications, given the burgeoning of performance-based incentive systems in contemporary society. It also presents a theoretical challenge for economic and reinforcement learning theories, which tend to assume that monetary incentives monotonically increase motivation. Despite the practical and theoretical importance of this provocative phenomenon, however, little is known about its neural basis. Herein we induced the behavioral undermining effect using a newly developed task, and we tracked its neural correlates using functional MRI. Our results show that performance-based monetary reward indeed undermines intrinsic motivation, as assessed by the number of voluntary engagements in the task. We found that activity in the anterior striatum and the prefrontal areas decreased along with this behavioral undermining effect. These findings suggest that the corticobasal ganglia valuation system underlies the undermining effect through the integration of extrinsic reward value and intrinsic task value.

[1]  J. W. Atkinson Motivational determinants of risk-taking behavior. , 1957, Psychological review.

[2]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[3]  R. Kirk Experimental Design: Procedures for the Behavioral Sciences , 1970 .

[4]  E. Deci Effects of Externally Mediated Rewards on Intrinsic Motivation. , 1971 .

[5]  R. Nisbett,et al.  Undermining children's intrinsic interest with extrinsic reward: A test of the "overjustification" hypothesis. , 1973 .

[6]  R. Ryan,et al.  Relation of reward contingency and interpersonal context to intrinsic motivation: A review and test using cognitive evaluation theory. , 1983 .

[7]  M. Morgan Reward-Induced Decrements and Increments in Intrinsic Motivation , 1984 .

[8]  Edward L. Deci,et al.  Intrinsic Motivation and Self-Determination in Human Behavior , 1975, Perspectives in Social Psychology.

[9]  A R Damasio,et al.  Preserved motor learning in Alzheimer's disease: implications for anatomy and behavior , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  M. Csíkszentmihályi Flow. The Psychology of Optimal Experience. New York (HarperPerennial) 1990. , 1990 .

[11]  Philip H. Mirvis Flow: The Psychology of Optimal Experience , 1991 .

[12]  Robert Tibshirani,et al.  An Introduction to the Bootstrap CHAPMAN & HALL/CRC , 1993 .

[13]  C. Utman,et al.  Performance Effects of Motivational State: A Meta-Analysis , 1997, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[14]  David M. Kreps Intrinsic Motivation and Extrinsic Incentives , 1997 .

[15]  Colin Camerer,et al.  The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework , 1999 .

[16]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[17]  E. Deci,et al.  A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. , 1999, Psychological bulletin.

[18]  B. Frey,et al.  Motivation Crowding Theory: A Survey of Empirical Evidence , 2000 .

[19]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[20]  Leslie G. Ungerleider,et al.  Functional anatomy of motor skill learning. , 2002 .

[21]  I. Jolliffe Principal Component Analysis , 2002 .

[22]  P. Montague,et al.  Neural Economics and the Biological Substrates of Valuation , 2002, Neuron.

[23]  Edward E. Smith,et al.  Neuroimaging studies of working memory: , 2003, Cognitive, affective & behavioral neuroscience.

[24]  Kent C. Berridge,et al.  Pleasures of the brain , 2003, Brain and Cognition.

[25]  Keiji Tanaka,et al.  Neuronal Correlates of Goal-Based Motor Selection in the Prefrontal Cortex , 2003, Science.

[26]  M. Gluck,et al.  Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. , 2004, Journal of neurophysiology.

[27]  K. Berridge Motivation concepts in behavioral neuroscience , 2004, Physiology & Behavior.

[28]  S. Bunge How we use rules to select actions: A review of evidence from cognitive neuroscience , 2004, Cognitive, affective & behavioral neuroscience.

[29]  M. Delgado,et al.  Modulation of Caudate Activity by Action Contingency , 2004, Neuron.

[30]  Peter Dayan,et al.  Temporal difference models describe higher-order learning in humans , 2004, Nature.

[31]  Edward L. Deci,et al.  Intrinsic Motivation and Self-Determination , 2004 .

[32]  B. Barber The psychology of parental control: How well‐meant parenting backfires , 2005 .

[33]  W. Schultz Behavioral theories and the neurophysiology of reward. , 2006, Annual review of psychology.

[34]  James L. McClelland,et al.  Performance Feedback Drives Caudate Activation in a Phonological Learning Task , 2006, Journal of Cognitive Neuroscience.

[35]  W. Schultz,et al.  Learning-Related Human Brain Activations Reflecting Individual Finances , 2007, Neuron.

[36]  M. Kenward,et al.  An Introduction to the Bootstrap , 2007 .

[37]  Samuel M. McClure,et al.  Anchors, scales and the relative coding of value in the brain , 2008, Current Opinion in Neurobiology.

[38]  N. Sadato,et al.  Processing of Social and Monetary Rewards in the Human Striatum , 2008, Neuron.

[39]  Jan Gläscher,et al.  Visualization of Group Inference Data in Functional Neuroimaging , 2009, Neuroinformatics.

[40]  P. Dayan,et al.  Reinforcement learning: The Good, The Bad and The Ugly , 2008, Current Opinion in Neurobiology.

[41]  Samuel M. McClure,et al.  BOLD Responses Reflecting Dopaminergic Signals in the Human Ventral Tegmental Area , 2008, Science.

[42]  Elizabeth Tricomi,et al.  Feedback signals in the caudate reflect goal achievement on a declarative memory task , 2008, NeuroImage.

[43]  D. Balota,et al.  Memory efficiency and the strategic control of attention at encoding: impairments of value-directed remembering in Alzheimer's disease. , 2009, Neuropsychology.

[44]  Thomas H. B. FitzGerald,et al.  The Role of Human Orbitofrontal Cortex in Value Comparison for Incommensurable Objects , 2009, The Journal of Neuroscience.

[45]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[46]  M. Rushworth,et al.  General Mechanisms for Making Decisions? This Review Comes from a Themed Issue on Cognitive Neuroscience Edited the Representation of Value and Reward Expectations in Frontal Cortex Reward Prediction Errors and Learning Rates Other Types of Prediction Error , 2022 .

[47]  Hannah S. Locke,et al.  Prefrontal cortex mediation of cognitive enhancement in rewarding motivational contexts , 2010, Proceedings of the National Academy of Sciences.

[48]  S. Haber,et al.  The Reward Circuit: Linking Primate Anatomy and Human Imaging , 2010, Neuropsychopharmacology.