Diminished neural responses predict enhanced intrinsic motivation and sensitivity to external incentive

The duration and quality of human performance depend on both intrinsic motivation and external incentives. However, little is known about the neuroscientific basis of this interplay between internal and external motivators. Here, we used functional magnetic resonance imaging to examine the neural substrates of intrinsic motivation, operationalized as the free-choice time spent on a task when this was not required, and tested the neural and behavioral effects of external reward on intrinsic motivation. We found that increased duration of free-choice time was predicted by generally diminished neural responses in regions associated with cognitive and affective regulation. By comparison, the possibility of additional reward improved task accuracy, and specifically increased neural and behavioral responses following errors. Those individuals with the smallest neural responses associated with intrinsic motivation exhibited the greatest error-related neural enhancement under the external contingency of possible reward. Together, these data suggest that human performance is guided by a “tonic” and “phasic” relationship between the neural substrates of intrinsic motivation (tonic) and the impact of external incentives (phasic).

[1]  E. Deci,et al.  Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. , 2000, Contemporary educational psychology.

[2]  R. Baumeister,et al.  Ego Depletion: A Resource Model of Volition, Self-Regulation, and Controlled Processing , 2000 .

[3]  Jonathan D. Cohen,et al.  Anterior Cingulate Conflict Monitoring and Adjustments in Control , 2004, Science.

[4]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[5]  Jonathan D. Cohen,et al.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. , 2005, Annual review of neuroscience.

[6]  Nuttapong Chentanez,et al.  Intrinsically Motivated Learning of Hierarchical Collections of Skills , 2004 .

[7]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[8]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[9]  J. Tirole,et al.  Intrinsic and Extrinsic Motivation , 2003 .

[10]  Colin Camerer,et al.  The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework , 1999 .

[11]  Nina Mazar,et al.  Large stakes and big mistakes , 2009 .

[12]  Pearl H. Chiu,et al.  Smokers' brains compute, but ignore, a fictive error signal in a sequential investment task , 2008, Nature Neuroscience.

[13]  Murray B. Stein,et al.  Anterior cingulate activation in high trait anxious subjects is related to altered error processing during decision making , 2004, Biological Psychiatry.

[14]  W. Miller,et al.  Motivational interviewing: preparing people for change. , 2002 .

[15]  M. Kremer,et al.  The Two-Margin Problem in Insurance Markets , 2004, Review of Economics and Statistics.

[16]  P. Dayan,et al.  A framework for mesencephalic dopamine systems based on predictive Hebbian learning , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  Pierre-Yves Oudeyer,et al.  In Search of the Neural Circuits of Intrinsic Motivation , 2007, Front. Neurosci..

[18]  M. Leary.  Motivational and emotional aspects of the self. , 2007, Annual review of psychology.

[19]  J. Wardle,et al.  Eating for Pleasure or Profit , 2011, Psychological science.

[20]  A. Graybiel,et al.  Prolonged Dopamine Signalling in Striatum Signals Proximity and Value of Distant Rewards , 2013, Nature.

[21]  Sham M. Kakade,et al.  Opponent interactions between serotonin and dopamine , 2002, Neural Networks.

[22]  T. Robbins,et al.  Inhibition and the right inferior frontal cortex: one decade on , 2014, Trends in Cognitive Sciences.

[23]  Mark Jung-Beeman,et al.  Normative data for 144 compound remote associate problems , 2003, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[24]  D. Berlyne.  Curiosity and exploration. , 1966, Science.

[25]  S. Mednick,et al.  Remote Associates Test, College, Adult, Form 1 and Examiner's Manual, Remote Associates Test, College and Adult Forms 1 and 2. , 1967 .

[26]  E. Deci,et al.  A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. , 1999, Psychological bulletin.

[27]  Joseph E LeDoux.  Rethinking the Emotional Brain , 2012, Neuron.

[28]  R. Nisbett,et al.  Undermining children's intrinsic interest with extrinsic reward: A test of the "overjustification" hypothesis. , 1973 .

[29]  Peter Stone,et al.  Reinforcement learning , 2019, Scholarpedia.

[30]  Kenji Matsumoto,et al.  Neural basis of the undermining effect of monetary reward on intrinsic motivation , 2010, Proceedings of the National Academy of Sciences.

[31]  Stephen Rollnick,et al.  Motivational Interviewing: Preparing People for Change, 2nd Edition , 2002 .

[32]  R. Passingham,et al.  Motivation to do well enhances responses to errors and self-monitoring. , 2009, Cerebral cortex.

[33]  Carol S. Dweck,et al.  Motivational processes affecting learning. , 1986 .

[34]  S. Shimojo,et al.  Neural Mechanisms Underlying Paradoxical Performance for Monetary Incentives Are Driven by Loss Aversion , 2012, Neuron.

[35]  H. Critchley,et al.  Neural systems supporting interoceptive awareness , 2004, Nature Neuroscience.

[36]  P. Dayan,et al.  Reward, Motivation, and Reinforcement Learning , 2002, Neuron.

[37]  Jonathan D. Cohen,et al.  Imaging valuation models in human choice. , 2006, Annual review of neuroscience.

[38]  Pearl H Chiu,et al.  Neural evidence for enhanced error detection in major depressive disorder. , 2007, The American journal of psychiatry.

[39]  D. Hebb.  Drives and the C.N.S. (conceptual nervous system). , 1955, Psychological review.

[40]  A. Craig,et al.  How do you feel — now? The anterior insula and human awareness , 2009, Nature Reviews Neuroscience.

[41]  Peter Kirsch,et al.  Motivational orientation modulates the neural response to reward , 2010, NeuroImage.

[42]  Akira Ishii,et al.  The neural basis of academic achievement motivation , 2008, NeuroImage.

[43]  Suzanne T. Gurland,et al.  What happens during the free-choice period? Evidence of a polarizing effect of extrinsic rewards on intrinsic motivation , 2009 .

[44]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[45]  D. Laming.  Choice reaction performance following an error , 1979 .

[46]  M. Delgado,et al.  The Inherent Reward of Choice , 2011, Psychological science.

[47]  Kathleen D. Vohs,et al.  PSYCHOLOGICAL SCIENCE Research Article SELF-REGULATORY FAILURE: A Resource-Depletion Approach , 2022 .

[48]  A. Der-Avakian,et al.  The neurobiology of anhedonia and other reward-related deficits , 2012, Trends in Neurosciences.

[49]  R. Dolan,et al.  Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans , 2006, Nature.

[50]  M. Muraven,et al.  Conserving self-control strength. , 2006, Journal of personality and social psychology.

[51]  Shaun R. Patel,et al.  Human Dorsal Anterior Cingulate Cortex Neurons Mediate Ongoing Behavioral Adaptation , 2012, Nature.