Higher incentives can impair performance: neural evidence on reinforcement and rationality.

Standard economic thinking postulates that increased monetary incentives should increase performance. Human decision makers, however, frequently focus on past performance, a form of reinforcement learning occasionally at odds with rational decision making. We used an incentivized belief-updating task from economics to investigate this conflict through measurements of neural correlates of reward processing. We found that higher incentives fail to improve performance when immediate feedback on decision outcomes is provided. Subsequent analysis of the feedback-related negativity, an early event-related potential following feedback, revealed the mechanism behind this paradoxical effect. As incentives increase, the win/lose feedback becomes more prominent, leading to an increased reliance on reinforcement and more errors. This mechanism is relevant for economic decision making and the debate on performance-based payment.

[1]  Vardit Landsman,et al.  Dם Customers Learn from Experience? Evidence from Retail Banking , 2012, Manag. Sci..

[2]  C. Braun,et al.  Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a Generic Neural System for Error Detection , 1997, Journal of Cognitive Neuroscience.

[3]  Clay B. Holroyd,et al.  Reward prediction error signals associated with a modified time estimation task. , 2007, Psychophysiology.

[4]  J. Shaw,et al.  Are financial incentives related to performance? A meta-analytic review of empirical research. , 1998 .

[5]  E. Thorndike.  Animal Intelligence; Experimental Studies , 2009 .

[6]  Jonathan Evans.  Dual-processing accounts of reasoning, judgment, and social cognition. , 2008, Annual review of psychology.

[7]  Kara D. Federmeier,et al.  Event-related brain potentials. , 1990 .

[8]  Robin L. Dillon,et al.  How Near-Misses Influence Decision Making Under Risk: A Missed Opportunity for Learning , 2008, Manag. Sci..

[9]  Clay B. Holroyd,et al.  The feedback-related negativity reflects the binary evaluation of good versus bad outcomes , 2006, Biological Psychology.

[10]  Nina Mazar,et al.  Large stakes and big mistakes , 2009 .

[11]  Walter Schneider,et al.  Controlled and Automatic Human Information Processing: 1. Detection, Search, and Attention. , 1977 .

[12]  F. Strack,et al.  Reflective and Impulsive Determinants of Social Behavior , 2004, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[13]  D. Kahneman.  Maps of Bounded Rationality: Psychology for Behavioral Economics , 2003 .

[14]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[15]  Colin Camerer,et al.  The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework , 1999 .

[16]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[17]  R. Baumeister.  Choking under pressure: self-consciousness and paradoxical effects of incentives on skillful performance. , 1984, Journal of personality and social psychology.

[18]  Carlos Alós-Ferrer,et al.  Fast or Rational? A Response-Times Study of Bayesian Updating , 2014, Manag. Sci..

[19]  Marco Steinhauser,et al.  The neural basis of belief updating and rational decision making. , 2014, Social cognitive and affective neuroscience.

[20]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[21]  U. Gneezy,et al.  Journal of Economic Perspectives—Volume 25, Number 4—Fall 2011—Pages 191–210 When and Why Incentives (Don’t) Work to Modify Behavior , 2022 .

[22]  Bradley R. Staats,et al.  Learning from My Success and from Others' Failure: Evidence from Minimally Invasive Cardiac Surgery , 2013, Manag. Sci..

[23]  Michael J. Frank,et al.  Error-Related Negativity Predicts Reinforcement Learning and Conflict Biases , 2005, Neuron.

[24]  Jonathan D. Cohen,et al.  Computational roles for dopamine in behavioural control , 2004, Nature.

[25]  S. Shimojo,et al.  Neural Mechanisms Underlying Paradoxical Performance for Monetary Incentives Are Driven by Loss Aversion , 2012, Neuron.

[26]  E. Thorndike.  “Animal Intelligence” , 1898, Nature.

[27]  Gary Charness,et al.  When Optimal Choices Feel Wrong: A Laboratory Study of Bayesian Updating, Complexity, and Affect , 2004 .

[28]  R. Baumeister,et al.  A review of paradoxical performance effects: Choking under pressure in sports and mental tests , 1986 .

[29]  D. Hassabis,et al.  Choking on the Money , 2009, Psychological science.

[30]  R. Shiffrin,et al.  Controlled and automatic human information processing: I , 1977 .

[31]  A. Rustichini,et al.  Pay Enough or Don't Pay at All , 2000 .

[32]  J. Baron,et al.  Outcome bias in decision evaluation. , 1988, Journal of personality and social psychology.

[33]  Clay B. Holroyd,et al.  Errors in reward prediction are re£ected in the event-related brain potential , 2003 .

[34]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[35]  A. Sanfey,et al.  Independent Coding of Reward Magnitude and Valence in the Human Brain , 2004, The Journal of Neuroscience.

[36]  Leslie E. Papke,et al.  Econometric Methods for Fractional Response Variables with an Application to 401(K) Plan Participation Rates , 1993 .

[37]  Clay B. Holroyd,et al.  Sensitivity of electrophysiological activity from medial frontal cortex to utilitarian and performance feedback. , 2004, Cerebral cortex.