Reward positivity: Reward prediction error or salience prediction error?

The reward positivity is a component of the human ERP elicited by feedback stimuli in trial-and-error learning and guessing tasks. A prominent theory holds that the reward positivity reflects a reward prediction error signal that is sensitive to outcome valence, being larger for unexpected positive events relative to unexpected negative events (Holroyd & Coles, 2002). Although the theory has found substantial empirical support, most of these studies have utilized either monetary or performance feedback to test the hypothesis. However, in apparent contradiction to the theory, a recent study found that unexpected physical punishments also elicit the reward positivity (Talmi, Atkinson, & El-Deredy, 2013). The authors of this report argued that the reward positivity reflects a salience prediction error rather than a reward prediction error. To investigate this finding further, in the present study participants navigated a virtual T maze and received feedback on each trial under two conditions. In a reward condition, the feedback indicated that they would either receive a monetary reward or not and in a punishment condition the feedback indicated that they would receive a small shock or not. We found that the feedback stimuli elicited a typical reward positivity in the reward condition and an apparently delayed reward positivity in the punishment condition. Importantly, this signal was more positive to the stimuli that predicted the omission of a possible punishment relative to stimuli that predicted a forthcoming punishment, which is inconsistent with the salience hypothesis.

[1]  Clay B. Holroyd,et al.  The Impact of Deliberative Strategy Dissociates ERP Components Related to Conflict Processing vs. Reinforcement Learning , 2012, Front. Neurosci..

[2]  Greg H. Proudfit The reward positivity: from basic research on reward to a biomarker for depression. , 2015, Psychophysiology.

[3]  Clay B. Holroyd,et al.  A note on the oddball N200 and the feedback ERN , 2004 .

[4]  R. Baker,et al.  When is an error not a prediction error? An electrophysiological investigation , 2009, Cognitive, affective & behavioral neuroscience.

[5]  Raymond J. Dolan,et al.  An MEG signature corresponding to an axiomatic model of reward prediction error , 2012, NeuroImage.

[6]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[7]  Thomas D. Sambrook,et al.  A neural reward prediction error revealed by a meta-analysis of ERPs using great grand averages. , 2015, Psychological bulletin.

[8]  M Conte Learning from experience. , 1987, Food management.

[9]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[10]  Clay B. Holroyd,et al.  Motivation of extended behaviors by anterior cingulate cortex , 2012, Trends in Cognitive Sciences.

[11]  Samuel M. McClure,et al.  Hierarchical control over effortful behavior by rodent medial frontal cortex: A computational model. , 2015, Psychological review.

[12]  E Donchin,et al.  A new method for off-line removal of ocular artifact. , 1983, Electroencephalography and clinical neurophysiology.

[13]  Clay B. Holroyd,et al.  The feedback correct-related positivity: sensitivity of the event-related brain potential to unexpected positive feedback. , 2008, Psychophysiology.

[14]  Nicola K. Ferdinand,et al.  The Processing of Unexpected Positive Response Outcomes in the Mediofrontal Cortex , 2012, The Journal of Neuroscience.

[15]  K. R. Ridderinkhof,et al.  The Role of the Medial Frontal Cortex in Cognitive Control , 2004, Science.

[16]  John R. Anderson,et al.  Learning from experience: Event-related potential correlates of reward processing, neural adaptation, and behavioral choice , 2012, Neuroscience & Biobehavioral Reviews.

[17]  Deborah Talmi,et al.  The Feedback-Related Negativity Signals Salience Prediction Errors, Not Reward Prediction Errors , 2013, The Journal of Neuroscience.

[18]  P. Dayan,et al.  Action versus valence in decision making , 2014, Trends in Cognitive Sciences.

[19]  Joseph T. McGuire,et al.  A Neural Signature of Hierarchical Reinforcement Learning , 2011, Neuron.

[20]  Sham M. Kakade,et al.  Opponent interactions between serotonin and dopamine , 2002, Neural Networks.

[21]  Jeff T. Larsen,et al.  Context dependence of the event-related brain potential associated with reward and punishment. , 2004, Psychophysiology.

[22]  Clay B. Holroyd,et al.  Sensitivity of electrophysiological activity from medial frontal cortex to utilitarian and performance feedback. , 2004, Cerebral cortex.

[23]  Tobias U. Hauser,et al.  The feedback-related negativity (FRN) revisited: New insights into the localization, meaning and network organization , 2014, NeuroImage.

[24]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[25]  C. Holroyd,et al.  Which way do I go? Neural activation in response to feedback and spatial processing in a virtual T-maze. , 2009, Cerebral cortex.

[26]  Clay B. Holroyd,et al.  Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feedback error-related negativity and N200 , 2011, Biological Psychology.

[27]  J. Grose-Fifer,et al.  The feedback-related negativity (FRN) in adolescents. , 2012, Psychophysiology.

[28]  C. Braun,et al.  Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a Generic Neural System for Error Detection , 1997, Journal of Cognitive Neuroscience.

[29]  Clay B. Holroyd,et al.  Reward prediction error signals associated with a modified time estimation task. , 2007, Psychophysiology.

[30]  Clay B. Holroyd,et al.  Errors in reward prediction are re£ected in the event-related brain potential , 2003 .

[31]  M. Masson,et al.  Using confidence intervals in within-subject designs , 1994, Psychonomic bulletin & review.

[32]  Martin E. Maier,et al.  Mediofrontal negativity signals unexpected omission of aversive events , 2014, Scientific Reports.

[33]  David Goodman,et al.  Performance Monitoring in the Anterior Cingulate is Not All Error Related: Expectancy Deviation and the Representation of Action-Outcome Associations , 2007, Journal of Cognitive Neuroscience.