Valence-separated representation of reward prediction error in feedback-related negativity and positivity

Feedback-related negativity (FRN) is an event-related brain potential (ERP) component elicited by errors and negative outcomes. Previous studies proposed that FRN reflects the activity of a general error-processing system that incorporates reward prediction error (RPE). However, other studies reported inconsistent results on this issue – namely, that FRN only reflects the valence of feedback and that the magnitude of RPE is reflected by the other ERP component called P300. The present study focused on the relationship between the FRN amplitude and RPE. ERPs were recorded during a reversal learning task performed by the participants, and a computational model was used to estimate trial-by-trial RPEs, which we correlated with the ERPs. The results indicated that FRN and P300 reflected the magnitude of RPE in negative outcomes and positive outcomes, respectively. In addition, the correlation between RPE and the P300 amplitude was stronger than the correlation between RPE and the FRN amplitude. These differences in the correlation between ERP and RPE components may explain the inconsistent results reported by previous studies; the asymmetry in the correlations might make it difficult to detect the effect of the RPE magnitude on the FRN and makes it appear that the FRN only reflects the valence of feedback.

[1]  Adrian G. Fischer,et al.  Neural mechanisms and temporal dynamics of performance monitoring , 2014, Trends in Cognitive Sciences.

[2]  John R. Anderson,et al.  Modulation of the feedback-related negativity by instruction and experience , 2011, Proceedings of the National Academy of Sciences.

[3]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[4]  C. Holroyd,et al.  Which way do I go? Neural activation in response to feedback and spatial processing in a virtual T-maze. , 2009, Cerebral cortex.

[5]  Sander Nieuwenhuis,et al.  Mediofrontal negativities in the absence of responding. , 2005, Brain research. Cognitive brain research.

[6]  Jonathan R. Folstein,et al.  Novelty and conflict in the categorization of complex stimuli. , 2008, Psychophysiology.

[7]  P. Dayan,et al.  Differential Encoding of Losses and Gains in the Human Striatum , 2007, The Journal of Neuroscience.

[8]  Clay B. Holroyd,et al.  Brain potentials associated with expected and unexpected good and bad outcomes. , 2005, Psychophysiology.

[9]  James F. Cavanagh,et al.  Frontal theta links prediction errors to behavioral adaptation in reinforcement learning , 2010, NeuroImage.

[10]  John R. Anderson,et al.  Learning from delayed feedback: neural responses in temporal credit assignment , 2011, Cognitive, affective & behavioral neuroscience.

[11]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[12]  N. Daw,et al.  Differential roles of human striatum and amygdala in associative learning , 2011, Nature Neuroscience.

[13]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[14]  D. Meyer,et al.  A Neural System for Error Detection and Compensation , 1993 .

[15]  Clay B. Holroyd,et al.  It's worse than you thought: the feedback negativity and violations of reward prediction in gambling tasks. , 2007, Psychophysiology.

[16]  Y. Niv,et al.  Dialogues on prediction errors , 2008, Trends in Cognitive Sciences.

[17]  Nathaniel D. Daw,et al.  Trial-by-trial data analysis using computational models , 2011 .

[18]  Hauke R. Heekeren,et al.  Temporal dynamics of prediction error processing during reward-based decision making , 2010, NeuroImage.

[19]  Hideki Ohira,et al.  Subjective and model-estimated reward prediction: association with the feedback-related negativity (FRN) and reward prediction error in a reinforcement learning task. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[20]  Jonathan R. Folstein,et al.  Influence of cognitive control and mismatch on the N2 component of the ERP: a review. , 2007, Psychophysiology.

[21]  C. Braun,et al.  Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a Generic Neural System for Error Detection , 1997, Journal of Cognitive Neuroscience.

[22]  Roshan Cools,et al.  Dissociable responses to punishment in distinct striatal regions during reversal learning , 2010, NeuroImage.

[23]  Yu Bai,et al.  Dual learning processes underlying human decision-making in reversal learning tasks: functional significance and evidence from the model fit to human behavior , 2014, Front. Psychol..