The Good, the Bad, or the Useful? The Examination of the Relationship between the Feedback-related Negativity (FRN) and Long-term Learning Outcomes

According to the reinforcement learning account of the error-related negativity (ERN), the ERN is a manifestation of a signal generated in ACC as a consequence of a phasic decrease in the activity of the mesencephalic dopamine system occurring when the monitoring system evaluates events as worse than expected. This signal is also hypothesized to be used to modify behavior to ascertain that future events will have better outcomes. It is therefore expected that this signal be correlated with learning outcomes. We report a study designed to examine the extent to which the ERN is related to learning outcomes within a paired-associates learning task. The feedback-related negativity (FRN) elicited by stimuli that indicated to the participants whether their response was correct or not was examined both according the degree to which the associates were learned in the session and according to whether participants recalled the associations on the next day. The results of the spatio-temporal PCA indicate that, whereas the process giving rise to the negative feedback elicited a FRN whose amplitude was not correlated with long-term learning outcomes, positive feedback was associated with a FRN-like activity, which was correlated with the learning outcomes. Another ERP component that follows the FRN temporally and shares its spatial distribution was found associated with long-term learning outcomes. Our findings shed light on the functional significance of the feedback-related ERP components and are discussed within the framework of the reinforcement learning ERN hypothesis.

[1]  Clay B. Holroyd,et al.  A note on the oddball N200 and the feedback ERN , 2004 .

[2]  C. Braun,et al.  Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a Generic Neural System for Error Detection , 1997, Journal of Cognitive Neuroscience.

[3]  Clay B. Holroyd,et al.  Reward prediction error signals associated with a modified time estimation task. , 2007, Psychophysiology.

[4]  M. Coles,et al.  The influence of the magnitude, probability, and valence of potential wins and losses on the amplitude of the feedback negativity. , 2012, Psychophysiology.

[5]  U. Sailer,et al.  Effects of learning on feedback-related brain potentials in a decision-making task , 2010, Brain Research.

[6]  Clay B. Holroyd,et al.  Evidence for hierarchical error processing in the human brain , 2006, Neuroscience.

[7]  Roshan Cools,et al.  Feedback-related Negativity Codes Prediction Error but Not Behavioral Adjustment during Probabilistic Reversal Learning , 2011, Journal of Cognitive Neuroscience.

[8]  Younghee Sheen.  Exploring the relationship between characteristics of recasts and learner uptake , 2006 .

[9]  R. Baker,et al.  When is an error not a prediction error? An electrophysiological investigation , 2009, Cognitive, affective & behavioral neuroscience.

[10]  Stephanie C. Y. Chan,et al.  On the value of information and other rewards , 2011, Nature Neuroscience.

[11]  Miriam Erez,et al.  Feedback: A necessary condition for the goal setting-performance relationship. , 1976 .

[12]  Michael J. Frank,et al.  Error-Related Negativity Predicts Reinforcement Learning and Conflict Biases , 2005, Neuron.

[13]  K. Kiehl,et al.  Error processing and the rostral anterior cingulate: an event-related fMRI study. , 2000, Psychophysiology.

[14]  Clay B. Holroyd,et al.  It's worse than you thought: the feedback negativity and violations of reward prediction in gambling tasks. , 2007, Psychophysiology.

[15]  James L. McClelland,et al.  Performance Feedback Drives Caudate Activation in a Phonological Learning Task , 2006, Journal of Cognitive Neuroscience.

[16]  Yael Arbel,et al.  How large the sin? A study of the event related potentials elicited by errors of varying magnitude. , 2011, Psychophysiology.

[17]  Anna Weinberg,et al.  Event‐related potential activity in the basal ganglia differentiates rewards from nonrewards: Temporospatial principal components analysis and source localization of the feedback negativity , 2011, Human brain mapping.

[18]  Clay B. Holroyd,et al.  Error-related scalp potentials elicited by hand and foot movements: evidence for an output-independent error-processing system in humans , 1998, Neuroscience Letters.

[19]  W. Perlstein,et al.  Reward context sensitivity impairment following severe TBI: An event-related potential investigation , 2007, Journal of the International Neuropsychological Society.

[20]  M. Coltheart,et al.  358,534 nonwords: The ARC Nonword Database , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[21]  Elizabeth Tricomi,et al.  Feedback signals in the caudate reflect goal achievement on a declarative memory task , 2008, NeuroImage.

[22]  F. Donkers,et al.  Mediofrontal negativities to averted gains and losses in the slot-machine task : a further investigation , 2005 .

[23]  Petra Vlamings,et al.  Reduced error monitoring in children with autism spectrum disorder: an ERP study , 2008, The European journal of neuroscience.

[24]  M. Posner,et al.  Localization of a Neural System for Error Detection and Compensation , 1994 .

[25]  Caroline Di Bernardi Luft,et al.  Learning from feedback: The neural mechanisms of feedback processing facilitating better performance , 2014, Behavioural Brain Research.

[26]  Cameron S Carter,et al.  Development of action monitoring through adolescence into adulthood: ERP and source localization. , 2007, Developmental science.

[27]  Jutta Kray,et al.  Developmental differences in learning and error processing: evidence from ERPs. , 2009, Psychophysiology.

[28]  Yael Arbel,et al.  On the Utility of Positive and Negative Feedback in a Paired-associate Learning Task , 2014, Journal of Cognitive Neuroscience.

[29]  Maarten A. S. Boksem,et al.  The Importance of Failure: Feedback Related Negativity Predicts Motor Learning Efficiency , 2009, NeuroImage.

[30]  James W. Tanaka,et al.  Learning to Become an Expert: Reinforcement Learning and the Acquisition of Perceptual Expertise , 2009, Journal of Cognitive Neuroscience.

[31]  Adrian R. Willoughby,et al.  The Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses , 2002, Science.

[32]  David Goodman,et al.  Performance Monitoring in the Anterior Cingulate is Not All Error Related: Expectancy Deviation and the Representation of Action-Outcome Associations , 2007, Journal of Cognitive Neuroscience.

[33]  P. Read Montague,et al.  When Things Are Better or Worse than Expected: The Medial Frontal Cortex and the Allocation of Processing Resources , 2006, Journal of Cognitive Neuroscience.

[34]  G. Jackson,et al.  Learning and altering behaviours by reinforcement: Neurocognitive differences between children and adults , 2013, Developmental Cognitive Neuroscience.

[35]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[36]  Sander Nieuwenhuis,et al.  Mediofrontal negativities in the absence of responding. , 2005, Brain research. Cognitive brain research.

[37]  Clay B. Holroyd,et al.  Errors in reward prediction are re£ected in the event-related brain potential , 2003 .

[38]  Scott A. Huettel,et al.  Rapid Electrophysiological Brain Responses are Influenced by Both Valence and Magnitude of Monetary Rewards , 2008, Journal of Cognitive Neuroscience.

[39]  D. Meyer,et al.  A Neural System for Error Detection and Compensation , 1993 .

[40]  M. Botvinick,et al.  Anterior cingulate cortex, error detection, and the online monitoring of performance. , 1998, Science.

[41]  Ivan Toni,et al.  Neural dynamics of error processing in medial frontal cortex , 2005, NeuroImage.

[42]  Clay B. Holroyd,et al.  The feedback correct-related positivity: sensitivity of the event-related brain potential to unexpected positive feedback. , 2008, Psychophysiology.

[43]  E. Donchin,et al.  Spatiotemporal analysis of the late ERP responses to deviant stimuli. , 2001, Psychophysiology.

[44]  Ethan S. Bromberg-Martin,et al.  Lateral habenula neurons signal errors in the prediction of reward information , 2011, Nature Neuroscience.

[45]  G. Glover,et al.  Error‐related brain activation during a Go/NoGo response inhibition task , 2001, Human brain mapping.

[46]  N. Yeung,et al.  On the ERN and the significance of errors. , 2005, Psychophysiology.

[47]  Kyle S. Smith,et al.  Corticostriatal Interactions during Learning, Memory Processing, and Decision Making , 2009, The Journal of Neuroscience.

[48]  Michael X. Cohen,et al.  Behavioral / Systems / Cognitive Reinforcement Learning Signals Predict Future Decisions , 2007 .

[49]  M. Kawato,et al.  Different neural correlates of reward expectation and reward expectation error in the putamen and caudate nucleus during stimulus-action-reward association learning. , 2006, Journal of neurophysiology.

[50]  C. Brunia,et al.  Psychophysiological brain research. , 1993 .

[51]  C. Carter,et al.  The Timing of Action-Monitoring Processes in the Anterior Cingulate Cortex , 2002, Journal of Cognitive Neuroscience.

[52]  J. Ford,et al.  Anatomy of an error: ERP and fMRI , 2003, Biological Psychology.

[53]  Yael Arbel,et al.  Parsing the componential structure of post-error ERPs: a principal component analysis of ERPs following errors. , 2009, Psychophysiology.

[54]  E Donchin,et al.  A new method for off-line removal of ocular artifact. , 1983, Electroencephalography and clinical neurophysiology.

[55]  Clay B. Holroyd,et al.  Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feedback error-related negativity and N200 , 2011, Biological Psychology.

[56]  Carol A. Seger,et al.  Dissociation between Striatal Regions while Learning to Categorize via Feedback and via Observation , 2007, Journal of Cognitive Neuroscience.

[57]  Raymond J. Dolan,et al.  Anterior cingulate activity during error and autonomic response , 2005, NeuroImage.

[58]  T. Endrass,et al.  Changes of performance monitoring with learning in older and younger adults. , 2008, Psychophysiology.

[59]  J. Fiez,et al.  Information content and reward processing in the human striatum during performance of a declarative memory task , 2011, Cognitive, Affective, & Behavioral Neuroscience.

[60]  I. Daum,et al.  It is less than you expected: The feedback-related negativity reflects violations of reward magnitude expectations , 2010, Neuropsychologia.