The Importance of Failure: Feedback Related Negativity Predicts Motor Learning Efficiency

Learning from past mistakes is of prominent importance for successful future behavior. In the present study, we tested whether reinforcement learning signals in the brain are predictive of adequate learning of a sequence of motor actions. We recorded event-related potentials (ERPs) while subjects engaged in a sequence learning task. The results showed that brain responses to feedback (the feedback-related negativity [FRN]) predicted whether subjects learned to avoid an erroneous response the next time this action had to be performed. Our findings add to a growing literature on feedback-based performance adjustment, by showing that FRN amplitudes may reflect the acquisition of motor skill and the consolidation of contingencies between stimuli or cues and their associated responses, providing evidence that learning efficiency and future performance can be predicted by the neural response to current feedback: FRN amplitude associated with a mistake is predictive of whether this mistake will be repeated, or learned from.

[1]  David Goodman,et al.  Performance Monitoring in the Anterior Cingulate is Not All Error Related: Expectancy Deviation and the Representation of Action-Outcome Associations , 2007, Journal of Cognitive Neuroscience.

[2]  R. Sutton,et al.  Reinforcement Learning in Artificial Intelligence , 1997 .

[3]  Michael J. Frank,et al.  Error-Related Negativity Predicts Reinforcement Learning and Conflict Biases , 2005, Neuron.

[4]  W. Schultz.  Getting Formal with Dopamine and Reward , 2002, Neuron.

[5]  I. Daum,et al.  Learning‐related changes in reward expectancy are reflected in the feedback‐related negativity , 2008, The European journal of neuroscience.

[6]  M. Botvinick,et al.  Error-likelihood prediction in the medial frontal cortex: a critical evaluation. , 2007, Cerebral cortex.

[7]  Maarten A. S. Boksem,et al.  Mental fatigue, motivation and action monitoring , 2006, Biological Psychology.

[8]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[9]  D. Meyer,et al.  A Neural System for Error Detection and Compensation , 1993 .

[10]  Adrian R. Willoughby,et al.  The Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses , 2002, Science.

[11]  M. Reuter,et al.  Genetically Determined Differences in Learning from Errors , 2007, Science.

[12]  K. R. Ridderinkhof,et al.  Errors are foreshadowed in brain potentials associated with action monitoring in cingulate cortex in humans , 2003, Neuroscience Letters.

[13]  Clay B. Holroyd,et al.  Dorsal anterior cingulate cortex integrates reinforcement history to guide voluntary behavior , 2008, Cortex.

[14]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[15]  R. T. Pivik,et al.  Guidelines for the recording and quantitative analysis of electroencephalographic activity in research contexts. , 1993, Psychophysiology.

[16]  Timothy E. J. Behrens,et al.  Optimal decision making and the anterior cingulate cortex , 2006, Nature Neuroscience.

[17]  Clay B. Holroyd,et al.  Reward prediction error signals associated with a modified time estimation task. , 2007, Psychophysiology.

[18]  M. Annett.  A classification of hand preference by association analysis. , 1970, British journal of psychology.

[19]  Clay B. Holroyd,et al.  The feedback correct-related positivity: sensitivity of the event-related brain potential to unexpected positive feedback. , 2008, Psychophysiology.

[20]  Clay B. Holroyd,et al.  Knowing good from bad: differential activation of human cortical areas by positive and negative outcomes , 2005, The European journal of neuroscience.

[21]  D. Tucker,et al.  Electrophysiological Responses to Errors and Feedback in the Process of Action Regulation , 2003, Psychological science.

[22]  Clay B. Holroyd,et al.  Reinforcement-related brain potentials from medial frontal cortex: origins and functional significance , 2004, Neuroscience & Biobehavioral Reviews.

[23]  Michael X. Cohen,et al.  Behavioral / Systems / Cognitive Reinforcement Learning Signals Predict Future Decisions , 2007 .

[24]  C. Braun,et al.  Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a Generic Neural System for Error Detection , 1997, Journal of Cognitive Neuroscience.

[25]  E. Donchin,et al.  On quantifying surprise: the variation of event-related potentials with subjective probability. , 1977, Psychophysiology.

[26]  Daniel G. Dillon,et al.  Individual differences in reinforcement learning: Behavioral, electrophysiological, and neuroimaging correlates , 2008, NeuroImage.

[27]  Maarten A. S. Boksem,et al.  Error-related ERP components and individual differences in punishment and reward sensitivity , 2006, Brain Research.

[28]  Clay B. Holroyd,et al.  It's worse than you thought: the feedback negativity and violations of reward prediction in gambling tasks. , 2007, Psychophysiology.

[29]  E Donchin,et al.  A new method for off-line removal of ocular artifact. , 1983, Electroencephalography and clinical neurophysiology.

[30]  W. Schultz.  Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology , 2004, Current Opinion in Neurobiology.

[31]  J. Mattingley,et al.  Human medial frontal cortex activity predicts learning from errors. , 2008, Cerebral cortex.

[32]  R. Knight,et al.  Mechanisms of human attention: event-related potentials and oscillations , 2001, Neuroscience & Biobehavioral Reviews.