On the Utility of Positive and Negative Feedback in a Paired-associate Learning Task

This study offers a neurophysiological examination of the relationship between feedback processing and learning. A two-choice paired-associate learning task borrowed and modified from Tricomi and Fiez [Tricomi, E., & Fiez, J. A. Feedback signals in the caudate reflect goal achievement on a declarative memory task. Neuroimage, 41, 1154–1167, 2008] was employed to examine the mediofrontal electrophysiological brain activity associated with the processing of performance feedback in a learning task and to elucidate the extent to which the processing of the initial informative feedback is related to learning outcomes. Twenty participants were tasked with learning to correctly pair 60 novel objects with their names by choosing on a trial-by-trial basis between two possible names and receiving feedback about the accuracy of their selection. The novel objects were presented in three blocks of trials (rounds), each of which presented the same set of 60 objects once. The rounds allowed the separation of the initial informative feedback in Round 1 from the other feedback stimuli in Rounds 2 and 3. The results indicated differences in the processing of initial informative and proceeding feedback stimuli. More specifically, the difference appeared to be driven by the change in the processing of positive feedback. Moreover, very first positive feedback provided in association with a particular new object was found associated with learning outcomes. The results imply that signs of successful and unsuccessful learning may be detected as early as the initial positive feedback provided in a learning task. The results suggest that the process giving rise to the feedback-related negativity is sensitive to the utility of the feedback and that the processing of the first informative positive feedback is associated with learning outcomes.

[1]  Maarten A. S. Boksem,et al.  The Importance of Failure: Feedback Related Negativity Predicts Motor Learning Efficiency , 2009, NeuroImage.

[2]  Clay B. Holroyd,et al.  It's worse than you thought: the feedback negativity and violations of reward prediction in gambling tasks. , 2007, Psychophysiology.

[3]  James W. Tanaka,et al.  Learning to Become an Expert: Reinforcement Learning and the Acquisition of Perceptual Expertise , 2009, Journal of Cognitive Neuroscience.

[4]  U. Sailer,et al.  Effects of learning on feedback-related brain potentials in a decision-making task , 2010, Brain Research.

[5]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[6]  Jutta Kray,et al.  Developmental differences in learning and error processing: evidence from ERPs. , 2009, Psychophysiology.

[7]  Clay B. Holroyd,et al.  Errors in reward prediction are re£ected in the event-related brain potential , 2003 .

[8]  D. Meyer,et al.  A Neural System for Error Detection and Compensation , 1993 .

[9]  Yael Arbel,et al.  The Good, the Bad, or the Useful? The Examination of the Relationship between the Feedback-related Negativity (FRN) and Long-term Learning Outcomes , 2013, Journal of Cognitive Neuroscience.

[10]  Nicola K. Ferdinand,et al.  The Processing of Unexpected Positive Response Outcomes in the Mediofrontal Cortex , 2012, The Journal of Neuroscience.

[11]  Markus Ullsperger,et al.  Event-Related Potential Correlates of Performance-Monitoring in a Lateralized Time-Estimation Task , 2011, PloS one.

[12]  Agustín Ibáñez,et al.  Size and probability of rewards modulate the feedback error-related negativity associated with wins but not losses in a monetarily rewarded gambling task , 2010, NeuroImage.

[13]  Scott A. Huettel,et al.  Rapid Electrophysiological Brain Responses are Influenced by Both Valence and Magnitude of Monetary Rewards , 2008, Journal of Cognitive Neuroscience.

[14]  Clay B. Holroyd,et al.  Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feedback error-related negativity and N200 , 2011, Biological Psychology.

[15]  T. Endrass,et al.  Changes of performance monitoring with learning in older and younger adults. , 2008, Psychophysiology.

[16]  Eoin Thomas,et al.  Online extraction and single trial analysis of regions contributing to erroneous feedback detection , 2015, NeuroImage.

[17]  Clay B. Holroyd,et al.  Reward positivity elicited by predictive cues , 2011, Neuroreport.

[18]  Junrrs F. Kri Recognizing Words, Pictures, and Concepts: A Comparison of Lexical, Object, and Reality Decisions , 1984 .

[19]  Clay B. Holroyd,et al.  Reward prediction error signals associated with a modified time estimation task. , 2007, Psychophysiology.

[20]  Elizabeth Tricomi,et al.  Feedback signals in the caudate reflect goal achievement on a declarative memory task , 2008, NeuroImage.

[21]  P. Read Montague,et al.  When Things Are Better or Worse than Expected: The Medial Frontal Cortex and the Allocation of Processing Resources , 2006, Journal of Cognitive Neuroscience.

[22]  Matthew W. Miller,et al.  Why self-controlled feedback enhances motor learning: Answers from electroencephalography and indices of motivation. , 2015, Human movement science.

[23]  E Donchin,et al.  A new method for off-line removal of ocular artifact. , 1983, Electroencephalography and clinical neurophysiology.

[24]  Michael X. Cohen,et al.  Reward expectation modulates feedback-related negativity and EEG spectra , 2007, NeuroImage.

[25]  Clay B. Holroyd,et al.  The feedback correct-related positivity: sensitivity of the event-related brain potential to unexpected positive feedback. , 2008, Psychophysiology.

[26]  E. Donchin,et al.  Spatiotemporal analysis of the late ERP responses to deviant stimuli. , 2001, Psychophysiology.

[27]  M. Coles,et al.  The influence of the magnitude, probability, and valence of potential wins and losses on the amplitude of the feedback negativity. , 2012, Psychophysiology.

[28]  M. Coltheart,et al.  358,534 nonwords: The ARC Nonword Database , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[29]  B. Eppinger,et al.  Better or worse than expected? Aging, learning, and the ERN , 2008, Neuropsychologia.

[30]  Adrian R. Willoughby,et al.  The Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses , 2002, Science.

[31]  J. Fiez,et al.  Information content and reward processing in the human striatum during performance of a declarative memory task , 2011, Cognitive, Affective, & Behavioral Neuroscience.

[32]  David Goodman,et al.  Performance Monitoring in the Anterior Cingulate is Not All Error Related: Expectancy Deviation and the Representation of Action-Outcome Associations , 2007, Journal of Cognitive Neuroscience.

[33]  Anna Weinberg,et al.  Event‐related potential activity in the basal ganglia differentiates rewards from nonrewards: Temporospatial principal components analysis and source localization of the feedback negativity , 2011, Human brain mapping.

[34]  C. Braun,et al.  Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a Generic Neural System for Error Detection , 1997, Journal of Cognitive Neuroscience.

[35]  I. Daum,et al.  It is less than you expected: The feedback-related negativity reflects violations of reward magnitude expectations , 2010, Neuropsychologia.