From Positivity to Negativity Bias: Ambiguity Affects the Neurophysiological Signatures of Feedback Processing

Previous studies on the neurophysiological underpinnings of feedback processing almost exclusively used low-ambiguity feedback, which does not fully address the diversity of situations in everyday life. We therefore used a pseudo trial-and-error learning task to investigate ERPs of low- versus high-ambiguity feedback. Twenty-eight participants tried to deduce the rule governing visual feedback to their button presses in response to visual stimuli. In the blocked condition, the same two feedback words were presented across several consecutive trials, whereas in the random condition feedback was randomly drawn on each trial from sets of five positive and five negative words. The feedback-related negativity (FRN-D), a frontocentral ERP difference between negative and positive feedback, was significantly larger in the blocked condition, whereas the centroparietal late positive complex indicating controlled attention was enhanced for negative feedback irrespective of condition. Moreover, FRN-D in the blocked condition was due to increased reward positivity (Rew-P) for positive feedback, rather than increased (raw) FRN for negative feedback. Our findings strongly support recent lines of evidence that the FRN-D, one of the most widely studied signatures of reinforcement learning in the human brain, critically depends on feedback discriminability and is primarily driven by the Rew-P. A novel finding concerned larger frontocentral P2 for negative feedback in the random but not the blocked condition. Although Rew-P points to a positivity bias in feedback processing under conditions of low feedback ambiguity, P2 suggests a specific adaptation of information processing in case of highly ambiguous feedback, involving an early negativity bias. Generalizability of the P2 findings was demonstrated in a second experiment using explicit valence categorization of highly emotional positive and negative adjectives.

[1]  Clay B. Holroyd,et al.  It's worse than you thought: the feedback negativity and violations of reward prediction in gambling tasks. , 2007, Psychophysiology.

[2]  Anna Weinberg,et al.  Event‐related potential activity in the basal ganglia differentiates rewards from nonrewards: Temporospatial principal components analysis and source localization of the feedback negativity , 2011, Human brain mapping.

[3]  David M. Amodio,et al.  Coordinated Roles of Motivation and Perception in the Regulation of Intergroup Responses: Frontal Cortical Asymmetry Effects on the P2 Event-related Potential and Behavior , 2010, Journal of Cognitive Neuroscience.

[4]  Clay B. Holroyd,et al.  Knowing good from bad: differential activation of human cortical areas by positive and negative outcomes , 2005, The European journal of neuroscience.

[5]  Sara C. Sereno,et al.  Early emotion word processing: Evidence from event-related potentials , 2009, Biological Psychology.

[6]  Margaret Bradley,et al.  Event-related potential studies of language and emotion: words, phrases, and task effects. , 2006, Progress in brain research.

[7]  Josep Marco-Pallarés,et al.  Feedback-related Brain Potential Activity Complies with Basic Assumptions of Associative Learning Theory , 2012, Journal of Cognitive Neuroscience.

[8]  Mich Schwibbe,et al.  Zum emotionalen Gehalt von Substantiven, Adjektiven und Verben. , 1981 .

[9]  Michael X. Cohen,et al.  Reward expectation modulates feedback-related negativity and EEG spectra , 2007, NeuroImage.

[10]  Peter J. Lang,et al.  When fear forms memories: Threat of shock and brain potentials during encoding and recognition , 2013, Cortex.

[11]  Ezra E. Smith,et al.  The feedback negativity reflects favorable compared to nonfavorable outcomes based on global, not local, alternatives. , 2013, Psychophysiology.

[12]  Clay B. Holroyd,et al.  Hypersensitivity to Reward in Problem Gamblers , 2010, Biological Psychiatry.

[13]  Clay B. Holroyd,et al.  Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feedback error-related negativity and N200 , 2011, Biological Psychology.

[14]  Yue-Jia Luo,et al.  Temporal course of emotional negativity bias: An ERP study , 2006, Neuroscience Letters.

[15]  G. Peeters,et al.  Positive-Negative Asymmetry in Evaluations: The Distinction Between Affective and Informational Negativity Effects , 1990 .

[16]  Michael G. H. Coles,et al.  What if I told you: "You were wrong"? Brain potentials and behavioral adjustments elicited by feedback in a time-estimation task , 2004 .

[17]  M. Coles,et al.  The influence of the magnitude, probability, and valence of potential wins and losses on the amplitude of the feedback negativity. , 2012, Psychophysiology.

[18]  M. Bradley,et al.  Affective picture processing: the late positive potential is modulated by motivational relevance. , 2000, Psychophysiology.

[19]  William J. Gehring,et al.  Perceptual properties of feedback stimuli influence the feedback-related negativity in the flanker gambling task. , 2014, Psychophysiology.

[20]  E Donchin,et al.  A new method for off-line removal of ocular artifact. , 1983, Electroencephalography and clinical neurophysiology.

[21]  Uta Sailer,et al.  Manipulation of feedback expectancy and valence induces negative and positive reward prediction error signals manifest in event-related brain potentials. , 2011, Psychophysiology.

[22]  Issidoros C. Sarinopoulos,et al.  Uncertainty during anticipation modulates neural responses to aversion in human insula and amygdala. , 2010, Cerebral cortex.

[23]  Qingguo Ma,et al.  How an uncertain cue modulates subsequent monetary outcome evaluation: An ERP study , 2011, Neuroscience Letters.

[24]  E. Lettich,et al.  Modified Nomenclature for the “10%” Electrode System1 , 1988 .

[25]  A. Jacobs,et al.  Affective processing within 1/10th of a second: High arousal is necessary for early facilitative processing of negative but not positive words , 2009, Cognitive, affective & behavioral neuroscience.

[26]  David Goodman,et al.  Performance Monitoring in the Anterior Cingulate is Not All Error Related: Expectancy Deviation and the Representation of Action-Outcome Associations , 2007, Journal of Cognitive Neuroscience.

[27]  Yanni Liu,et al.  Loss feedback negativity elicited by single- versus conjoined-feature stimuli , 2009, Neuroreport.

[28]  T. Sejnowski,et al.  Removing electroencephalographic artifacts by blind source separation. , 2000, Psychophysiology.

[29]  Francesca M. M. Citron Neural correlates of written emotion word processing: A review of recent electrophysiological and hemodynamic neuroimaging studies , 2012, Brain and Language.

[30]  Clay B. Holroyd,et al.  Reward positivity elicited by predictive cues , 2011, Neuroreport.

[31]  J. Kissler,et al.  Event related potentials to emotional adjectives during reading. , 2008, Psychophysiology.

[32]  Clay B. Holroyd,et al.  A note on the oddball N200 and the feedback ERN , 2004 .

[33]  Johannes Hewig,et al.  Decision-making in Blackjack: an electrophysiological analysis. , 2007, Cerebral cortex.

[34]  C. Braun,et al.  Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a Generic Neural System for Error Detection , 1997, Journal of Cognitive Neuroscience.

[35]  W. Schultz Behavioral theories and the neurophysiology of reward. , 2006, Annual review of psychology.

[36]  Clay B. Holroyd,et al.  Reward prediction error signals associated with a modified time estimation task. , 2007, Psychophysiology.

[37]  Michael J. Frank,et al.  Error-Related Negativity Predicts Reinforcement Learning and Conflict Biases , 2005, Neuron.

[38]  P. Read Montague,et al.  When Things Are Better or Worse than Expected: The Medial Frontal Cortex and the Allocation of Processing Resources , 2006, Journal of Cognitive Neuroscience.

[39]  P Read Montague,et al.  Electrophysiological and hemodynamic responses to reward prediction violation , 2009, Neuroreport.

[40]  Salil H. Patel,et al.  Impact of instructed relevance on the visual ERP. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[41]  G. Potts An ERP index of task relevance evaluation of visual stimuli , 2004, Brain and Cognition.

[42]  Stephen B Gilbert,et al.  The temporal dynamics of medial and lateral frontal neural activity related to proactive cognitive control , 2012, Neuropsychologia.

[43]  Uta Sailer,et al.  Blocked versus randomized presentation modes differentially modulate feedback-related negativity and P3b amplitudes , 2014, Clinical Neurophysiology.

[44]  John M. Pearson,et al.  Rapid Brain Responses Independently Predict Gain Maximization and Loss Minimization during Economic Decision Making , 2013, The Journal of Neuroscience.

[45]  Joshua W. Brown,et al.  Medial prefrontal cortex as an action-outcome predictor , 2011, Nature Neuroscience.

[46]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[47]  Luis Carretié,et al.  Automatic attention to emotional stimuli: Neural correlates , 2004, Human brain mapping.

[48]  S. Luck,et al.  Spatio‐temporal dynamics of attention to color: Evidence from human electrophysiology , 1998, Human brain mapping.

[49]  W. Sommer,et al.  Time course and task dependence of emotion effects in word processing , 2009, Cognitive, affective & behavioral neuroscience.

[50]  E. Lettich,et al.  Modified nomenclature for the "10%" electrode system. , 1988, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[51]  B. Eppinger,et al.  Better or worse than expected? Aging, learning, and the ERN , 2008, Neuropsychologia.

[52]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[53]  Scott A. Huettel,et al.  Rapid Electrophysiological Brain Responses are Influenced by Both Valence and Magnitude of Monetary Rewards , 2008, Journal of Cognitive Neuroscience.

[54]  Xiaolin Zhou,et al.  The P300 and reward valence, magnitude, and expectancy in outcome evaluation , 2009, Brain Research.

[55]  Abigail A. Scholer,et al.  Responding to negativity : How a risky tactic can serve a vigilant strategy , 2008 .

[56]  W. Sommer,et al.  Emotions in word and face processing: Early and late cortical responses , 2009, Brain and Cognition.

[57]  P. Rabbitt Errors and error correction in choice-response tasks. , 1966, Journal of experimental psychology.

[58]  Sonja A. Kotz,et al.  Concreteness in emotional words: ERP evidence from a hemifield study , 2007, Brain Research.

[59]  Jeff T. Larsen,et al.  Negative information weighs more heavily on the brain: the negativity bias in evaluative categorizations. , 1998, Journal of personality and social psychology.

[60]  Clay B. Holroyd,et al.  Errors in reward prediction are re£ected in the event-related brain potential , 2003 .

[61]  R. Cools,et al.  Feedback-related negativity codes outcome valence, but not outcome expectancy, during reversal learning , 2013, Cognitive, affective & behavioral neuroscience.

[62]  Paul D. Kieffaber,et al.  Beyond the FN: A spatio-temporal analysis of the neural correlates of feedback processing in a virtual Blackjack game , 2014, Brain and Cognition.

[63]  Clay B. Holroyd,et al.  The feedback correct-related positivity: sensitivity of the event-related brain potential to unexpected positive feedback. , 2008, Psychophysiology.