The P300 and reward valence, magnitude, and expectancy in outcome evaluation

The P300 in event-related potentials (ERPs) has been implicated in outcome evaluation and reward processing, but it is controversial as to what aspects of reward processing it is sensitive. This study manipulated orthogonally reward valence, reward magnitude, and expectancy towards reward magnitude in a monetary gambling task and observed both the valence and the magnitude effects on the P300, but only when the amount of reward was expected on the basis of a previous cue. The FRN (feedback-related negativity), defined as the mean amplitudes of ERP responses to the loss or the gain outcome in the 250-350 ms time window post-onset of feedback, was found to be sensitive not only to reward valence, but also to expectancy towards reward magnitude and reward magnitude, with the violation of expectancy and the small magnitude eliciting more negative-going FRN. These findings demonstrate that while the FRN may function as a general mechanism that evaluates whether the outcome is consistent or inconsistent with expectation, the P300 is sensitive to a later, top-down controlled process of outcome evaluation, into which factors related to the allocation of attentional resources, including reward valence, reward magnitude, and magnitude expectancy, come to play.

[1]  Rongjun Yu,et al.  Brain responses to outcomes of one's own and other's performance in a gambling task , 2006, Neuroreport.

[2]  Clay B. Holroyd,et al.  Reward prediction error signals associated with a modified time estimation task. , 2007, Psychophysiology.

[3]  A. Sanfey,et al.  Independent Coding of Reward Magnitude and Valence in the Human Brain , 2004, The Journal of Neuroscience.

[4]  E. John,et al.  Evoked-Potential Correlates of Stimulus Uncertainty , 1965, Science.

[5]  Shiwei Jia,et al.  Detecting perceptual conflict by the feedback-related negativity in brain potentials , 2007, Neuroreport.

[6]  Michael X. Cohen,et al.  Behavioral / Systems / Cognitive Reinforcement Learning Signals Predict Future Decisions , 2007 .

[7]  D. Tucker,et al.  Electrophysiological Responses to Errors and Feedback in the Process of Action Regulation , 2003, Psychological science.

[8]  Jeff T. Larsen,et al.  Negative information weighs more heavily on the brain: the negativity bias in evaluative categorizations. , 1998, Journal of personality and social psychology.

[9]  Scott A. Huettel,et al.  Rapid Electrophysiological Brain Responses are Influenced by Both Valence and Magnitude of Monetary Rewards , 2008, Journal of Cognitive Neuroscience.

[10]  C. Braun,et al.  Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a Generic Neural System for Error Detection , 1997, Journal of Cognitive Neuroscience.

[11]  Clay B. Holroyd,et al.  Reinforcement-related brain potentials from medial frontal cortex: origins and functional significance , 2004, Neuroscience & Biobehavioral Reviews.

[12]  J. Polich,et al.  Cognitive and biological determinants of P300: an integrative review , 1995, Biological Psychology.

[13]  Clay B. Holroyd,et al.  The feedback correct-related positivity: sensitivity of the event-related brain potential to unexpected positive feedback. , 2008, Psychophysiology.

[14]  Asymmetrical effects of frequent gains and frequent losses in a gambling task , 2008, Neuroreport.

[15]  Giuseppe Sartori,et al.  Predicting outcomes of decisions in the brain , 2008, Behavioural Brain Research.

[16]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[17]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[18]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[19]  F. Martin,et al.  Affective picture processing and motivational relevance: arousal and valence effects on ERPs in an oddball task. , 2009, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[20]  Clay B. Holroyd,et al.  Errors in reward prediction are re£ected in the event-related brain potential , 2003 .

[21]  Sander Nieuwenhuis,et al.  Mediofrontal negativities in the absence of responding. , 2005, Brain research. Cognitive brain research.

[22]  Rongjun Yu,et al.  Brain potentials associated with outcome expectation and outcome evaluation , 2006, Neuroreport.

[23]  M. Bradley,et al.  Fleeting images: a new look at early emotion discrimination. , 2001, Psychophysiology.

[24]  Thomas F Münte,et al.  Internal and external information in error processing , 2008, BMC Neuroscience.

[25]  Clay B. Holroyd,et al.  The feedback-related negativity reflects the binary evaluation of good versus bad outcomes , 2006, Biological Psychology.

[26]  E. Donchin,et al.  On quantifying surprise: the variation of event-related potentials with subjective probability. , 1977, Psychophysiology.

[27]  R. Cabeza,et al.  Event-related potentials of emotional memory: Encoding pleasant, unpleasant, and neutral pictures , 2002, Cognitive, affective & behavioral neuroscience.

[28]  Jeff T. Larsen,et al.  The good, the bad and the neutral: Electrophysiological responses to feedback stimuli , 2006, Brain Research.

[29]  Clay B. Holroyd,et al.  It's worse than you thought: the feedback negativity and violations of reward prediction in gambling tasks. , 2007, Psychophysiology.

[30]  Clay B. Holroyd,et al.  Brain potentials associated with expected and unexpected good and bad outcomes. , 2005, Psychophysiology.

[31]  P. Read Montague,et al.  When Things Are Better or Worse than Expected: The Medial Frontal Cortex and the Allocation of Processing Resources , 2006, Journal of Cognitive Neuroscience.

[32]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[33]  Michael X. Cohen,et al.  Reward expectation modulates feedback-related negativity and EEG spectra , 2007, NeuroImage.

[34]  David Cucurell,et al.  Human oscillatory activity associated to reward processing in a gambling task , 2008, Neuropsychologia.

[35]  Adrian R. Willoughby,et al.  The Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses , 2002, Science.

[36]  Clay B. Holroyd,et al.  A note on the oddball N200 and the feedback ERN , 2004 .

[37]  H. Murohashi,et al.  The ERPs to feedback indicating monetary loss and gain on the game of modified “rock–paper–scissors” , 2005 .

[38]  John Polich,et al.  Affective valence and P300 when stimulus arousal level is controlled , 2007 .

[39]  Bryan C. McCannon Rock Paper Scissors , 2007 .

[40]  Don M. Tucker,et al.  Corticolimbic mechanisms in the control of trial and error learning , 2009, Brain Research.

[41]  Xiaolin Zhou,et al.  Modulation of the brain activity in outcome evaluation by interpersonal relationship: An ERP study , 2010, Neuropsychologia.

[42]  Jonas K. Olofsson,et al.  Affective picture processing: An integrative review of ERP findings , 2008, Biological Psychology.

[43]  S A Hillyard,et al.  P3 waves to the discrimination of targets in homogeneous and heterogeneous stimulus sequences. , 1977, Psychophysiology.

[44]  E Donchin,et al.  P300 and stimulus categorization: two plus one is not so different from one plus one. , 1980, Psychophysiology.

[45]  Atsushi Sato,et al.  Effects of value and reward magnitude on feedback negativity and P300 , 2005, Neuroreport.

[46]  Clay B. Holroyd,et al.  ERP correlates of feedback and reward processing in the presence and absence of response choice. , 2005, Cerebral cortex.

[47]  J. Polich Updating P 300 : An Integrative Theory of P 3 a and P 3 b , 2009 .

[48]  Jonathan D. Cohen,et al.  Decision making, the P3, and the locus coeruleus-norepinephrine system. , 2005, Psychological bulletin.

[49]  F. Hefti,et al.  TGFα stimulation of phosphatidylinositol hydrolysis in mesencephalic cultures requires neuron‐glia interactions , 1993, Neuroreport.

[50]  N. Squires,et al.  Two varieties of long-latency positive waves evoked by unpredictable auditory stimuli in man. , 1975, Electroencephalography and clinical neurophysiology.