Binary sensitivity of theta activity for gain and loss when monitoring parametric prediction errors.

Several theories have been proposed to account for the medial frontal activity that is elicited during the evaluation of outcomes. Respectively, these theories claim that the medial frontal response reflects (i) the absolute deviation between the value of an outcome and its expected value (i.e. an absolute prediction error); (ii) the deviation between actual and expected outcomes, with a specific sensitivity to outcomes that are worse than expected (i.e. a negative prediction error); (iii) a binary evaluation in terms of good and bad outcomes. In the current electroencephalography study, participants were presented with cues that induced specific predictions for the values of trial outcomes (a gain or loss of points). The actual outcomes occasionally deviated from the predicted values, producing prediction errors with parametrically varying size. Analysis of the medial frontal theta activity in response to the outcomes demonstrated a specific sensitivity to the occurrence of a loss of points when a gain had been predicted. However, the absolute deviation with respect to the predicted value did not modulate the theta response. This finding is consistent with the idea that outcome monitoring activity measured over medial frontal cortex is sensitive to the binary distinction between good and bad outcomes.

[1]  Thomas D. Sambrook,et al.  A neural reward prediction error revealed by a meta-analysis of ERPs using great grand averages. , 2015, Psychological bulletin.

[2]  Jeff T. Larsen,et al.  Context dependence of the event-related brain potential associated with reward and punishment. , 2004, Psychophysiology.

[3]  C. Brunia,et al.  Waiting to perceive: Reward or punishment? , 2011, Clinical Neurophysiology.

[4]  Dirk J. Heslenfeld,et al.  Activity in human reward-sensitive brain areas is strongly context dependent , 2005, NeuroImage.

[5]  D. Geary,et al.  Psychonomic Bulletin Review , 2000 .

[6]  R. Simons,et al.  The Neural Consequences of Flip-flopping: the Feedback- Related Negativity and Salience of Reward Prediction the Authors Thank Jenna Dietz and Natalie Shroyer for Their Help with Data Collection. We Also Thank , 2022 .

[7]  Timothy E. J. Behrens,et al.  Choice, uncertainty and value in prefrontal and cingulate cortex , 2008, Nature Neuroscience.

[8]  Jeff T. Larsen,et al.  The good, the bad and the neutral: Electrophysiological responses to feedback stimuli , 2006, Brain Research.

[9]  John R. Anderson,et al.  Learning from experience: Event-related potential correlates of reward processing, neural adaptation, and behavioral choice , 2012, Neuroscience & Biobehavioral Reviews.

[10]  Joshua W. Brown,et al.  Medial prefrontal cortex as an action-outcome predictor , 2011, Nature Neuroscience.

[11]  Peter Dixon,et al.  Likelihood ratios: A simple and flexible statistic for empirical psychologists , 2004, Psychonomic bulletin & review.

[12]  David Goodman,et al.  Performance Monitoring in the Anterior Cingulate is Not All Error Related: Expectancy Deviation and the Representation of Action-Outcome Associations , 2007, Journal of Cognitive Neuroscience.

[13]  H. Murohashi,et al.  Discrepancy between feedback negativity and subjective evaluation in gambling , 2005, Neuroreport.

[14]  Michael X. Cohen,et al.  Frontal Oscillatory Dynamics Predict Feedback Learning and Action Adjustment , 2011, Journal of Cognitive Neuroscience.

[15]  Clay B. Holroyd,et al.  Knowing good from bad: differential activation of human cortical areas by positive and negative outcomes , 2005, The European journal of neuroscience.

[16]  Jun'ichi Katayama,et al.  Self-relevant criteria determine the evaluation of outcomes induced by others , 2008, Neuroreport.

[17]  Jonathan R. Folstein,et al.  Influence of cognitive control and mismatch on the N2 component of the ERP: a review. , 2007, Psychophysiology.

[18]  Ryan K. Jessup,et al.  Error Effects in Anterior Cingulate Cortex Reverse when Error Likelihood Is High , 2010, The Journal of Neuroscience.

[19]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[20]  A. Rodríguez-Fornells,et al.  Brain potentials related to self-generated and external information used for performance monitoring , 2005, Clinical Neurophysiology.

[21]  David R. Anderson,et al.  AIC model selection and multimodel inference in behavioral ecology: some background, observations, and comparisons , 2011, Behavioral Ecology and Sociobiology.

[22]  Michael X. Cohen,et al.  Behavioral / Systems / Cognitive Reinforcement Learning Signals Predict Future Decisions , 2007 .

[23]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources , 1999, Neural Computation.

[24]  Markus Kiefer,et al.  Human anterior cingulate cortex is activated by negative feedback: evidence from event-related potentials in a guessing task , 2002, Neuroscience Letters.

[25]  A. Sanfey,et al.  Independent Coding of Reward Magnitude and Valence in the Human Brain , 2004, The Journal of Neuroscience.

[26]  R. Cools,et al.  Feedback-related negativity codes outcome valence, but not outcome expectancy, during reversal learning , 2013, Cognitive, affective & behavioral neuroscience.

[27]  D. Tucker,et al.  Electrophysiological Responses to Errors and Feedback in the Process of Action Regulation , 2003, Psychological science.

[28]  Clay B. Holroyd,et al.  The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. , 2002, Psychological review.

[29]  Uta Sailer,et al.  Context-sensitivity of the feedback-related negativity for zero-value feedback outcomes , 2015, Biological Psychology.

[30]  Greg H. Proudfit,et al.  Anterior cingulate activity to monetary loss and basal ganglia activity to monetary gain uniquely contribute to the feedback negativity , 2015, Clinical Neurophysiology.

[31]  G. Potts,et al.  Medial frontal event-related potentials and reward prediction: Do responses matter? , 2011, Brain and Cognition.

[32]  J. Gläscher,et al.  Dissociable Systems for Gain- and Loss-Related Value Predictions and Errors of Prediction in the Human Brain , 2006, The Journal of Neuroscience.

[33]  James F. Cavanagh,et al.  Frontal theta links prediction errors to behavioral adaptation in reinforcement learning , 2010, NeuroImage.

[34]  P. Bolam.  European Journal of Neuroscience , 2017 .

[35]  M. Schoenfeld,et al.  Temporal dynamics of reward processing revealed by magnetoencephalography , 2011, Human brain mapping.

[36]  Michael X. Cohen,et al.  Cortical electrophysiological network dynamics of feedback learning , 2011, Trends in Cognitive Sciences.

[37]  Clay B. Holroyd,et al.  The feedback-related negativity reflects the binary evaluation of good versus bad outcomes , 2006, Biological Psychology.

[38]  Michael X. Cohen,et al.  Reward expectation modulates feedback-related negativity and EEG spectra , 2007, NeuroImage.

[39]  David Cucurell,et al.  Human oscillatory activity associated to reward processing in a gambling task , 2008, Neuropsychologia.

[40]  Adrian R. Willoughby,et al.  The Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses , 2002, Science.

[41]  Sabrina M. Tom,et al.  The Neural Basis of Loss Aversion in Decision-Making Under Risk , 2007, Science.

[42]  R. K. Simpson.  Nature Neuroscience , 2022 .

[43]  Caroline Di Bernardi Luft,et al.  Learning from feedback: The neural mechanisms of feedback processing facilitating better performance , 2014, Behavioural Brain Research.

[44]  R. Hommer,et al.  Reward feedback processing in children and adolescents: Medial frontal theta oscillations , 2014, Brain and Cognition.

[45]  Atsushi Sato,et al.  Effects of value and reward magnitude on feedback negativity and P300 , 2005, Neuroreport.