Novel rewards occlude the reward positivity, and what to do about it

Both the Reward Positivity (RewP) and the novelty N2 component appear within the same spatio-temporal window. This signal overlap impedes the assessment of the RewP evoked by complex novel rewards like affective or motivational imagery. Here we conducted a series of experiments which successfully isolated signals of reward and novelty through spectral decomposition as well as with experimental manipulations that systematically removed the influence of novelty on the reward-evoking image. Together, these findings help explain the nature of this component overlap and provide methodological and analytic techniques for isolating reward- and novelty-specific computations to complex stimuli.

[1]  Clay B Holroyd,et al.  Reward positivity: Reward prediction error or salience prediction error? , 2016, Psychophysiology.

[2]  Karl Mann,et al.  Validating incentive salience with functional magnetic resonance imaging: association between mesolimbic cue reactivity and attentional bias in alcohol‐dependent patients , 2012, Addiction Biology.

[3]  I. Daum,et al.  Learning‐related changes in reward expectancy are reflected in the feedback‐related negativity , 2008, The European journal of neuroscience.

[4]  Michael X. Cohen,et al.  Frontal theta reflects uncertainty and unexpectedness during exploration and exploitation. , 2012, Cerebral cortex.

[5]  J. Lorberbaum,et al.  From the Departments Of , 2022 .

[6]  F. Esteves,et al.  Emotions Under the Skin Autonomic Reactivity to Emotional Pictures in Insecure Attachment , 2015 .

[7]  R. B. Reilly,et al.  FASTER: Fully Automated Statistical Thresholding for EEG artifact Rejection , 2010, Journal of Neuroscience Methods.

[8]  Simon J Graham,et al.  Functional neuroanatomical substrates of altered reward processing in major depressive disorder revealed by a dopaminergic probe. , 2005, Archives of general psychiatry.

[9]  Nico Bunzeck,et al.  Contextual interaction between novelty and reward processing within the mesolimbic system , 2011, Human brain mapping.

[10]  A. Barto,et al.  Novelty or Surprise? , 2013, Front. Psychol..

[11]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[12]  Peter Dayan,et al.  Dopamine: generalization and bonuses , 2002, Neural Networks.

[13]  Kyle S. Smith,et al.  The Ventral Pallidum and Hedonic Reward: Neurochemical Maps of Sucrose “Liking” and Food Intake , 2005, The Journal of Neuroscience.

[14]  K. Berridge Food reward: Brain substrates of wanting and liking , 1996, Neuroscience & Biobehavioral Reviews.

[15]  Dennis J L G Schutter,et al.  Anger is associated with reward-related electrocortical activity: Evidence from the reward positivity. , 2015, Psychophysiology.

[16]  W. Schultz Neuronal Reward and Decision Signals: From Theories to Data. , 2015, Physiological reviews.

[17]  N. Bunzeck,et al.  Absolute Coding of Stimulus Novelty in the Human Substantia Nigra/VTA , 2006, Neuron.

[18]  M. Milders,et al.  Abnormal Temporal Difference Reward-learning Signals in Major Depression Department of Radiology And , 2022 .

[19]  J. O'Doherty,et al.  Reward representations and reward-related learning in the human brain: insights from neuroimaging , 2004, Current Opinion in Neurobiology.

[20]  David Goodman,et al.  Performance Monitoring in the Anterior Cingulate is Not All Error Related: Expectancy Deviation and the Representation of Action-Outcome Associations , 2007, Journal of Cognitive Neuroscience.

[21]  Edward M Bernat,et al.  Time-frequency theta and delta measures index separable components of feedback processing in a gambling task. , 2015, Psychophysiology.

[22]  James F. Cavanagh,et al.  Cortical delta activity reflects reward prediction error and related behavioral adjustments, but at different times , 2015, NeuroImage.

[23]  Deborah Talmi,et al.  The Feedback-Related Negativity Signals Salience Prediction Errors, Not Reward Prediction Errors , 2013, The Journal of Neuroscience.

[24]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[25]  P. Lang International Affective Picture System (IAPS) : Technical Manual and Affective Ratings , 1995 .

[26]  Graham Finlayson,et al.  Is it possible to dissociate ‘liking’ and ‘wanting’ for foods in humans? A novel experimental procedure , 2007, Physiology & Behavior.

[27]  John J. B. Allen,et al.  Multiple Dissociations Between Comorbid Depression and Anxiety on Reward and Punishment Processing: Evidence From Computationally Informed EEG , 2019, Computational Psychiatry.

[28]  Greg Hajcak,et al.  Considering ERP difference scores as individual difference measures: Issues with subtraction and alternative approaches. , 2017, Psychophysiology.

[29]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[30]  P. Dayan,et al.  A common mechanism for adaptive scaling of reward and novelty , 2010, Human brain mapping.

[31]  K. Berridge,et al.  What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? , 1998, Brain Research Reviews.

[32]  Clay B. Holroyd,et al.  The feedback correct-related positivity: sensitivity of the event-related brain potential to unexpected positive feedback. , 2008, Psychophysiology.

[33]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[34]  John J. B. Allen,et al.  Prelude to and Resolution of an Error: EEG Phase Synchrony Reveals Cognitive Control Dynamics during Action Monitoring , 2009, The Journal of Neuroscience.

[35]  J. Cavanagh,et al.  Rewarding images do not invoke the reward positivity: They inflate it. , 2018, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[36]  W. Schultz Multiple reward signals in the brain , 2000, Nature Reviews Neuroscience.

[37]  Matthew W. Miller,et al.  The effects of reward magnitude on reward processing: An averaged and single trial event-related potential study , 2016, Biological Psychology.

[38]  Olave E Krigolson,et al.  Event-related brain potentials and the study of reward processing: Methodological considerations. , 2017, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[39]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[40]  Minfen Shen,et al.  Independent component analysis of electroencephalographic signals , 2002, 6th International Conference on Signal Processing, 2002..

[41]  P. Read Montague,et al.  When Things Are Better or Worse than Expected: The Medial Frontal Cortex and the Allocation of Processing Resources , 2006, Journal of Cognitive Neuroscience.

[42]  Karl J. Friston,et al.  The Trouble with Cognitive Subtraction , 1996, NeuroImage.

[43]  Clay B. Holroyd,et al.  Feedback information and the reward positivity. , 2017, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[44]  Heidi Johansen-Berg,et al.  Ventral Striatum/Nucleus Accumbens Activation to Smoking-Related Pictorial Cues in Smokers and Nonsmokers: A Functional Magnetic Resonance Imaging Study , 2005, Biological Psychiatry.

[45]  Clay B. Holroyd,et al.  Dissociated roles of the anterior cingulate cortex in reward and conflict processing as revealed by the feedback error-related negativity and N200 , 2011, Biological Psychology.

[46]  Peter J. Lang,et al.  Detecting Novelty and Significance , 2010, Journal of Cognitive Neuroscience.

[47]  Greg Hajcak,et al.  The Utility of Event-Related Potentials in Clinical Psychology. , 2019, Annual review of clinical psychology.

[48]  Greg H. Proudfit The reward positivity: from basic research on reward to a biomarker for depression. , 2015, Psychophysiology.

[49]  M. Frank,et al.  Frontal theta as a mechanism for cognitive control , 2014, Trends in Cognitive Sciences.

[50]  Clay B. Holroyd,et al.  Reward positivity elicited by predictive cues , 2011, Neuroreport.