Magneto- and electroencephalographic manifestations of reward anticipation and delivery

The monetary incentive delay task was used to characterize reward anticipation and delivery with concurrently acquired evoked magnetic fields, EEG potentials and EEG/MEG oscillatory responses, obtaining a precise portrayal of their spatiotemporal evolution. In the anticipation phase, differential activity was most prominent over midline electrodes and parieto-occipital sensors. Differences between non-reward- and reward-predicting cues were localized in the cuneus and later in the dorsal PCC, suggesting a modulation by potential reward information during early visual processing, followed by a coarse emotional evaluation of the cues. Oscillatory analysis revealed increased theta power after non-reward cues over fronto-central sites. In the beta range, power decreased with the magnitude of the potential reward and increased with reaction time, probably reflecting the influence of the striatal response to potential reward on the sensorimotor cortex. At reward delivery, negative prediction errors led to a larger mediofrontal negativity. The spatiotemporal evolution of reward processing was modulated by prediction error: whereas differences were located in PCC and putamen in the prediction error comparison, in the case of expected outcomes they were located in PCC, ACC and parahippocampal gyrus. In the oscillatory realm, theta power was largest following rewards and, in the case of non-rewards, was largest when these were unexpected. Higher beta activity following rewards was also observed in both modalities, but MEG additionally showed a significant power decrease for this condition over parieto-occipital sensors. Our results show how visual, limbic and striatal structures are involved in the different stages of reward anticipation and delivery, and how theta and beta oscillations have a prominent role in the processing of these stimuli.

[1]  M. Roitman,et al.  Nucleus Accumbens Neurons Are Innately Tuned for Rewarding and Aversive Taste Stimuli, Encode Their Predictors, and Are Linked to Motor Output , 2005, Neuron.

[2]  Brian Knutson,et al.  Dissociation of reward anticipation and outcome with event-related fMRI , 2001, Neuroreport.

[3]  W. Singer,et al.  Hemodynamic Signals Correlate Tightly with Synchronized Gamma Oscillations , 2005, Science.

[4]  K. Miyazaki,et al.  Nucleus accumbens , 2018, Radiopaedia.org.

[5]  G. Rizzolatti The mirror neuron system and its function in humans , 2005, Anatomy and Embryology.

[6]  D. Poeppel,et al.  Magnetoencephalography and magnetic source imaging. , 1998, Neuropsychiatry, neuropsychology, and behavioral neurology.

[7]  J. C. Crowley,et al.  Saccade Reward Signals in Posterior Cingulate Cortex , 2003, Neuron.

[8]  Christopher S. Monk,et al.  Choice selection and reward anticipation: an fMRI study , 2004, Neuropsychologia.

[9]  Robert Oostenveld,et al.  Trial-by-trial coupling between EEG and BOLD identifies networks related to alpha and theta EEG power increases during working memory maintenance , 2009, NeuroImage.

[10]  David Cucurell,et al.  Human oscillatory activity associated to reward processing in a gambling task , 2008, Neuropsychologia.

[11]  Michael Falkenstein,et al.  Errors, Conflicts, and the Brain , 2004 .

[12]  P. Rossini,et al.  Multimodal integration of EEG and MEG data: A simulation study with variable signal‐to‐noise ratio and number of sensors , 2004, Human brain mapping.

[13]  R. James R. Blair,et al.  Response options and expectations of reward in decision-making: The differential roles of dorsal and rostral anterior cingulate cortex , 2007, NeuroImage.

[14]  W. Schultz,et al.  Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[15]  J. Hollerman,et al.  Reward prediction in primate basal ganglia and frontal cortex , 1998, Neuropharmacology.

[16]  S. Hillyard,et al.  Delayed Striate Cortical Activation during Spatial Attention , 2002, Neuron.

[17]  W. Gehring,et al.  Are all medial frontal negativities created equal ? Toward a richer empirical basis for theories of action monitoring , 2003 .

[18]  Emanuel Donchin,et al.  Neural response to action and reward prediction errors: Comparing the error-related negativity to behavioral errors and the feedback-related negativity to reward prediction violations. , 2011, Psychophysiology.

[19]  S. Bressler,et al.  Response preparation and inhibition: The role of the cortical sensorimotor beta rhythm , 2008, Neuroscience.

[20]  O. Bertrand,et al.  Oscillatory gamma-band (30-70 Hz) activity induced by a visual search task in humans. , 1997, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[21]  Hisao Nishijo,et al.  Single neuron responses in the monkey anterior cingulate cortex during visual discrimination , 1997, Neuroscience Letters.

[22]  R. Maddock The retrosplenial cortex and emotion: new insights from functional neuroimaging of the human brain , 1999, Trends in Neurosciences.

[23]  Clay B. Holroyd,et al.  Reinforcement-related brain potentials from medial frontal cortex: origins and functional significance , 2004, Neuroscience & Biobehavioral Reviews.

[24]  Alan C. Evans,et al.  Emotional responses to pleasant and unpleasant music correlate with activity in paralimbic brain regions , 1999, Nature Neuroscience.

[25]  Roger B. H. Tootell,et al.  The advantage of combining MEG and EEG: Comparison to fMRI in focally stimulated visual cortex , 2007, NeuroImage.

[26]  Clay B. Holroyd,et al.  The feedback-related negativity reflects the binary evaluation of good versus bad outcomes , 2006, Biological Psychology.

[27]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[28]  J. Pernier,et al.  Oscillatory γ-Band (30–70 Hz) Activity Induced by a Visual Search Task in Humans , 1997, The Journal of Neuroscience.

[29]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[30]  Michael X. Cohen,et al.  Reward expectation modulates feedback-related negativity and EEG spectra , 2007, NeuroImage.

[31]  M. Bradley,et al.  Neuroanatomical correlates of pleasant and unpleasant emotion , 1997, Neuropsychologia.

[32]  Wolfram Schultz,et al.  Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. , 2003, Journal of neurophysiology.

[33]  O. Jensen,et al.  Beyond ERPs: Oscillatory neuronal dynamics , 2012 .

[34]  M Wagner,et al.  Improving source reconstructions by combining bioelectric and biomagnetic data. , 1998, Electroencephalography and clinical neurophysiology.

[35]  Michael X. Cohen,et al.  Frontal Oscillatory Dynamics Predict Feedback Learning and Action Adjustment , 2011, Journal of Cognitive Neuroscience.

[36]  Lutz Trahms,et al.  Recent advances in modeling and analysis of bioelectric and biomagnetic sources , 2010, Biomedizinische Technik. Biomedical engineering.

[37]  M. Buonocore,et al.  Posterior cingulate cortex activation by emotional words: fMRI evidence from a valence decision task , 2003, Human brain mapping.

[38]  B. Gold,et al.  Functional Dissociation in Frontal and Striatal Areas for Processing of Positive and Negative Reward Information , 2007, The Journal of Neuroscience.

[39]  David Papo,et al.  Modulation of late alpha band oscillations by feedback in a hypothesis testing paradigm. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[40]  E. Procyk,et al.  Behavioral Shifts and Action Valuation in the Anterior Cingulate Cortex , 2008, Neuron.

[41]  Ankoor S. Shah,et al.  Neural dynamics and the fundamental mechanisms of event-related brain potentials. , 2004, Cerebral cortex.

[42]  Henning Scheich,et al.  Representation of Reward Feedback in Primate Auditory Cortex , 2011, Front. Syst. Neurosci..

[43]  R. E. Passingham,et al.  Prediction error for free monetary reward in the human prefrontal cortex , 2004, NeuroImage.

[44]  James F. Cavanagh,et al.  Frontal theta links prediction errors to behavioral adaptation in reinforcement learning , 2010, NeuroImage.

[45]  L. Nystrom,et al.  Tracking the hemodynamic responses to reward and punishment in the striatum. , 2000, Journal of neurophysiology.

[46]  Adrian R. Willoughby,et al.  The Medial Frontal Cortex and the Rapid Processing of Monetary Gains and Losses , 2002, Science.

[47]  Clay B. Holroyd,et al.  Brain potentials associated with expected and unexpected good and bad outcomes. , 2005, Psychophysiology.

[48]  John T Serences,et al.  Value-Based Modulations in Human Visual Cortex , 2008, Neuron.

[49]  Angela R. Laird,et al.  ALE meta-analysis of action observation and imitation in the human brain , 2010, NeuroImage.

[50]  T. Sejnowski,et al.  Dynamic Brain Sources of Visual Evoked Responses , 2002, Science.

[51]  C. Braun,et al.  Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a Generic Neural System for Error Detection , 1997, Journal of Cognitive Neuroscience.

[52]  J. Martinerie,et al.  The brainweb: Phase synchronization and large-scale integration , 2001, Nature Reviews Neuroscience.

[53]  Jeff T. Larsen,et al.  The good, the bad and the neutral: Electrophysiological responses to feedback stimuli , 2006, Brain Research.

[54]  A. Holmes,et al.  Dissociation of neural regions associated with anticipatory versus consummatory phases of incentive processing. , 2007, Psychophysiology.

[55]  R. Baker,et al.  When is an error not a prediction error? An electrophysiological investigation , 2009, Cognitive, affective & behavioral neuroscience.

[56]  Matthew S. Tata,et al.  Right frontal cortex generates reward-related theta-band oscillatory activity , 2009, NeuroImage.

[57]  Rongjun Yu,et al.  Brain potentials associated with outcome expectation and outcome evaluation , 2006, Neuroreport.

[58]  W. Schultz,et al.  Dopamine responses comply with basic assumptions of formal learning theory , 2001, Nature.

[59]  Anna Weinberg,et al.  Event‐related potential activity in the basal ganglia differentiates rewards from nonrewards: Temporospatial principal components analysis and source localization of the feedback negativity , 2011, Human brain mapping.

[60]  Michael S. Gazzaniga,et al.  Methods in mind , 2006 .

[61]  Brian Knutson,et al.  Valence and salience contribute to nucleus accumbens activation , 2008, NeuroImage.

[62]  Y. Okada,et al.  Contributions of principal neocortical neurons to magnetoencephalography and electroencephalography signals , 2006, The Journal of physiology.

[63]  Aziz M. Ulug,et al.  Differential cingulate and caudate activation following unexpected nonrewarding stimuli , 2004, NeuroImage.

[64]  K. Zilles,et al.  The Neural Basis of Vertical and Horizontal Line Bisection Judgments: An fMRI Study of Normal Volunteers , 2001, NeuroImage.

[65]  P. König,et al.  A comparison of hemodynamic and neural responses in cat visual cortex using complex stimuli. , 2004, Cerebral cortex.

[66]  W. Schultz,et al.  Neuronal activity in monkey ventral striatum related to the expectation of reward , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[67]  Masataka Watanabe,et al.  Prefrontal and cingulate unit activity during timing behavior in the monkey , 1979, Brain Research.

[68]  S. Krach,et al.  Anticipation of monetary and social reward differently activates mesolimbic brain structures in men and women. , 2009, Social cognitive and affective neuroscience.

[69]  Brian Knutson,et al.  A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI , 2003, NeuroImage.

[70]  M. Bear,et al.  Reward Timing in the Primary Visual Cortex , 2006, Science.

[71]  Clay B. Holroyd,et al.  Reward prediction error signals associated with a modified time estimation task. , 2007, Psychophysiology.

[72]  M. Hallett,et al.  Asymmetric spatiotemporal patterns of event-related desynchronization preceding voluntary sequential finger movements: a high-resolution EEG study , 2005, Clinical Neurophysiology.

[73]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[74]  L. Pessoa,et al.  Combined Effects of Attention and Motivation on Visual Task Performance: Transient and Sustained Motivational Effects , 2008, Front. Hum. Neurosci..

[75]  Clay B. Holroyd,et al.  Reward positivity elicited by predictive cues , 2011, Neuroreport.

[76]  J. Gläscher,et al.  Dissociable Systems for Gain- and Loss-Related Value Predictions and Errors of Prediction in the Human Brain , 2006, The Journal of Neuroscience.

[77]  M. Corbetta,et al.  The Reorienting System of the Human Brain: From Environment to Theory of Mind , 2008, Neuron.

[78]  D. Tucker,et al.  Electrophysiological Responses to Errors and Feedback in the Process of Action Regulation , 2003, Psychological science.

[79]  J. Russell,et al.  Neural systems subserving valence and arousal during the experience of induced emotions. , 2010, Emotion.

[80]  T. Münte,et al.  Pramipexole modulates the neural network of reward anticipation , 2011, Human brain mapping.

[81]  G. Glover,et al.  Error‐related brain activation during a Go/NoGo response inhibition task , 2001, Human brain mapping.

[82]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[83]  N. Sadato,et al.  Processing of Social and Monetary Rewards in the Human Striatum , 2008, Neuron.

[84]  Brian Knutson,et al.  Anticipation of Increasing Monetary Reward Selectively Recruits Nucleus Accumbens , 2001, The Journal of Neuroscience.

[85]  R. L. Nó,et al.  Action potential of the motoneurons of the hypoglossus nucleus. , 1947 .

[86]  C. Olson,et al.  Functional heterogeneity in cingulate cortex: the anterior executive and posterior evaluative regions. , 1992, Cerebral cortex.

[87]  M. Vinck,et al.  Theta-Band Phase Locking of Orbitofrontal Neurons during Reward Expectancy , 2010, The Journal of Neuroscience.

[88]  A. Rodríguez-Fornells,et al.  Brain potentials related to self-generated and external information used for performance monitoring , 2005, Clinical Neurophysiology.

[89]  Raymond J. Dolan,et al.  Contingency awareness in human aversive conditioning involves the middle frontal gyrus , 2006, NeuroImage.

[90]  G. Pfurtscheller,et al.  Event-related dynamics of cortical rhythms: frequency-specific features and functional correlates. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[91]  Brian Knutson,et al.  FMRI Visualization of Brain Activity during a Monetary Incentive Delay Task , 2000, NeuroImage.

[92]  Matthew T. Kaufman,et al.  Distributed Neural Representation of Expected Value , 2005, The Journal of Neuroscience.

[93]  M. Botvinick,et al.  Anterior cingulate cortex, error detection, and the online monitoring of performance. , 1998, Science.

[94]  Henrik Walter,et al.  Prediction error as a linear function of reward probability is coded in human nucleus accumbens , 2006, NeuroImage.

[95]  Christian Keysers,et al.  Expanding the mirror: vicarious activity for actions, emotions, and sensations , 2009, Current Opinion in Neurobiology.

[96]  Risto Näätänen,et al.  Magnetoencephalography in studies of human cognitive brain function , 1994, Trends in Neurosciences.

[97]  S. Quartz,et al.  Neural Differentiation of Expected Reward and Risk in Human Subcortical Structures , 2006, Neuron.

[98]  Clay B. Holroyd,et al.  Dorsal anterior cingulate cortex shows fMRI response to internal and external error signals , 2004, Nature Neuroscience.

[99]  J. Driver,et al.  Rewarding Feedback After Correct Visual Discriminations Has Both General and Specific Influences on Visual Cortex , 2010, Journal of neurophysiology.

[100]  M. Iacoboni Neural mechanisms of imitation , 2005, Current Opinion in Neurobiology.

[101]  W. Singer Synchronization of cortical activity and its putative role in information processing and learning. , 1993, Annual review of physiology.

[102]  Peter A Bandettini,et al.  Seven topics in functional magnetic resonance imaging. , 2009, Journal of integrative neuroscience.

[103]  M. Schoenfeld,et al.  Temporal dynamics of reward processing revealed by magnetoencephalography , 2011, Human brain mapping.

[104]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[105]  P. Tobler,et al.  Segregated and integrated coding of reward and punishment in the cingulate cortex. , 2009, Journal of neurophysiology.

[106]  G. Pfurtscheller,et al.  Visualization of sensorimotor areas involved in preparation for hand movement based on classification of μ and central β rhythms in single EEG trials in man , 1994, Neuroscience Letters.

[107]  Jian Li,et al.  Parallel contributions of distinct human memory systems during probabilistic learning , 2011, NeuroImage.

[108]  Yul-Wan Sung,et al.  Functional magnetic resonance imaging , 2004, Scholarpedia.

[109]  T. Münte,et al.  Learning by doing: an fMRI study of feedback-related brain activations , 2007, Neuroreport.

[110]  G. Glover,et al.  The Role of Ventral Frontostriatal Circuitry in Reward-Based Learning in Humans , 2005, The Journal of Neuroscience.

[111]  William H. Alexander,et al.  Competition between learned reward and error outcome predictions in anterior cingulate cortex , 2010, NeuroImage.

[112]  Matthew J. Brookes,et al.  Methods in mind , 2013 .

[113]  D. Lehmann,et al.  Low resolution electromagnetic tomography: a new method for localizing electrical activity in the brain. , 1994, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[114]  A. Nobre,et al.  Magnetoencephalography , 1990, The Lancet.

[115]  R. Dolan,et al.  Contextual Novelty Modulates the Neural Dynamics of Reward Anticipation , 2011, The Journal of Neuroscience.

[116]  P. Derambure,et al.  Basic mechanisms of central rhythms reactivity to preparation and execution of a voluntary movement: a stereoelectroencephalographic study , 2003, Clinical Neurophysiology.

[117]  J. O'Doherty,et al.  Neural Responses during Anticipation of a Primary Taste Reward , 2002, Neuron.

[118]  Soeren Krach,et al.  Dissociation of neural networks for anticipation and consumption of monetary and social rewards , 2010, NeuroImage.

[119]  Clay B. Holroyd,et al.  Knowing good from bad: differential activation of human cortical areas by positive and negative outcomes , 2005, The European journal of neuroscience.

[120]  J. Yelnik,et al.  Modelling and detecting deep brain activity with MEG and EEG , 2009 .