How Does Reward Expectation Influence Cognition in the Human Brain?

The prospect of reward changes how we think and behave. We investigated how this occurs in the brain using a novel continuous performance task in which fluctuating reward expectations biased cognitive processes between competing spatial and verbal tasks. Critically, effects of reward expectancy could be distinguished from induced changes in task-related networks. Behavioral data confirm specific bias toward a reward-relevant modality. Increased reward expectation improves reaction time and accuracy in the relevant dimension while reducing sensitivity to modulations of stimuli characteristics in the irrelevant dimension. Analysis of functional magnetic resonance imaging data shows that the proximity to reward over successive trials is associated with increased activity of the medial frontal cortex regardless of the modality. However, there are modality-specific changes in brain activity in the lateral frontal, parietal, and temporal cortex. Analysis of effective connectivity suggests that reward expectancy enhances coupling in both early visual pathways and within the prefrontal cortex. These distributed changes in task-related cortical networks arise from subjects' representations of future events and likelihood of reward.

[1]  M. Corbetta,et al.  Neural Systems for Visual Orienting and Their Relationships to Spatial Working Memory , 2002, Journal of Cognitive Neuroscience.

[2]  R. Passingham,et al.  Prefrontal interactions reflect future task operations , 2003, Nature Neuroscience.

[3]  Jonathan D. Cohen,et al.  Cognition and control in schizophrenia: a computational model of dopamine and prefrontal function , 1999, Biological Psychiatry.

[4]  S. Bunge How we use rules to select actions: A review of evidence from cognitive neuroscience , 2004, Cognitive, affective & behavioral neuroscience.

[5]  S. J. Beck Review of The Blacky Pictures. , 1956 .

[6]  Andreas Nieder,et al.  A parieto-frontal network for visual numerical information in the monkey. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[7]  J. Tanji,et al.  Role for cingulate motor area cells in voluntary movement selection based on reward. , 1998, Science.

[8]  Jaap Oosterlaan,et al.  Pathological gambling: a comprehensive review of biobehavioral findings , 2004, Neuroscience & Biobehavioral Reviews.

[9]  Jonathan D. Cohen,et al.  Anterior Cingulate Conflict Monitoring and Adjustments in Control , 2004, Science.

[10]  R. Frackowiak,et al.  Demonstrating the implicit processing of visually presented words and pseudowords. , 1996, Cerebral cortex.

[11]  Karl J. Friston,et al.  Modelling functional integration: a comparison of structural equation and dynamic causal models , 2004, NeuroImage.

[12]  Lawrence R. Frank,et al.  Anterior cingulate activity modulates nonlinear decision weight function of uncertain prospects , 2006, NeuroImage.

[13]  K. C. Anderson,et al.  Single neurons in prefrontal cortex encode abstract rules , 2001, Nature.

[14]  Neuroscience Research , 2006, Neuroscience Research.

[15]  Katsuyuki Sakai,et al.  Prefrontal Set Activity Predicts Rule-Specific Neural Processing during Subsequent Cognitive Performance , 2006, The Journal of Neuroscience.

[16]  J V Haxby,et al.  Dissociation of saccade-related and pursuit-related activation in human frontal eye fields as revealed by fMRI. , 1997, Journal of neurophysiology.

[17]  M. Kerszberg,et al.  A Neuronal Model of a Global Workspace in Effortful Cognitive Tasks , 2001 .

[18]  M. Mesulam A cortical network for directed attention and unilateral neglect , 1981, Annals of neurology.

[19]  T. Robbins,et al.  Prefrontal executive and cognitive functions in rodents: neural and neurochemical substrates , 2004, Neuroscience & Biobehavioral Reviews.

[20]  R. Dolan,et al.  Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans , 2006, Nature.

[21]  D. Kumaran,et al.  Frames, Biases, and Rational Decision-Making in the Human Brain , 2006, Science.

[22]  H. Damasio,et al.  Dissociation Of Working Memory from Decision Making within the Human Prefrontal Cortex , 1998, The Journal of Neuroscience.

[23]  Karl J. Friston,et al.  Attention to action in Parkinson's disease: impaired effective connectivity among frontal cortical regions. , 2002, Brain : a journal of neurology.

[24]  Kent A. Kiehl,et al.  Orbitofrontal cortex dysfunction in abstinent cocaine abusers performing a decision-making task , 2003, NeuroImage.

[25]  Karl J. Friston,et al.  Comparing dynamic causal models , 2004, NeuroImage.

[26]  Keiji Tanaka,et al.  Neuronal Correlates of Goal-Based Motor Selection in the Prefrontal Cortex , 2003, Science.

[27]  Jeffrey D Schall,et al.  The neural selection and control of saccades by the frontal eye field. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[28]  T. Robbins,et al.  Contrasting Cortical and Subcortical Activations Produced by Attentional-Set Shifting and Reversal Learning in Humans , 2000, Journal of Cognitive Neuroscience.

[29]  Todd B. Parrish,et al.  Altered Effective Connectivity within the Language Network in Primary Progressive Aphasia , 2007, The Journal of Neuroscience.

[30]  M. Shadlen,et al.  Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque , 1999, Nature Neuroscience.

[31]  E. Rolls,et al.  Abstract reward and punishment representations in the human orbitofrontal cortex , 2001, Nature Neuroscience.

[32]  J. Cohen,et al.  Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. , 2000, Science.

[33]  E. Claus,et al.  Prefrontal cortex activity is reduced in gambling and nongambling substance users during decision‐making , 2007, Human brain mapping.

[34]  D. Wilkin,et al.  Neuron , 2001, Brain Research.

[35]  J. Gläscher,et al.  Pathological gambling is linked to reduced activation of the mesolimbic reward system , 2005, Nature Neuroscience.

[36]  B. Richmond,et al.  Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy , 2002, Science.

[37]  H E ROSVOLD,et al.  A continuous performance test of brain damage. , 1956, Journal of consulting psychology.

[38]  G. Orban,et al.  Comparative mapping of higher visual areas in monkeys and humans , 2004, Trends in Cognitive Sciences.

[39]  E. Miller,et al.  Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task , 2003, The European journal of neuroscience.

[40]  E. Crone,et al.  Neural evidence for dissociable components of task-switching. , 2006, Cerebral cortex.

[41]  T. Robbins,et al.  A componential analysis of task-switching deficits associated with lesions of left and right frontal cortex. , 2004, Brain : a journal of neurology.

[42]  J. Duncan,et al.  Common regions of the human frontal lobe recruited by diverse cognitive demands , 2000, Trends in Neurosciences.

[43]  Karl J. Friston,et al.  Large-scale neural models and dynamic causal modelling , 2006, NeuroImage.

[44]  S. Dehaene,et al.  Dynamics of prefrontal and cingulate activity during a reward-based logical deduction task. , 2006, Cerebral cortex.

[45]  Karl J. Friston,et al.  Psychophysiological and Modulatory Interactions in Neuroimaging , 1997, NeuroImage.

[46]  K. Johnston,et al.  Top-Down Control-Signal Dynamics in Anterior Cingulate and Prefrontal Cortex Neurons following Task Switching , 2007, Neuron.

[47]  Daniel C. Krawczyk,et al.  Reward modulation of prefrontal and visual association cortex during an incentive working memory task , 2007, Brain Research.

[48]  J. Changeux,et al.  Reward-dependent learning in neuronal networks for planning and decision making. , 2000, Progress in brain research.

[49]  E. Rolls,et al.  Reward-related Reversal Learning after Surgical Excisions in Orbito-frontal or Dorsolateral Prefrontal Cortex in Humans , 2004, Journal of Cognitive Neuroscience.

[50]  P. Dayan,et al.  Cortical substrates for exploratory decisions in humans , 2006, Nature.

[51]  J. Winn,et al.  Brain , 1878, The Lancet.

[52]  A. Owen,et al.  Fractionating attentional control using event-related fMRI. , 2005, Cerebral cortex.

[53]  Michael X. Cohen,et al.  Functional connectivity with anterior cingulate and orbitofrontal cortices during decision-making. , 2005, Brain research. Cognitive brain research.

[54]  C. Rorden,et al.  Cognitive Control Mechanisms Revealed by ERP and fMRI: Evidence from Repeated Task-Switching , 2003, Journal of Cognitive Neuroscience.

[55]  T. Robbins,et al.  Dissociable Forms of Inhibitory Control within Prefrontal Cortex with an Analog of the Wisconsin Card Sort Test: Restriction to Novel Situations and Independence from “On-Line” Processing , 1997, The Journal of Neuroscience.

[56]  T. Robbins,et al.  Decision-making processes following damage to the prefrontal cortex. , 2002, Brain : a journal of neurology.

[57]  Karl J. Friston,et al.  Lateralized Cognitive Processes and Lateralized Task Control in the Human Brain , 2003, Science.

[58]  Karl J. Friston,et al.  Dynamic causal modelling , 2003, NeuroImage.

[59]  Karl J. Friston,et al.  Dissociable Neural Responses in Human Reward Systems , 2000, The Journal of Neuroscience.

[60]  M. Shadlen,et al.  Effect of Expected Reward Magnitude on the Response of Neurons in the Dorsolateral Prefrontal Cortex of the Macaque , 1999, Neuron.

[61]  Munetaka Shidara,et al.  Differential encoding of information about progress through multi-trial reward schedules by three groups of ventral striatal neurons , 2004, Neuroscience Research.

[62]  Clayton E. Curtis,et al.  Coherence between fMRI time-series distinguishes two spatial working memory networks , 2005, NeuroImage.

[63]  J. O'Doherty,et al.  Dissociating Valence of Outcome from Behavioral Control in Human Orbital and Ventral Prefrontal Cortices , 2003, The Journal of Neuroscience.

[64]  Simon B. Eickhoff,et al.  Analysis of neural mechanisms underlying verbal fluency in cytoarchitectonically defined stereotaxic space—The roles of Brodmann areas 44 and 45 , 2004, NeuroImage.

[65]  S. Tsujimoto,et al.  Neuronal representation of response-outcome in the primate prefrontal cortex. , 2004, Cerebral cortex.

[66]  Norio Fujimaki,et al.  Functional magnetic resonance imaging of neural activity related to orthographic, phonological, and lexico‐semantic judgments of visually presented characters and words , 1999, Human brain mapping.

[67]  Ronald A. Walker Decision-Making Processes , 2004 .

[68]  Jonathan D. Cohen,et al.  Conflict monitoring versus selection-for-action in anterior cingulate cortex , 1999, Nature.

[69]  Tomoyoshi Komiyama,et al.  Analysis of neural mechanisms in postural adjustments during voluntary arm movements , 1992 .

[70]  R. Dolan,et al.  How the Brain Translates Money into Force: A Neuroimaging Study of Subliminal Motivation , 2007, Science.