Encoding of reward and space during a working memory task in the orbitofrontal cortex and anterior cingulate sulcus.

Several lines of research indicate that emotional and motivational information may be useful in guiding the allocation of attentional resources. Two areas of the frontal lobe that are particularly implicated in the encoding of motivational information are the orbital prefrontal cortex (PFo) and the dorsomedial region of prefrontal cortex, specifically the anterior cingulate sulcus (PFcs). However, it remains unclear whether these areas use this information to influence spatial attention. We used single-unit neurophysiology to examine whether, at the level of individual neurons, there was evidence for integration between reward information and spatial attention. We trained two subjects to perform a task that required them to attend to a spatial location across a delay under different expectancies of reward for correct performance. We balanced the order of presentation of spatial and reward information so we could assess the neuronal encoding of the two pieces of information independently and conjointly. We found little evidence for encoding of the spatial location in either PFo or PFcs. In contrast, both areas encoded the expected reward. Furthermore, PFo consistently encoded reward more quickly than PFcs, although reward encoding was subsequently more prevalent and stronger in PFcs. These results suggest a differential contribution of PFo and PFcs to reward encoding, with PFo potentially more important for initially determining the value of rewards predicted by sensory stimuli. They also suggest that neither PFo nor PFcs play a direct role in the control of spatial attention.

[1]  K. Pribram,et al.  Effects of lesions of the medial forebrain on alternation behavior of rhesus monkeys. , 1962, Experimental neurology.

[2]  Masataka Watanabe,et al.  Cingulate unit activity and delayed response , 1976, Brain Research.

[3]  Mortimer Mishkin,et al.  Visual recognition impairment follows ventromedial but not dorsolateral prefrontal lesions in monkeys , 1986, Behavioural Brain Research.

[4]  C. MacLeod,et al.  Attentional bias in emotional disorders. , 1986, Journal of abnormal psychology.

[5]  D L Rosene,et al.  Cingulate cortex of the rhesus monkey: I. Cytoarchitecture and thalamic afferents , 1987, The Journal of comparative neurology.

[6]  A. Mathews Anxiety and the Processing of Threatening Information , 1988 .

[7]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[8]  M. Eysenck,et al.  Attentional bias to threat in clinical anxiety states , 1992 .

[9]  P. Goldman-Rakic,et al.  Dorsolateral prefrontal lesions and oculomotor delayed-response performance: evidence for mnemonic "scotomas" , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  P. Goldman-Rakic,et al.  Characterization of the dopaminergic innervation of the primate frontal cortex using a dopamine-specific antibody. , 1993, Cerebral cortex.

[11]  B. Vogt,et al.  Connections of the Monkey Cingulate Cortex , 1993 .

[12]  P. Goldman-Rakic,et al.  Prefrontal connections of medial motor areas in the rhesus monkey , 1993, The Journal of comparative neurology.

[13]  M. Gabriel,et al.  Neurobiology of Cingulate Cortex and Limbic Thalamus: A Comprehensive Handbook , 1993 .

[14]  P. Strick,et al.  Cingulate Motor Areas , 1993 .

[15]  D. Meyer,et al.  A Neural System for Error Detection and Compensation , 1993 .

[16]  M. Petrides Comparative architectonic analysis of the human and the macaque frontal cortex , 1994 .

[17]  A. Damasio,et al.  Insensitivity to future consequences following damage to human prefrontal cortex , 1994, Cognition.

[18]  J. Price,et al.  Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys , 1995, The Journal of comparative neurology.

[19]  J. Price,et al.  Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys , 1995, The Journal of comparative neurology.

[20]  E. Rolls,et al.  Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. , 1996, Journal of neurophysiology.

[21]  K. Mogg,et al.  ATTENTIONAL BIASES FOR EMOTIONAL FACES , 1997 .

[22]  C. Braun,et al.  Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a Generic Neural System for Error Detection , 1997, Journal of Cognitive Neuroscience.

[23]  S C Rao,et al.  Integration of what and where in the primate prefrontal cortex. , 1997, Science.

[24]  M. Mishkin,et al.  Effects of orbital frontal and anterior cingulate lesions on object and spatial memory in rhesus monkeys , 1997, Neuropsychologia.

[25]  M. Botvinick,et al.  Anterior cingulate cortex, error detection, and the online monitoring of performance. , 1998, Science.

[26]  Leslie G. Ungerleider,et al.  Sustained Activity in the Medial Wall during Working Memory Delays , 1998, The Journal of Neuroscience.

[27]  J. Price,et al.  Prefrontal cortical projections to the hypothalamus in Macaque monkeys , 1998, The Journal of comparative neurology.

[28]  R. Morecraft,et al.  Convergence of Limbic Input to the Cingulate Motor Cortex in the Rhesus Monkey , 1998, Brain Research Bulletin.

[29]  T. Paus,et al.  Regional differences in the effects of task difficulty and motor output on blood flow response in the human anterior cingulate cortex: a review of 107 PET activation studies , 1998, Neuroreport.

[30]  H Hyare,et al.  Selective attention to food-related stimuli in hunger: are attentional biases specific to emotional and psychopathological states, or are they also found in normal drive states? , 1998, Behaviour research and therapy.

[31]  Earl K. Miller,et al.  Selective representation of relevant information by neurons in the primate prefrontal cortex , 1998, Nature.

[32]  D. Gitelman,et al.  Neuroanatomic Overlap of Working Memory and Spatial Attention Networks: A Functional MRI Comparison within Subjects , 1999, NeuroImage.

[33]  M. Mesulam,et al.  Spatial attention and neglect: parietal, frontal and cingulate contributions to the mental representation and attentional targeting of salient extrapersonal events. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[34]  W. Schultz,et al.  Relative reward preference in primate orbitofrontal cortex , 1999, Nature.

[35]  M. Mesulam Spatial attention and neglect: parietal, frontal and cingulate contributions to the mental representation and attentional targeting of salient extrapersonal events. , 1999, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[36]  D. Gitelman,et al.  Covert Visual Spatial Orienting and Saccades: Overlapping Neural Systems , 2000, NeuroImage.

[37]  J. Duncan,et al.  Common regions of the human frontal lobe recruited by diverse cognitive demands , 2000, Trends in Neurosciences.

[38]  C. Cavada,et al.  The anatomical connections of the macaque monkey orbitofrontal cortex. A review. , 2000, Cerebral cortex.

[39]  E. Murray,et al.  Control of Response Selection by Reinforcer Value Requires Interaction of Amygdala and Orbital Prefrontal Cortex , 2000, The Journal of Neuroscience.

[40]  J. Price,et al.  The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans. , 2000, Cerebral cortex.

[41]  W. Schultz,et al.  Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. , 2000, Journal of neurophysiology.

[42]  M. Posner,et al.  Cognitive and emotional influences in anterior cingulate cortex , 2000, Trends in Cognitive Sciences.

[43]  E. Procyk,et al.  Anterior cingulate activity during routine and non-routine sequential behaviors in macaques , 2000, Nature Neuroscience.

[44]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[45]  J. Duncan An adaptive coding model of neural function in prefrontal cortex , 2001 .

[46]  A. Nobre,et al.  Heterogeneity of Cingulate Contributions to Spatial Attention , 2001, NeuroImage.

[47]  E. Procyk,et al.  Characterization of serial order encoding in the monkey anterior cingulate sulcus , 2001, The European journal of neuroscience.

[48]  Christos Constantinidis,et al.  The sensory nature of mnemonic representation in the primate prefrontal cortex , 2001, Nature Neuroscience.

[49]  J. Jonides,et al.  Overlapping mechanisms of attention and spatial working memory , 2001, Trends in Cognitive Sciences.

[50]  R. Dolan,et al.  Modulation of spatial attention by fear-conditioned stimuli: an event-related fMRI study , 2002, Neuropsychologia.

[51]  B. Richmond,et al.  Anterior Cingulate: Single Neuronal Signals Related to Degree of Reward Expectancy , 2002, Science.

[52]  J. Duncan,et al.  Filtering of neural signals by focused attention in the monkey prefrontal cortex , 2002, Nature Neuroscience.

[53]  K. A. Hadland,et al.  The anterior cingulate and reward-guided selection of actions. , 2003, Journal of neurophysiology.

[54]  D. V. von Cramon,et al.  Error Monitoring Using External Feedback: Specific Roles of the Habenular Complex, the Reward System, and the Cingulate Motor Area Revealed by Functional Magnetic Resonance Imaging , 2003, The Journal of Neuroscience.

[55]  E. Miller,et al.  Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task , 2003, The European journal of neuroscience.

[56]  K. A. Hadland,et al.  The Effect of Cingulate Cortex Lesions on Task Switching and Working Memory , 2003, Journal of Cognitive Neuroscience.

[57]  Keiji Tanaka,et al.  Neuronal Correlates of Goal-Based Motor Selection in the Prefrontal Cortex , 2003, Science.

[58]  J. Parkinson,et al.  Dissociable Contributions of the Human Amygdala and Orbitofrontal Cortex to Incentive Motivation and Goal Selection , 2003, The Journal of Neuroscience.

[59]  Matt Field,et al.  Eye movements to smoking-related pictures in smokers: relationship between attentional biases and implicit and explicit measures of stimulus valence. , 2003, Addiction.

[60]  Ziv M. Williams,et al.  Human anterior cingulate neurons and the integration of monetary reward with motor responses , 2004, Nature Neuroscience.

[61]  Clay B. Holroyd,et al.  Dorsal anterior cingulate cortex shows fMRI response to internal and external error signals , 2004, Nature Neuroscience.

[62]  M. Walton,et al.  Action sets and decisions in the medial frontal cortex , 2004, Trends in Cognitive Sciences.

[63]  Jerald D. Kralik,et al.  Representation of Attended Versus Remembered Locations in Prefrontal Cortex , 2004, PLoS biology.

[64]  E. Murray,et al.  Bilateral Orbital Prefrontal Cortex Lesions in Rhesus Monkeys Disrupt Choices Guided by Both Reward Value and Reward Contingency , 2004, The Journal of Neuroscience.

[65]  K. R. Ridderinkhof,et al.  The Role of the Medial Frontal Cortex in Cognitive Control , 2004, Science.

[66]  Jonathan D. Cohen,et al.  Anterior Cingulate Conflict Monitoring and Adjustments in Control , 2004, Science.

[67]  M. Roesch,et al.  Neuronal Activity Related to Reward Value and Motivation in Primate Frontal Cortex , 2004, Science.

[68]  Gregory McCarthy,et al.  Emotion-attention network interactions during a visual oddball task. , 2004, Brain research. Cognitive brain research.

[69]  Timothy Edward John Behrens,et al.  Quantitative Investigation of Connections of the Prefrontal Cortex in the Human and Macaque using Probabilistic Diffusion Tractography , 2005, The Journal of Neuroscience.

[70]  M. Roesch,et al.  Neuronal activity in macaque SEF and ACC during performance of tasks involving conflict. , 2005, Journal of neurophysiology.

[71]  M. Roesch,et al.  Neuronal activity in primate orbitofrontal cortex reflects the value of time. , 2005, Journal of neurophysiology.

[72]  B. Vogt,et al.  Architecture and neurocytology of monkey cingulate gyrus , 2005, The Journal of comparative neurology.

[73]  P. Glimcher,et al.  Midbrain Dopamine Neurons Encode a Quantitative Reward Prediction Error Signal , 2005, Neuron.

[74]  K. Saleem,et al.  Differential connections of the perirhinal and parahippocampal cortex with the orbital and medial prefrontal networks in macaque monkeys , 2005, The Journal of comparative neurology.

[75]  Timothy E. J. Behrens,et al.  Optimal decision making and the anterior cingulate cortex , 2006, Nature Neuroscience.

[76]  C. Padoa-Schioppa,et al.  Neurons in the orbitofrontal cortex encode economic value , 2006, Nature.

[77]  E. Vaadia,et al.  Midbrain dopamine neurons encode decisions for future action , 2006, Nature Neuroscience.

[78]  L. Chelazzi,et al.  Visual Selective Attention and the Effects of Monetary Rewards , 2006, Psychological science.

[79]  E. Procyk,et al.  Reward encoding in the monkey anterior cingulate cortex. , 2006, Cerebral cortex.

[80]  Jeffrey D Schall,et al.  The role of working memory representations in the control of attention. , 2007, Cerebral cortex.

[81]  J. Wallis Orbitofrontal cortex and its contribution to decision-making. , 2007, Annual review of neuroscience.

[82]  "Motivation sharpens exogenous spatial attention": Correction to Engelmann and Pessoa (2007). , 2007 .

[83]  Keiji Tanaka,et al.  Medial prefrontal cell activity signaling prediction errors of action values , 2007, Nature Neuroscience.

[84]  M. Roesch,et al.  Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards , 2007, Nature Neuroscience.

[85]  Timothy E. J. Behrens,et al.  Functional organization of the medial frontal cortex , 2007, Current Opinion in Neurobiology.

[86]  H. Seo,et al.  Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy Game , 2007, The Journal of Neuroscience.

[87]  E. Procyk,et al.  Expectations, gains, and losses in the anterior cingulate cortex , 2007, Cognitive, affective & behavioral neuroscience.

[88]  M. Roesch,et al.  Neuronal Activity Related to Anticipated Reward in Frontal Cortex , 2007, Annals of the New York Academy of Sciences.

[89]  S. Funahashi,et al.  Activity of primate orbitofrontal and dorsolateral prefrontal neurons: task-related activity during an oculomotor delayed-response task , 2007, Experimental Brain Research.

[90]  Geoffrey Schoenbaum,et al.  The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewards , 2008, Nature.

[91]  Paul M Bays,et al.  Dynamic Shifts of Limited Working Memory Resources in Human Vision , 2008, Science.

[92]  Timothy E. J. Behrens,et al.  Frontal Cortex Subregions Play Distinct Roles in Choices between Actions and Stimuli , 2008, The Journal of Neuroscience.

[93]  E. Procyk,et al.  Behavioral Shifts and Action Valuation in the Anterior Cingulate Cortex , 2008, Neuron.

[94]  D. Gitelman,et al.  The spatial attention network interacts with limbic and monoaminergic systems to modulate motivation-induced attention shifts. , 2008, Cerebral cortex.

[95]  S. Kennerley,et al.  Reward-Dependent Modulation of Working Memory in Lateral Prefrontal Cortex , 2009, The Journal of Neuroscience.

[96]  Daeyeol Lee,et al.  Behavioral and Neural Changes after Gains and Losses of Conditioned Reinforcers , 2009, The Journal of Neuroscience.

[97]  John M. Pearson,et al.  Fictive Reward Signals in the Anterior Cingulate Cortex , 2009, Science.

[98]  S. Kennerley,et al.  Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables , 2009, The European journal of neuroscience.

[99]  Jonathan D. Wallis,et al.  Neurons in the Frontal Lobe Encode the Value of Multiple Decision Variables , 2009, Journal of Cognitive Neuroscience.

[100]  J. Wallis,et al.  Dynamic Encoding of Responses and Outcomes by Neurons in Medial Prefrontal Cortex , 2009, The Journal of Neuroscience.

[101]  O. Hikosaka,et al.  Two types of dopamine neuron distinctly convey positive and negative motivational signals , 2009, Nature.

[102]  R. Dolan,et al.  Enhanced Processing of Threat Stimuli under Limited Attentional Resources , 2008, Cerebral cortex.

[103]  E. Koechlin,et al.  Motivation and cognitive control in the human prefrontal cortex , 2009, Nature Neuroscience.

[104]  A. Cooper,et al.  Predictive Reward Signal of Dopamine Neurons , 2011 .