Dynamics of prefrontal and cingulate activity during a reward-based logical deduction task.

We used behavioral and functional magnetic resonance imaging (fMRI) methods to probe the cerebral organization of a simple logical deduction process. Subjects were engaged in a motor trial-and-error learning task, in which they had to infer the identity of an unknown 4-key code. The design of the task allowed subjects to base their inferences not only on the feedback they received but also on the internal deductions that it afforded (autoevaluation). fMRI analysis revealed a large bilateral parietal, prefrontal, cingulate, and striatal network that activated suddenly during search periods and collapsed during ensuing periods of sequence repetition. Fine-grained analyses of the temporal dynamics of this search network indicated that it operates according to near-optimal rules that include 1) computation of the difference between expected and obtained rewards and 2) anticipatory deductions that predate the actual reception of positive reward. In summary, the dynamics of effortful mental deduction can be tracked with fMRI and relate to a distributed network engaging prefrontal cortex and its interconnected cortical and subcortical regions.

[1]  J. Panksepp,et al.  The neurobiology of positive emotions , 2006, Neuroscience & Biobehavioral Reviews.

[2]  Angela J. Yu,et al.  Uncertainty, Neuromodulation, and Attention , 2005, Neuron.

[3]  Jonathan D. Cohen,et al.  Prefrontal cortex and flexible cognitive control: rules without symbols. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[5]  R. E. Passingham,et al.  Prediction error for free monetary reward in the human prefrontal cortex , 2004, NeuroImage.

[6]  Karl J. Friston,et al.  Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning , 2004, Science.

[7]  M. Gluck,et al.  Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. , 2004, Brain : a journal of neurology.

[8]  K. Doya,et al.  A Neural Correlate of Reward-Based Behavioral Learning in Caudate Nucleus: A Functional Magnetic Resonance Imaging Study of a Stochastic Decision Task , 2004, The Journal of Neuroscience.

[9]  T. Robbins,et al.  Differential Responses in Human Striatum and Prefrontal Cortex to Changes in Object and Rule Relevance , 2004, The Journal of Neuroscience.

[10]  Sharlene D. Newman,et al.  Frontal and parietal participation in problem solving in the Tower of London: fMRI and computational modeling of planning and high-level perception , 2003, Neuropsychologia.

[11]  Vinod Goel,et al.  Reciprocal neural response within lateral and ventral medial prefrontal cortex during hot and cold reasoning , 2003, NeuroImage.

[12]  E. Koechlin,et al.  The Architecture of Cognitive Control in the Human Prefrontal Cortex , 2003, Science.

[13]  E. Miller,et al.  From rule to response: neuronal processes in the premotor and prefrontal cortex. , 2003, Journal of neurophysiology.

[14]  Samuel M. McClure,et al.  Temporal Prediction Errors in a Passive Learning Task Activate Human Striatum , 2003, Neuron.

[15]  Karl J. Friston,et al.  Temporal Difference Models and Reward-Related Learning in the Human Brain , 2003, Neuron.

[16]  Frederik Barkhof,et al.  Frontostriatal system in planning complexity: a parametric functional magnetic resonance version of tower of london task , 2003, NeuroImage.

[17]  Brian Knutson,et al.  A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI , 2003, NeuroImage.

[18]  Y. Miyashita,et al.  Functional MRI of Macaque Monkeys Performing a Cognitive Set-Shifting Task , 2002, Science.

[19]  T. Braver,et al.  Anterior cingulate cortex and response conflict: effects of frequency, inhibition and errors. , 2001, Cerebral cortex.

[20]  M. Botvinick,et al.  Conflict monitoring and cognitive control. , 2001, Psychological review.

[21]  D. Kahneman,et al.  Functional Imaging of Neural Responses to Expectancy and Experience of Monetary Gains and Losses tasks with monetary payoffs , 2001 .

[22]  Samuel M. McClure,et al.  Predictability Modulates Human Brain Response to Reward , 2001, The Journal of Neuroscience.

[23]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[24]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[25]  E. Koechlin,et al.  Dissociating the role of the medial and lateral anterior prefrontal cortex in human planning. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[26]  M. Posner,et al.  Cognitive and emotional influences in anterior cingulate cortex , 2000, Trends in Cognitive Sciences.

[27]  E. Procyk,et al.  Anterior cingulate activity during routine and non-routine sequential behaviors in macaques , 2000, Nature Neuroscience.

[28]  Leslie G. Ungerleider,et al.  Distinguishing the Functional Roles of Multiple Regions in Distributed Neural Systems for Visual Working Memory , 2000, NeuroImage.

[29]  J. Changeux,et al.  Reward-dependent learning in neuronal networks for planning and decision making. , 2000, Progress in brain research.

[30]  T. Robbins,et al.  Contrasting Cortical and Subcortical Activations Produced by Attentional-Set Shifting and Reversal Learning in Humans , 2000, Journal of Cognitive Neuroscience.

[31]  A. Dagher,et al.  Mapping the network for planning: a correlational PET activation study with the Tower of London task. , 1999, Brain : a journal of neurology.

[32]  A M Dale,et al.  Optimal experimental design for event‐related fMRI , 1999, Human brain mapping.

[33]  S Dehaene,et al.  A neuronal model of a global workspace in effortful cognitive tasks. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[34]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[35]  Earl K. Miller,et al.  Selective representation of relevant information by neurons in the primate prefrontal cortex , 1998, Nature.

[36]  M. Botvinick,et al.  Anterior cingulate cortex, error detection, and the online monitoring of performance. , 1998, Science.

[37]  Emmanuel Dupoux,et al.  Expe: An expandable programming language for on-line psychological experiments , 1997 .

[38]  J. Fuster.  The Prefrontal Cortex , 1997 .

[39]  N. White.  Mnemonic functions of the basal ganglia , 1997, Current Opinion in Neurobiology.

[40]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[41]  M. Kinsbourne,et al.  Divergent Thinking Styles of the Hemispheres: How Syllogisms Are Solved during Transitory Hemisphere Suppression , 1996, Brain and Cognition.

[42]  R. Dolan,et al.  Neural systems engaged by planning: a PET study of the Tower of London task , 1996, Neuropsychologia.

[43]  Alan C. Evans,et al.  Planning and Spatial Working Memory: a Positron Emission Tomography Study in Humans , 1996, The European journal of neuroscience.

[44]  E. Seidemann,et al.  Simultaneously recorded single units in the frontal cortex go through sequences of discrete and stable states in monkeys performing a delayed localization task , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  R. Morris,et al.  Neural correlates of planning ability: Frontal lobe activation during the tower of London test , 1993, Neuropsychologia.

[46]  James L. McClelland,et al.  A parallel distributed processing approach to automaticity. , 1992, The American journal of psychology.

[47]  J. Changeux,et al.  The Wisconsin Card Sorting Test: theoretical analysis and modeling in a neuronal network. , 1991, Cerebral cortex.

[48]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[49]  O. Andy.  The prefrontal cortex: Anatomy, physiology and neuropsychology of the frontal lobe , 1981 .