Behavioral flexibility is associated with changes in structure and function distributed across a frontal cortical network in macaques

One of the most influential accounts of central orbitofrontal cortex– that it mediates behavioral flexibility – has been challenged by the finding that discrimination reversal in macaques –the classic test of behavioral flexibility –is unaffected when lesions are made by excitotoxin injection rather than aspiration. This suggests the critical brain circuit mediating behavioral flexibility in reversal tasks lies beyond the central orbitofrontal cortex. To determine its identity a group of nine macaques were taught discrimination reversal learning tasks and its impact on grey matter was measured. Magnetic resonance imaging scans were taken before and after learning and compared with scans from two control groups each comprising ten animals. One control group learned similar discrimination tasks but which lacked any reversal component and the other control group engaged in no learning. Grey matter changes were prominent in posterior orbitofrontal cortex/anterior insula but also were found in three other frontal cortical regions: lateral orbitofrontal cortex (12o), cingulate cortex, and lateral prefrontal cortex. In a second analysis, neural activity in posterior orbitofrontal cortex/anterior insula was measured at rest and its pattern of coupling with the other frontal cortical regions was assessed. Activity coupling increased significantly in the reversal learning group in comparison to controls. In a final set of experiments we used similar structural imaging procedures and analyses to demonstrate that aspiration lesion of central orbitofrontal cortex, of the type known to affect discrimination learning, affected structure and activity in the same frontal cortical circuit. The results identify a distributed frontal cortical circuit associated with behavioral flexibility.

[1]  Yann Humeau,et al.  The next generation of approaches to investigate the link between synaptic plasticity and learning , 2019, Nature Neuroscience.

[2]  Ninon Burgos,et al.  New advances in the Clinica software platform for clinical neuroimaging studies , 2019 .

[3]  C. Gilbert,et al.  Axonal plasticity associated with perceptual learning in adult macaque primary visual cortex , 2018, Proceedings of the National Academy of Sciences.

[4]  Shauna L. Parkes,et al.  Insular and Ventrolateral Orbitofrontal Cortices Differentially Contribute to Goal-Directed Behavior in Rodents , 2018, Cerebral cortex.

[5]  Bolton K. H. Chau,et al.  The macaque anterior cingulate cortex translates counterfactual choice value into actual behavioral change , 2018, Nature Neuroscience.

[6]  E. Murray,et al.  Specializations for reward-guided decision-making in the primate ventral prefrontal cortex , 2018, Nature Reviews Neuroscience.

[7]  K. Wassum,et al.  Distinct cortical-amygdala projections drive reward value encoding and retrieval , 2018, Nature Neuroscience.

[8]  Heidi Johansen-Berg,et al.  Structural Plasticity in Adulthood with Motor Learning and Stroke Rehabilitation. , 2018, Annual review of neuroscience.

[9]  Bolton K. H. Chau,et al.  Inverted activity patterns in ventromedial prefrontal cortex during value-guided decision-making in a less-is-more task , 2017, Nature Communications.

[10]  A. Izquierdo Functional Heterogeneity within Rat Orbitofrontal Cortex in Reward Learning and Decision Making , 2017, The Journal of Neuroscience.

[11]  Jacqueline Scholl,et al.  Simultaneous representation of a spectrum of dynamically changing value estimates during decision making , 2017, Nature Communications.

[12]  Elisabeth A. Murray,et al.  Specialized Representations of Value in the Orbital and Ventrolateral Prefrontal Cortex: Desirability versus Availability of Outcomes , 2017, Neuron.

[13]  Kathryn M. Rothenhoefer,et al.  Effects of Ventral Striatum Lesions on Stimulus-Based versus Action-Based Reinforcement Learning , 2017, The Journal of Neuroscience.

[14]  Lesley K Fellows,et al.  Contrasting Effects of Medial and Lateral Orbitofrontal Cortex Lesions on Credit Assignment and Decision-Making in Humans , 2017, The Journal of Neuroscience.

[15]  Timothy Edward John Behrens,et al.  Value, search, persistence and model updating in anterior cingulate cortex , 2016, Nature Neuroscience.

[16]  A. J. Parker,et al.  Individual Differences in the Alignment of Structural and Functional Markers of the V5/MT Complex in Primates , 2016, Cerebral cortex.

[17]  Nils Kolling,et al.  Predictive decision making driven by multiple time-linked reward representations in the anterior cingulate cortex , 2016, Nature Communications.

[18]  Emmanuel Procyk,et al.  Specific frontal neural dynamics contribute to decisions to check , 2016, Nature Communications.

[19]  Timothy Edward John Behrens,et al.  Reward-Guided Learning with and without Causal Attribution , 2016, Neuron.

[20]  J. David Sweatt,et al.  Neural plasticity and behavior – sixty years of conceptual advances , 2016, Journal of neurochemistry.

[21]  L. Wilbrecht,et al.  Rule learning enhances structural plasticity of long-range axons in frontal cortex , 2016, Nature Communications.

[22]  Joshua W. Brown,et al.  Neural Mechanisms of Credit Assignment in a Multicue Environment , 2016, The Journal of Neuroscience.

[23]  Michael Petrides,et al.  Midcingulate Motor Map and Feedback Detection: Converging Data from Humans and Monkeys. , 2014, Cerebral cortex.

[24]  P. B. Cipolloni,et al.  Cytoarchitecture and cortical connections of the anterior insula and adjacent frontal motor fields in the rhesus monkey , 2015, Brain Research Bulletin.

[25]  Matthew F.S. Rushworth,et al.  Contrasting Roles for Orbitofrontal Cortex and Amygdala in Credit Assignment and Learning in Macaques , 2015, Neuron.

[26]  Thomas E. Nichols,et al.  A positive-negative mode of population covariation links brain connectivity, demographics and behavior , 2015, Nature Neuroscience.

[27]  Vincent D Costa,et al.  The Role of Frontal Cortical and Medial-Temporal Lobe Brain Areas in Learning a Bayesian Prior Belief on Reversals , 2015, The Journal of Neuroscience.

[28]  Angelo Arleo,et al.  Spatiotemporal Spike Coding of Behavioral Adaptation in the Dorsal Anterior Cingulate Cortex , 2015, PLoS biology.

[29]  M. Rushworth,et al.  Connectivity reveals relationship of brain areas for reward-guided learning and decision making in human and monkey frontal cortex , 2015, Proceedings of the National Academy of Sciences.

[30]  G. Schoenbaum,et al.  What the orbitofrontal cortex does not do , 2015, Nature Neuroscience.

[31]  E. Murray,et al.  The Orbitofrontal Oracle: Cortical Mechanisms for the Prediction and Evaluation of Specific Behavioral Outcomes , 2014, Neuron.

[32]  John Duncan,et al.  Distinct aspects of frontal lobe structure mediate age-related differences in fluid intelligence and multitasking , 2014, Nature Communications.

[33]  Anna S. Mitchell,et al.  A Neural Circuit Covarying with Social Hierarchy in Macaques , 2014, PLoS biology.

[34]  Heidi Johansen-Berg,et al.  Gray matter volume is associated with rate of subsequent skill learning after a long term training intervention , 2014, NeuroImage.

[35]  C. Barnes,et al.  Orbitofrontal Cortex Volume in Area 11/13 Predicts Reward Devaluation, But Not Reversal Learning Performance, in Young and Aged Monkeys , 2014, The Journal of Neuroscience.

[36]  Jonathan D. Wallis,et al.  Medial-lateral Organization of the Orbitofrontal Cortex , 2014, Journal of Cognitive Neuroscience.

[37]  Stephen M. Smith,et al.  Permutation inference for the general linear model , 2014, NeuroImage.

[38]  Kate E. Watkins,et al.  Age of language learning shapes brain structure: A cortical thickness study of bilingual and monolingual individuals , 2014, Brain and Language.

[39]  Robert C. Wilson,et al.  Orbitofrontal Cortex as a Cognitive Map of Task Space , 2014, Neuron.

[40]  Heidi Johansen-Berg,et al.  Motor Skill Learning Induces Changes in White Matter Microstructure and Myelination , 2013, The Journal of Neuroscience.

[41]  E. Murray,et al.  The role of the anterior cingulate cortex in choices based on reward value and reward contingency. , 2013, Cerebral cortex.

[42]  R. Saunders,et al.  Prefrontal mechanisms of behavioral flexibility, emotion regulation and value updating , 2013, Nature Neuroscience.

[43]  Timothy E. J. Behrens,et al.  Human and Monkey Ventral Prefrontal Fibers Use the Same Organizational Principles to Reach Their Targets: Tracing versus Tractography , 2013, The Journal of Neuroscience.

[44]  Michael Petrides,et al.  Modulation of feedback related activity in the rostral anterior cingulate cortex during trial and error exploration , 2012, NeuroImage.

[45]  R. Passingham,et al.  The Neurobiology of the Prefrontal Cortex: Anatomy, Evolution, and the Origin of Insight , 2012 .

[46]  Anatol C. Kreitzer,et al.  Plasticity in gray and white: neuroimaging changes in brain structure during learning , 2012, Nature Neuroscience.

[47]  David W. McNeal,et al.  Cytoarchitecture and cortical connections of the anterior cingulate and adjacent somatomotor fields in the rhesus monkey , 2012, Brain Research Bulletin.

[48]  Deepak N. Pandya,et al.  The prefrontal cortex: Comparative architectonic organization in the human and the macaque monkey brains , 2012, Cortex.

[49]  J. Wallis Cross-species studies of orbitofrontal cortex and value-based decision-making , 2011, Nature Neuroscience.

[50]  Sara E. Morrison,et al.  Representations of appetitive and aversive information in the primate orbitofrontal cortex , 2011, Annals of the New York Academy of Sciences.

[51]  J L Andersson,et al.  Social Network Size Affects Neural Circuits in Macaques , 2011, Science.

[52]  M. Rushworth,et al.  Distinct Roles of Three Frontal Cortical Areas in Reward-Guided Behavior , 2011, The Journal of Neuroscience.

[53]  Sara E. Morrison,et al.  Different Time Courses for Learning-Related Changes in Amygdala and Orbitofrontal Cortex , 2011, Neuron.

[54]  Timothy E. J. Behrens,et al.  Review Frontal Cortex and Reward-guided Learning and Decision-making Figure 1. Frontal Brain Regions in the Macaque Involved in Reward-guided Learning and Decision-making Finer Grained Anatomical Divisions with Frontal Cortical Systems for Reward-guided Behavior , 2022 .

[55]  Frank J. Yuk,et al.  Evidence for Reduced Experience-Dependent Dendritic Spine Plasticity in the Aging Prefrontal Cortex , 2011, The Journal of Neuroscience.

[56]  M. Walton,et al.  Cingulate and orbitofrontal contributions to valuing knowns and unknowns in a changeable world , 2011 .

[57]  Dawn M Eagle,et al.  Dissociable Effects of Lesions to Orbitofrontal Cortex Subregions on Impulsive Choice in the Rat , 2011, The Journal of Neuroscience.

[58]  M. Mallar Chakravarty,et al.  An MRI based average macaque monkey stereotaxic atlas and space (MNI monkey space) , 2011, NeuroImage.

[59]  Timothy Edward John Behrens,et al.  Diffusion-Weighted Imaging Tractography-Based Parcellation of the Human Parietal Cortex and Comparison with Human and Macaque Resting-State Functional Connectivity , 2011, The Journal of Neuroscience.

[60]  Veronique D. Bohbot,et al.  Maze training in mice induces MRI-detectable brain shape changes specific to the type of learning , 2011, NeuroImage.

[61]  Timothy Edward John Behrens,et al.  Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex , 2010, Proceedings of the National Academy of Sciences.

[62]  T. Robbins,et al.  Differential Contributions of the Primate Ventrolateral Prefrontal and Orbitofrontal Cortex to Serial Reversal Learning , 2010, The Journal of Neuroscience.

[63]  Arno Villringer,et al.  Dynamic Properties of Human Brain Structure: Learning-Related Changes in Cortical Areas and Associated Fiber Connections , 2010, The Journal of Neuroscience.

[64]  Russell A Poldrack,et al.  Neural components underlying behavioral flexibility in human reversal learning. , 2010, Cerebral cortex.

[65]  Timothy Edward John Behrens,et al.  Separable Learning Systems in the Macaque Brain and the Role of Orbitofrontal Cortex in Contingent Learning , 2010, Neuron.

[66]  Willie F. Tobin,et al.  Rapid formation and selective stabilization of synapses for enduring motor memories , 2009, Nature.

[67]  A. Cowey,et al.  Imaging studies in congenital anophthalmia reveal preservation of brain architecture in 'visual' cortex. , 2009, Brain : a journal of neurology.

[68]  T. Asamizuya,et al.  Gray and white matter changes associated with tool-use learning in macaque monkeys , 2009, Proceedings of the National Academy of Sciences.

[69]  John M. Pearson,et al.  Fictive Reward Signals in the Anterior Cingulate Cortex , 2009, Science.

[70]  Stephen M. Smith,et al.  Threshold-free cluster enhancement: Addressing problems of smoothing, threshold dependence and localisation in cluster inference , 2009, NeuroImage.

[71]  Timothy E. J. Behrens,et al.  Frontal Cortex Subregions Play Distinct Roles in Choices between Actions and Stimuli , 2008, The Journal of Neuroscience.

[72]  Steven P. Wise,et al.  Forward frontal fields: phylogeny and fundamental function , 2008, Trends in Neurosciences.

[73]  Christian Büchel,et al.  Changes in Gray Matter Induced by Learning—Revisited , 2008, PloS one.

[74]  Charles R. E. Wilson,et al.  Prefrontal–Inferotemporal Interaction Is Not Always Necessary for Reversal Learning , 2008, The Journal of Neuroscience.

[75]  E. Procyk,et al.  Behavioral Shifts and Action Valuation in the Anterior Cingulate Cortex , 2008, Neuron.

[76]  Timothy Edward John Behrens,et al.  Anatomically related grey and white matter abnormalities in adolescent-onset schizophrenia. , 2007, Brain : a journal of neurology.

[77]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[78]  K. Johnston,et al.  Top-Down Control-Signal Dynamics in Anterior Cingulate and Prefrontal Cortex Neurons following Task Switching , 2007, Neuron.

[79]  M. Jenkinson Non-linear registration aka Spatial normalisation , 2007 .

[80]  Kristina M. Visscher,et al.  A Core System for the Implementation of Task Sets , 2006, Neuron.

[81]  D. Pandya,et al.  Fiber Pathways of the Brain , 2006 .

[82]  A. Roberts,et al.  Primate orbitofrontal cortex and adaptive behaviour , 2006, Trends in Cognitive Sciences.

[83]  Steven L. Thorne,et al.  Rising mean IQ: Cognitive demand of mathematics education for young children, population exposure to formal schooling, and the neurobiology of the prefrontal cortex , 2005 .

[84]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[85]  E. Murray,et al.  Bilateral Orbital Prefrontal Cortex Lesions in Rhesus Monkeys Disrupt Choices Guided by Both Reward Value and Reward Contingency , 2004, The Journal of Neuroscience.

[86]  J. O'Doherty,et al.  Dissociating Valence of Outcome from Behavioral Control in Human Orbital and Ventral Prefrontal Cortices , 2003, The Journal of Neuroscience.

[87]  Michael Brady,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[88]  Karl J. Friston,et al.  MRI analysis of an inherited speech and language disorder: structural brain abnormalities. , 2002, Brain : a journal of neurology.

[89]  J. Kleim,et al.  Motor Learning-Dependent Synaptogenesis Is Localized to Functionally Reorganized Motor Cortex , 2002, Neurobiology of Learning and Memory.

[90]  Stephen M. Smith,et al.  A global optimisation method for robust affine registration of brain images , 2001, Medical Image Anal..

[91]  K J Friston,et al.  Detecting bilateral abnormalities with voxel‐based morphometry , 2000, Human brain mapping.

[92]  Karl J. Friston,et al.  Voxel-Based Morphometry—The Methods , 2000, NeuroImage.

[93]  R. Elliott,et al.  Dissociable functions in the medial and lateral orbitofrontal cortex: evidence from human neuroimaging studies. , 2000, Cerebral cortex.

[94]  E. Rolls The orbitofrontal cortex and reward. , 2000, Cerebral cortex.

[95]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[96]  D. Pandya,et al.  Dorsolateral prefrontal cortex: comparative cytoarchitectonic analysis in the human and the macaque brain and corticocortical connection patterns , 1999, The European journal of neuroscience.

[97]  M. Mishkin,et al.  Effects of orbital frontal and anterior cingulate lesions on object and spatial memory in rhesus monkeys , 1997, Neuropsychologia.

[98]  T. Robbins,et al.  Dissociation in prefrontal cortex of affective and attentional shifts , 1996, Nature.

[99]  J. Price,et al.  Architectonic subdivision of the orbital and medial prefrontal cortex in the macaque monkey , 1994, The Journal of comparative neurology.