Hierarchical cognitive control and the frontal lobes.

Cognitive control refers to our ability to choose courses of thought and action that achieve our goals over habitual but contextually inappropriate ones. Hierarchical control problems are those in which multiple goals or contextual contingency must be managed at once and related to one another. In the open-ended complexity of the real world, hierarchical control arguably characterizes most of the problems faced by our control systems. And, it is these cases of hierarchical control where patients with damage to executive systems are most apt to fail, even those that perform well on simplified laboratory tasks. In this chapter, we consider the functional organization of frontal brain systems that support hierarchical cognitive control. We focus on two particular cases of hierarchical control. First, we discuss a line of work testing how managing multiple contingencies en route to a response relates to processing along the rostrocaudal axis of frontal cortex. Second, we consider cases of sequential tasks that require monitoring and behaving according to a series of tasks performed in time. In this latter case, we focus on the particular role of rostrolateral prefrontal cortex. We conclude with considerations of future directions of basic and clinically relevant research in this domain.

[1]  J. Duncan,et al.  Intelligence and the Frontal Lobe: The Organization of Goal-Directed Behavior , 1996, Cognitive Psychology.

[2]  David Badre,et al.  Frontal Cortex and the Hierarchical Control of Behavior , 2018, Trends in Cognitive Sciences.

[3]  M. D’Esposito,et al.  Frontal Cortex and the Discovery of Abstract Action Rules , 2010, Neuron.

[4]  V. Hachinski,et al.  Executive dysfunction in patients with transient ischemic attack and minor stroke , 2015, Journal of the Neurological Sciences.

[5]  Joshua W. Brown,et al.  Hierarchical error representation in medial prefrontal cortex , 2016, NeuroImage.

[6]  Leslie G. Ungerleider,et al.  Transient and sustained activity in a distributed neural system for human working memory , 1997, Nature.

[7]  B. Finlay Principles of Network Architecture Emerging from Comparisons of the Cerebral Cortex in Large and Small Brains , 2016, PLoS biology.

[8]  Marisa O. Hollinshead,et al.  The organization of the human cerebral cortex estimated by intrinsic functional connectivity. , 2011, Journal of neurophysiology.

[9]  John Kornak,et al.  Biomarkers and cognitive endpoints to optimize trials in Alzheimer's disease , 2015, Annals of clinical and translational neurology.

[10]  E. Koechlin,et al.  The Architecture of Cognitive Control in the Human Prefrontal Cortex , 2003, Science.

[11]  T. Montine,et al.  Neuropathologic correlates of cognition in a population-based sample. , 2013, Journal of Alzheimer's disease : JAD.

[12]  Mark D'Esposito,et al.  The Rostro-Caudal Axis of Frontal Cortex Is Sensitive to the Domain of Stimulus Information. , 2015, Cerebral cortex.

[13]  Christopher H. Chatham,et al.  Corticostriatal Output Gating during Selection from Working Memory , 2014, Neuron.

[14]  H. Jackson,et al.  The assessment of executive functions: coming out of the office , 2004, Brain injury.

[15]  Valerie A. Carr,et al.  Prospective representation of navigational goals in the human hippocampus , 2016, Science.

[16]  Anne G E Collins,et al.  Cognitive control over learning: creating, clustering, and generalizing task-set structure. , 2013, Psychological review.

[17]  Nicole M. Long,et al.  Rostrolateral Prefrontal Cortex and Individual Differences in Uncertainty-Driven Exploration , 2012, Neuron.

[18]  Donald T. Stuss,et al.  The Frontal Lobes and Control of Cognition and Memory , 2019, The Frontal Lobes Revisited.

[19]  D. Stuss,et al.  Frequency of domain-specific cognitive impairment in sub-acute and chronic stroke. , 2014, NeuroRehabilitation.

[20]  S. Huettel,et al.  Resolving Response, Decision, and Strategic Control: Evidence for a Functional Topography in Dorsomedial Prefrontal Cortex , 2009, The Journal of Neuroscience.

[21]  Franziska M. Korb,et al.  Hierarchically Organized Medial Frontal Cortex-Basal Ganglia Loops Selectively Control Task- and Response-Selection , 2017, The Journal of Neuroscience.

[22]  E. Koechlin,et al.  Motivation and cognitive control in the human prefrontal cortex , 2009, Nature Neuroscience.

[23]  E. Koechlin,et al.  The role of the anterior prefrontal cortex in human cognition , 1999, Nature.

[24]  M. Frank,et al.  Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: computational analysis. , 2012, Cerebral cortex.

[25]  Gordon D. Logan,et al.  Hierarchical control of cognitive processes: switching tasks in sequences. , 2006 .

[26]  R. Passingham,et al.  Prefrontal interactions reflect future task operations , 2003, Nature Neuroscience.

[27]  M. D’Esposito,et al.  Is the rostro-caudal axis of the frontal lobe hierarchical? , 2009, Nature Reviews Neuroscience.

[28]  Myrna F. Schwartz,et al.  The Naturalistic Action Test: A standardised assessment for everyday action impairment , 2002 .

[29]  A. Damasio,et al.  Severe disturbance of higher cognition after bilateral frontal lobe ablation , 1985, Neurology.

[30]  S. Brucki,et al.  Disorders in planning and strategy application in frontal lobe lesion patients , 2007, Brain and Cognition.

[31]  Oshin Vartanian,et al.  Lesions to right prefrontal cortex impair real-world planning through prematurecommitments , 2013, Neuropsychologia.

[32]  M. Frank,et al.  Mechanisms of hierarchical reinforcement learning in cortico-striatal circuits 2: evidence from fMRI. , 2012, Cerebral cortex.

[33]  T. Shallice,et al.  Deficits in strategy application following frontal lobe damage in man. , 1991, Brain : a journal of neurology.

[34]  T. Shallice,et al.  Hierarchical schemas and goals in the control of sequential behavior. , 2006, Psychological review.

[35]  T. Shallice,et al.  Action Sequencing Deficit Following Frontal Lobe Lesion , 2002, Neurocase.

[36]  M. Botvinick Hierarchical models of behavior and prefrontal function , 2008, Trends in Cognitive Sciences.

[37]  Jonathan D. Cohen,et al.  The Function and Organization of Lateral Prefrontal Cortex: A Test of Competing Hypotheses , 2012, PloS one.

[38]  Jeffrey W. Cooney,et al.  Hierarchical cognitive control deficits following damage to the human frontal lobe , 2009, Nature Neuroscience.

[39]  J. Grafman,et al.  A study of the performance of patients with frontal lobe lesions in a financial planning task. , 1997, Brain : a journal of neurology.

[40]  J. Fuster The Prefrontal Cortex—An Update Time Is of the Essence , 2001, Neuron.

[41]  J. Jacobs,et al.  Regional dendritic and spine variation in human cerebral cortex: a quantitative golgi study. , 2001, Cerebral cortex.

[42]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[43]  Alexandra Tinnermann,et al.  On the role of the anterior prefrontal cortex in cognitive ‘branching’: An fMRI study , 2015, Neuropsychologia.

[44]  Christopher H Chatham,et al.  Multiple gates on working memory , 2015, Current Opinion in Behavioral Sciences.

[45]  Joshua W. Brown,et al.  Prefrontal cortex organization: dissociating effects of temporal abstraction, relational abstraction, and integration with FMRI. , 2014, Cerebral cortex.

[46]  B. Dubois,et al.  Rostro-caudal Architecture of the Frontal Lobes in Humans , 2016, Cerebral cortex.

[47]  David Badre,et al.  Functional Magnetic Resonance Imaging Evidence for a Hierarchical Organization of the Prefrontal Cortex , 2007, Journal of Cognitive Neuroscience.

[48]  U. Bonuccelli,et al.  The Epidemiology and Clinical Manifestations of Dysexecutive Syndrome in Parkinson’s Disease , 2012, Front. Neur..

[49]  M. D’Esposito,et al.  Causal evidence for frontal cortex organization for perceptual decision making , 2016, Proceedings of the National Academy of Sciences.

[50]  Joshua W. Brown,et al.  Medial prefrontal cortex as an action-outcome predictor , 2011, Nature Neuroscience.

[51]  K. Lashley The problem of serial order in behavior , 1951 .

[52]  E. Chang,et al.  UC San Francisco UC San Francisco Previously Published Works Title Oscillatory dynamics coordinating human frontal networks in support of goal maintenance , 2015 .

[53]  Richard Levy,et al.  Testing the model of caudo-rostral organization of cognitive control in the human with frontal lesions , 2014, NeuroImage.

[54]  T. Braver,et al.  The Role of Frontopolar Cortex in Subgoal Processing during Working Memory , 2002, NeuroImage.

[55]  D. Pandya,et al.  The cortical connectivity of the prefrontal cortex in the monkey brain , 2012, Cortex.

[56]  D. Stuss,et al.  Further development of the Multiple Errands Test: standardized scoring, reliability, and ecological validity for the Baycrest version. , 2009, Archives of physical medicine and rehabilitation.

[57]  J. Cummings,et al.  Executive control function: a review of its promise and challenges for clinical research. A report from the Committee on Research of the American Neuropsychiatric Association. , 2002, The Journal of neuropsychiatry and clinical neurosciences.

[58]  E. Koechlin,et al.  Managing competing goals — a key role for the frontopolar cortex , 2017, Nature Reviews Neuroscience.

[59]  P. Burgess,et al.  The ecological validity of tests of executive function , 1998, Journal of the International Neuropsychological Society.

[60]  David Badre,et al.  Evidence for a Functional Hierarchy of Association Networks , 2018, Journal of Cognitive Neuroscience.

[61]  Theresa M. Desrochers,et al.  The Necessity of Rostrolateral Prefrontal Cortex for Higher-Level Sequential Behavior , 2015, Neuron.

[62]  T. Toulopoulou,et al.  Assessment of executive functions: review of instruments and identification of critical issues. , 2008, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[63]  Joshua W. Brown,et al.  Dissociable frontal-striatal and frontal-parietal networks involved in updating hierarchical contexts in working memory. , 2013, Cerebral cortex.

[64]  Maureen Schmitter-Edgecombe,et al.  Improving the ecological validity of executive functioning assessment. , 2006, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[65]  T. Stijnen,et al.  Cognitive Impairment and Risk of Stroke: A Systematic Review and Meta-Analysis of Prospective Cohort Studies , 2014, Stroke.

[66]  E. Koechlin,et al.  Organization of cognitive control within the lateral prefrontal cortex in schizophrenia. , 2009, Archives of general psychiatry.

[67]  David Badre,et al.  Cognitive control, hierarchy, and the rostro–caudal organization of the frontal lobes , 2008, Trends in Cognitive Sciences.

[68]  M. D’Esposito,et al.  Causal evidence for lateral prefrontal cortex dynamics supporting cognitive control , 2017, bioRxiv.

[69]  Robert Leech,et al.  Dynamic Network Mechanisms of Relational Integration , 2015, The Journal of Neuroscience.

[70]  Elizabeth Jefferies,et al.  Situating the default-mode network along a principal gradient of macroscale cortical organization , 2016, Proceedings of the National Academy of Sciences.

[71]  Theresa M. Desrochers,et al.  Sequential Control Underlies Robust Ramping Dynamics in the Rostrolateral Prefrontal Cortex , 2018, The Journal of Neuroscience.

[72]  Mark D'Esposito,et al.  The hierarchical organization of the lateral prefrontal cortex , 2016, eLife.