Multilevel structure in behaviour and in the brain: a model of Fuster's hierarchy

A basic question, intimately tied to the problem of action selection, is that of how actions are assembled into organized sequences. Theories of routine sequential behaviour have long acknowledged that it must rely not only on environmental cues but also on some internal representation of temporal or task context. It is assumed, in most theories, that such internal representations must be organized into a strict hierarchy, mirroring the hierarchical structure of naturalistic sequential behaviour. This article reviews an alternative computational account, which asserts that the representations underlying naturalistic sequential behaviour need not, and arguably cannot, assume a strictly hierarchical form. One apparent liability of this theory is that it seems to contradict neuroscientific evidence indicating that different levels of sequential structure in behaviour are represented at different levels in a hierarchy of cortical areas. New simulations, reported here, show not only that the original computational account can be reconciled with this alignment between behavioural and neural organization, but also that it gives rise to a novel explanation for how this alignment might develop through learning.

[1]  JORDAN GRAFMAN,et al.  Similarities and Distinctions among Current Models of Prefrontal Cortical Functions , 1995, Annals of the New York Academy of Sciences.

[2]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[3]  S. Courtney,et al.  Attention and cognitive control as emergent properties of information representation in working memory , 2004, Cognitive, affective & behavioral neuroscience.

[4]  T. Sejnowski,et al.  Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex. , 2000, Journal of neurophysiology.

[5]  Roger C. Schank,et al.  SCRIPTS, PLANS, GOALS, AND UNDERSTANDING , 1988 .

[6]  George Houghton,et al.  Parallel Models of Serial Behaviour: Lashley Revisited , 1995 .

[7]  K. Lashley The problem of serial order in behavior , 1951 .

[8]  Donald A. Norman,et al.  Simulating a Skilled Typist: A Study of Skilled Cognitive-Motor Performance , 1982, Cogn. Sci..

[9]  Angela Sirigu,et al.  Perception of action boundaries in patients with frontal lobe damage , 2003, Neuropsychologia.

[10]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[11]  David Zipser,et al.  Recurrent Network Model of the Neural Mechanism of Short-Term Active Memory , 1991, Neural Computation.

[12]  A. Miyake,et al.  Models of Working Memory: Mechanisms of Active Maintenance and Executive Control , 1999 .

[13]  Michael W. Montgomery,et al.  Naturalistic action impairment in closed head injury. , 1998, Neuropsychology.

[14]  J. Tanji Sequential organization of multiple movements: involvement of cortical motor areas. , 2001, Annual review of neuroscience.

[15]  S L Moody,et al.  A Model That Accounts for Activity in Primate Frontal Cortex during a Delayed Matching-to-Sample Task , 1998, The Journal of Neuroscience.

[16]  Matthew M Botvinick,et al.  Short-term memory for serial order: a recurrent neural network model. , 2006, Psychological review.

[17]  Glyn W. Humphreys,et al.  The organization of sequential actions , 2000 .

[18]  A. Seth The ecology of action selection: insights from artificial life , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[19]  James L. McClelland,et al.  Graded state machines: The representation of temporal contingencies in simple recurrent networks , 1991, Machine Learning.

[20]  J. Fuster The Prefrontal Cortex—An Update Time Is of the Essence , 2001, Neuron.

[21]  T. Shallice,et al.  CONTENTION SCHEDULING AND THE CONTROL OF ROUTINE ACTIVITIES , 2000, Cognitive neuropsychology.

[22]  G. Humphreys,et al.  Disordered action schema and action disorganisation syndrome , 1998 .

[23]  G. Micheletti The Prefrontal Cortex. Anatomy, Physiology and Neuropsychology of the Frontal Lobe, Fuster J.M.. Raven Press, New York (1989) , 1989 .

[24]  De Vries Book review: R.C. O'Reilly and Y. Munakata: Computational explorations in cognitive neuroscience: understanding the mind by stimulating the brain. Cambridge, Mass: The MIT Press. , 2002 .

[25]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[26]  Richard A. Andersen,et al.  A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons , 1988, Nature.

[27]  Jun Tani,et al.  How Hierarchical Control Self-organizes in Artificial Adaptive Systems , 2005, Adapt. Behav..

[28]  Geoffrey E. Hinton,et al.  Distributed Representations , 1986, The Philosophy of Artificial Intelligence.

[29]  D. Joel,et al.  The organization of the basal ganglia-thalamocortical circuits: Open interconnected rather than closed segregated , 1994, Neuroscience.

[30]  J. Fuster,et al.  Prefrontal Cortex and the Bridging of Temporal Gaps in the Perception‐Action Cycle , 1990, Annals of the New York Academy of Sciences.

[31]  D. Norman Categorization of action slips. , 1981 .

[32]  S. Grossberg The Adaptive Self-Organization of Serial Order in Behavior: Speech, Language, And Motor Control , 1987 .

[33]  D. Norman,et al.  Attention to action: Willed and automatic control , 1980 .

[34]  Nikolaus R. McFarland,et al.  Striatonigrostriatal Pathways in Primates Form an Ascending Spiral from the Shell to the Dorsolateral Striatum , 2000, The Journal of Neuroscience.

[35]  J. W. Aldridge,et al.  Coding of Serial Order by Neostriatal Neurons: A “Natural Action” Approach to Movement Sequence , 1998, The Journal of Neuroscience.

[36]  D. Zipser,et al.  A spiking network model of short-term active memory , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[37]  D. Plaut,et al.  Such stuff as habits are made on: A reply to Cooper and Shallice (2006). , 2006 .

[38]  Lauren M. Bylsma,et al.  Distraction and action slips in an everyday task: Evidence for a dynamic representation of task context , 2005, Psychonomic bulletin & review.

[39]  E. Koechlin,et al.  The Architecture of Cognitive Control in the Human Prefrontal Cortex , 2003, Science.

[40]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[41]  Jonathan D. Cohen,et al.  A Biologically Based Computational Model of Working Memory , 1999 .

[42]  Thomas E. Hazy,et al.  Banishing the homunculus: Making working memory work , 2006, Neuroscience.

[43]  J. Fuster Upper processing stages of the perception–action cycle , 2004, Trends in Cognitive Sciences.

[44]  Jordan Grafman,et al.  Selective Impairments in Managerial Knowledge Following Pre-Frontal Cortex Damage , 1995, Cortex.

[45]  Axel Cleeremans,et al.  Mechanisms of Implicit Learning: Connectionist Models of Sequence Processing , 1993 .

[46]  Toby Tyrell,et al.  The use of hierarchies for action selection , 1993 .

[47]  J. Fellous,et al.  A role for NMDA-receptor channels in working memory , 1998, Nature Neuroscience.

[48]  P. Redgrave,et al.  The basal ganglia: a vertebrate solution to the selection problem? , 1999, Neuroscience.

[49]  J. Fuster The Prefrontal Cortex , 1997 .

[50]  P. Strick,et al.  Basal ganglia and cerebellar loops: motor and cognitive circuits , 2000, Brain Research Reviews.

[51]  T. Shallice,et al.  Hierarchical schemas and goals in the control of sequential behavior. , 2006, Psychological review.

[52]  Ronald J. Williams,et al.  Gradient-based learning algorithms for recurrent networks and their computational complexity , 1995 .

[53]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[54]  T. Shallice,et al.  The simulation of action disorganisation in complex activities of daily living , 2005, Cognitive neuropsychology.

[55]  Philip E. Agre,et al.  The dynamic structure of everyday life , 1988 .

[56]  Donald A. Norman,et al.  Attention to Action , 1986 .

[57]  D. Plaut,et al.  Doing without schema hierarchies: a recurrent connectionist approach to normal and impaired routine sequential action. , 2004, Psychological review.

[58]  D. Plaut,et al.  Representing task context: proposals based on a connectionist model of action , 2002, Psychological research.

[59]  R. Cooper Mechanisms for the generation and regulation of sequential behaviour , 2003 .

[60]  S P Wise,et al.  Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action. , 1995, Cerebral cortex.

[61]  Stephen Grossberg,et al.  CHAPTER 6 – The Adaptive Self-organization of Serial Order in Behavior: Speech, Language, and Motor Control* , 1986 .

[62]  George Houghton,et al.  The problem of serial order: a neural network model of sequence learning and recall , 1990 .

[63]  Xiaohui Xie,et al.  Equivalence of Backpropagation and Contrastive Hebbian Learning in a Layered Network , 2003, Neural Computation.

[64]  Peter Yule,et al.  The simulation of action in complex activities of daily living , 2005 .

[65]  R. Cooper Tool Use And Related Errors in Ideational Apraxia: the Quantitative Simulation of Patient Error Profiles , 2007, Cortex.

[66]  ZipserDavid Recurrent network model of the neural mechanism of short-term active memory , 1991 .

[67]  Emilio Salinas,et al.  Fast Remapping of Sensory Stimuli onto Motor Actions on the Basis of Contextual Modulation , 2004, The Journal of Neuroscience.