The Goal Circuit Model: A Hierarchical Multi-Route Model of the Acquisition and Control of Routine Sequential Action in Humans

Human control of action in routine situations involves a flexible interplay between (a) task-dependent serial ordering constraints; (b) top-down, or intentional, control processes; and (c) bottom-up, or environmentally triggered, affordances. In addition, the interaction between these influences is modulated by learning mechanisms that, over time, appear to reduce the need for top-down control processes while still allowing those processes to intervene at any point if necessary or if desired. We present a model of the acquisition and control of goal-directed action that goes beyond existing models by operationalizing an interface between two putative systems-a routine and a non-routine system-thereby demonstrating how explicitly represented goals can interact with the emergent task representations that develop through learning in the routine system. The gradual emergence of task representations offers an explanation for the transfer of control with experience from the non-routine goal-based system to the routine system. At the same time it allows action selection to be sensitive both to environmental triggers and to biasing from multiple levels within the goal system.

[1]  Tirin Moore,et al.  A map of complex movements in motor cortex of primates , 2004 .

[2]  T. Shallice,et al.  Hierarchical schemas and goals in the control of sequential behavior. , 2006, Psychological review.

[3]  Ronald J. Williams,et al.  Gradient-based learning algorithms for recurrent networks and their computational complexity , 1995 .

[4]  Isabelle Rouleau,et al.  Frontal lesions impair the attentional control of movements during motor learning , 1999, Neuropsychologia.

[5]  Christian Montag,et al.  Imaging the structure of the human anxious brain: a review of findings from neuroscientific personality psychology , 2013, Reviews in the neurosciences.

[6]  Michael W. Montgomery,et al.  Naturalistic action impairment in closed head injury. , 1998, Neuropsychology.

[7]  James L. McClelland,et al.  Generalization with Componential Attractors: Word and Nonword Reading in an Attractor Network , 1993 .

[8]  D. Norman,et al.  Attention to Action: Willed and Automatic Control of Behavior Technical Report No. 8006. , 1980 .

[9]  H. Heckhausen,et al.  Intentional action and action slips. , 1990 .

[10]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[11]  T. Shallice,et al.  The origins of utilization behaviour. , 1989, Brain : a journal of neurology.

[12]  J. Gregory Trafton,et al.  Memory for goals: an activation-based model , 2002, Cogn. Sci..

[13]  Tim Shallice,et al.  The domain of supervisory processes and the temporal organisation of behaviour , 1998 .

[14]  W. N. Schoenfeld,et al.  Principles of Psychology , 2007 .

[15]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[16]  Daniel Dennett,et al.  Language and thought: Reflections on language and mind , 1998 .

[17]  D. Glasspool The Integration and Control of Behaviour: Insights from Neuroscience and AI , 2005 .

[18]  三嶋 博之 The theory of affordances , 2008 .

[19]  Denis Mareschal,et al.  Action selection in complex routinized sequential behaviors. , 2010, Journal of experimental psychology. Human perception and performance.

[20]  Richard S. J. Frackowiak,et al.  Anatomy of motor learning. I. Frontal cortex and attention to action. , 1997, Journal of neurophysiology.

[21]  Glyn W. Humphreys,et al.  The organization of sequential actions , 2000 .

[22]  A. Battersby Plans and the Structure of Behavior , 1968 .

[23]  Umberto Castiello,et al.  A neuroimaging study of selection-for-action: A reach-to-grasp study , 2004 .

[24]  Tim Shallice,et al.  Fractionation of the supervisory system. , 2002 .

[25]  Michael W. Montgomery,et al.  The quantitative description of action disorganisation after brain damage: a case study , 1991 .

[26]  Zoubin Ghahramani,et al.  Computational principles of movement neuroscience , 2000, Nature Neuroscience.

[27]  D. Norman Categorization of action slips. , 1981 .

[28]  Richard P. Cooper,et al.  A Systematic Methodology for Cognitive Modelling , 1996, Artif. Intell..

[29]  Richard J. Brown Neuropsychology Mental Structure , 1989 .

[30]  Tim Shallice,et al.  Contrasting domains in the control of action: the routine and the non-routine. , 2005 .

[31]  F. Lhermitte 'Utilization behaviour' and its relation to lesions of the frontal lobes. , 1983, Brain : a journal of neurology.

[32]  D. Mareschal,et al.  A REINFORCEMENT MODEL OF SEQUENTIAL ROUTINE ACTION , 2005 .

[33]  D. Plaut,et al.  Such stuff as habits are made on: A reply to Cooper and Shallice (2006). , 2006 .

[34]  Lauren M. Bylsma,et al.  Distraction and action slips in an everyday task: Evidence for a dynamic representation of task context , 2005, Psychonomic bulletin & review.

[35]  Jonathan D. Cohen,et al.  On the Control of Control: The Role of Dopamine in Regulating Prefrontal Function and Working Memory , 2007 .

[36]  E. Koechlin,et al.  The Architecture of Cognitive Control in the Human Prefrontal Cortex , 2003, Science.

[37]  Terence W. Picton,et al.  Mapping Task Switching in Frontal Cortex Through Neuropsychological Group Studies , 2008, Front. Neurosci..

[38]  G. Miller,et al.  Plans and the structure of behavior , 1960 .

[39]  T. Shallice,et al.  CONTENTION SCHEDULING AND THE CONTROL OF ROUTINE ACTIVITIES , 2000, Cognitive neuropsychology.

[40]  D. Plaut,et al.  Doing without schema hierarchies: a recurrent connectionist approach to normal and impaired routine sequential action. , 2004, Psychological review.

[41]  Rodney A. Brooks,et al.  How to Build Complete Creatures Rather than Isolated Cognitive Simulators , 2014 .

[42]  J. Shaoul Human Error , 1973, Nature.

[43]  G. Goldberg,et al.  Medial frontal cortex infarction and the alien hand sign. , 1981, Archives of neurology.

[44]  M. Conway Verifying autobiographical facts , 1987, Cognition.

[45]  A. Dickinson Actions and habits: the development of behavioural autonomy , 1985 .

[46]  David Glasspool,et al.  Learning Action Affordances and Action Schemas , 2000, NCPW.

[47]  Raj M. Ratwani,et al.  A memory for goals model of sequence errors , 2011, Cognitive Systems Research.

[48]  L. Buxbaum,et al.  The Coffee Challenge: A new method for the study of everyday action errors , 2007, Journal of clinical and experimental neuropsychology.

[49]  D. Brooks,et al.  Motor sequence learning: a study with positron emission tomography , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[50]  J. Duncan Disorganisation of behaviour after frontal lobe damage , 1986 .

[51]  M. Botvinick,et al.  Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective , 2009, Cognition.

[52]  James B. Rowe,et al.  Prefrontal cortex and attention to action , 2005 .

[53]  D. Spalding The Principles of Psychology , 1873, Nature.

[54]  A. Luria Higher Cortical Functions in Man , 1980, Springer US.

[55]  T Shallice,et al.  The domain of supervisory processes and temporal organization of behaviour. , 1996, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[56]  G. Humphreys,et al.  Visual affordances direct action: neuropsychological evidence from manual interference. , 1998, Cognitive neuropsychology.

[57]  G. Humphreys,et al.  Disordered action schema and action disorganisation syndrome , 1998 .

[58]  Bernhard Hommel,et al.  Planning and Representing Intentional Action , 2003, TheScientificWorldJournal.

[59]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[60]  Donald G. MacKay,et al.  The organization of perception and action. A theory for language and other cognitive skills , 1987, The Italian Journal of Neurological Sciences.

[61]  Jordan Grafman,et al.  Procedural learning is impaired in patients with prefrontal lesions , 1999, Neurology.

[62]  J. Reason Actions not as planned : The price of automatisation , 1979 .

[63]  T. Shallice,et al.  The Organisation of Mind , 2011, Cortex.

[64]  H. Spinnler,et al.  Right-sided anarchic (alien) hand: A longitudinal study , 1991, Neuropsychologia.

[65]  John R. Anderson,et al.  The acquisition of robust and flexible cognitive skills. , 2008, Journal of experimental psychology. General.

[66]  T. Shallice,et al.  The simulation of action disorganisation in complex activities of daily living , 2005, Cognitive neuropsychology.

[67]  Pat Langley,et al.  Ability, Breadth, and Parsimony in Computational Models of Higher-Order Cognition , 2008, Cogn. Sci..

[68]  B. Balleine,et al.  The Role of Learning in the Operation of Motivational Systems , 2002 .

[69]  David T. Neal,et al.  A new look at habits and the habit-goal interface. , 2007, Psychological review.

[70]  John R. Anderson,et al.  From recurrent choice to skill learning: a reinforcement-learning model. , 2006, Journal of experimental psychology. General.

[71]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.