Goal-direction and top-down control

We review the neural mechanisms that support top-down control of behaviour and suggest that goal-directed behaviour uses two systems that work in concert. A basal ganglia-centred system quickly learns simple, fixed goal-directed behaviours while a prefrontal cortex-centred system gradually learns more complex (abstract or long-term) goal-directed behaviours. Interactions between these two systems allow top-down control mechanisms to learn how to direct behaviour towards a goal but also how to guide behaviour when faced with a novel situation.

[1]  K. Pribram,et al.  Effects on delayed-response performance of lesions of dorsolateral and ventromedial frontal cortex of baboons. , 1952, Journal of comparative and physiological psychology.

[2]  H. E. Rosvold,et al.  Behavioral effects of selective ablation of the caudate nucleus. , 1967, Journal of comparative and physiological psychology.

[3]  B. Milner,et al.  Further analysis of the hippocampal amnesic syndrome: 14-year follow-up study of H.M.☆ , 1968 .

[4]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[5]  H. E. Rosvold,et al.  The effects of selective caudate lesions in infant and juvenile Rhesus monkeys. , 1972, Brain research.

[6]  J. Glowinski,et al.  Dopaminergic Terminals in the Rat Cortex , 1973, Science.

[7]  P. Goldman-Rakic,et al.  Direct and indirect pathways from the amygdala to the frontal lobe in rhesus monkeys , 1981, The Journal of comparative neurology.

[8]  D. Amaral,et al.  Amygdalo‐cortical projections in the monkey (Macaca fascicularis) , 1984, The Journal of comparative neurology.

[9]  P. Goldman-Rakic,et al.  Longitudinal topography and interdigitation of corticostriatal projections in the rhesus monkey , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  D. Amaral.  Amygdalohippocampal and amygdalocortical projections in the primate brain. , 1986, Advances in experimental medicine and biology.

[11]  P. Goldman-Rakic.  Topography of cognition: parallel distributed networks in primate association cortex. , 1988, Annual review of neuroscience.

[12]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[13]  D. Pandya,et al.  Architecture and intrinsic connections of the prefrontal cortex in the rhesus monkey , 1989, The Journal of comparative neurology.

[14]  H. Barbas,et al.  Projections from the amygdala to basoventral and mediodorsal prefrontal regions in the rhesus monkey , 1990, The Journal of comparative neurology.

[15]  D. Pandya,et al.  Prefrontal cortex in relation to other cortical areas in rhesus monkey: architecture and connections. , 1990, Progress in brain research.

[16]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[17]  P. Calabresi,et al.  Coactivation of D1 and D2 dopamine receptors is required for long-term synaptic depression in the striatum , 1992, Neuroscience Letters.

[18]  W. Schultz,et al.  Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  S. Haber,et al.  The organization of midbrain projections to the striatum in the primate: Sensorimotor-related striatum versus ventral striatum , 1994, Neuroscience.

[20]  A. Graybiel,et al.  Highly restricted origin of prefrontal cortical inputs to striosomes in the macaque monkey , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[21]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[22]  S. Kosslyn,et al.  Topographical representations of mental images in primary visual cortex , 1995, Nature.

[23]  S P Wise,et al.  Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action. , 1995, Cerebral cortex.

[24]  M. Mishkin,et al.  Responses of cells in the tail of the caudate nucleus during visual discrimination learning. , 1995, Journal of neurophysiology.

[25]  R. Desimone,et al.  Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque , 1996, The Journal of Neuroscience.

[26]  W. Schultz.  Dopamine neurons and their role in reward mechanisms , 1997, Current Opinion in Neurobiology.

[27]  P. Goldman-Rakic,et al.  Differential Activation of the Caudate Nucleus in Primates Performing Spatial and Nonspatial Working Memory Tasks , 1997, The Journal of Neuroscience.

[28]  P. Calabresi,et al.  Synaptic plasticity and physiological interactions between dopamine and glutamate in the striatum , 1997, Neuroscience & Biobehavioral Reviews.

[29]  O. Hikosaka,et al.  Differential roles of monkey striatum in learning of sequential hand movement , 1997, Experimental Brain Research.

[30]  E. Miller,et al.  Neural Activity in the Primate Prefrontal Cortex during Associative Learning , 1998, Neuron.

[31]  S. Wise,et al.  Rule-dependent neuronal activity in the prefrontal cortex , 1999, Experimental Brain Research.

[32]  D. Pandya,et al.  Dorsolateral prefrontal cortex: comparative cytoarchitectonic analysis in the human and the macaque brain and corticocortical connection patterns , 1999, The European journal of neuroscience.

[33]  E. Miller,et al.  Prospective Coding for Objects in Primate Prefrontal Cortex , 1999, The Journal of Neuroscience.

[34]  E. Miller,et al.  Task-specific neural activity in the primate prefrontal cortex. , 2000, Journal of neurophysiology.

[35]  J. Wickens,et al.  Dopamine D-1/D-5 receptor activation is required for long-term potentiation in the rat neostriatum in vitro. , 2001, Journal of neurophysiology.

[36]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[37]  David J. Freedman,et al.  Categorical representation of visual stimuli in the primate prefrontal cortex. , 2001, Science.

[38]  K. C. Anderson,et al.  Single neurons in prefrontal cortex encode abstract rules , 2001, Nature.

[39]  David J. Freedman,et al.  Representation of the Quantity of Visual Items in the Primate Prefrontal Cortex , 2002, Science.

[40]  Satoru Otani,et al.  Long-term potentiation in rat prefrontal slices facilitated by phased application of dopamine. , 2002, European journal of pharmacology.

[41]  Timothy Edward John Behrens,et al.  Quantitative Investigation of Connections of the Prefrontal Cortex in the Human and Macaque using Probabilistic Diffusion Tractography , 2005, The Journal of Neuroscience.

[42]  A. Graybiel,et al.  Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories , 2005, Nature.

[43]  E. Miller,et al.  Different time courses of learning-related activity in the prefrontal cortex and striatum , 2005, Nature.

[44]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[45]  Keiji Tanaka,et al.  Prefrontal Cell Activities Related to Monkeys' Success and Failure in Adapting to Rule Changes in a Wisconsin Card Sorting Test Analog , 2006, The Journal of Neuroscience.

[46]  H. Yin,et al.  The role of the basal ganglia in habit formation , 2006, Nature Reviews Neuroscience.

[47]  Matthijs A. A. van der Meer,et al.  Integrating hippocampus and striatum in decision-making , 2007, Current Opinion in Neurobiology.

[48]  E. Miller,et al.  Response to Comment on "Top-Down Versus Bottom-Up Control of Attention in the Prefrontal and Posterior Parietal Cortices" , 2007, Science.

[49]  J. Tanji,et al.  Categorization of behavioural sequences in the prefrontal cortex , 2007, Nature.

[50]  Matthew A. Wilson,et al.  Hippocampal Replay of Extended Experience , 2009, Neuron.

[51]  E. Miller,et al.  Serial, Covert Shifts of Attention during Visual Search Are Reflected by the Frontal Eye Fields and Correlated with Population Oscillations , 2009, Neuron.

[52]  Karl J. Friston,et al.  The mismatch negativity: A review of underlying mechanisms , 2009, Clinical Neurophysiology.

[53]  Xiao-Jing Wang,et al.  Internal Representation of Task Rules by Recurrent Dynamics: The Importance of the Diversity of Neural Responses , 2010, Front. Comput. Neurosci..

[54]  Andreas Nieder,et al.  Basic mathematical rules are encoded by primate prefrontal cortex neurons , 2010, Proceedings of the National Academy of Sciences.

[55]  Earl K. Miller,et al.  Shifting the Spotlight of Attention: Evidence for Discrete Computations in Cognition , 2010, Front. Hum. Neurosci..

[56]  Markus Siegel,et al.  Neural substrates of cognitive capacity limitations , 2011, Proceedings of the National Academy of Sciences.

[57]  R. Schubotz,et al.  Caudate Nucleus Signals for Breaches of Expectation in a Movement Observation Paradigm , 2011, Front. Hum. Neurosci..

[58]  E. Miller,et al.  Differences between Neural Activity in Prefrontal Cortex and Striatum during Learning of Novel Abstract Categories , 2011, Neuron.

[59]  Eric L. Denovellis,et al.  Synchronous Oscillatory Neural Ensembles for Rules in the Prefrontal Cortex , 2012, Neuron.

[60]  Karl J. Friston,et al.  Canonical Microcircuits for Predictive Coding , 2012, Neuron.

[61]  H. Seo,et al.  Neural basis of reinforcement learning and decision making. , 2012, Annual review of neuroscience.

[62]  N. Sigala,et al.  Dynamic Coding for Cognitive Control in Prefrontal Cortex , 2013, Neuron.

[63]  Chung-Hay Luk,et al.  Choice Coding in Frontal Cortex during Stimulus-Guided or Action-Guided Decision-Making , 2013, The Journal of Neuroscience.

[64]  Kyle S. Smith,et al.  A dual operator view of habitual behavior reflecting cortical and striatal dynamics. , 2013, Neuron.

[65]  Xiao-Jing Wang,et al.  The importance of mixed selectivity in complex cognitive tasks , 2013, Nature.

[66]  Thomas H. B. FitzGerald,et al.  Disruption of Dorsolateral Prefrontal Cortex Decreases Model-Based in Favor of Model-free Control in Humans , 2013, Neuron.

[67]  Junying Yuan,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2022 .