Multiple neuronal circuits for variable object–action choices based on short- and long-term memories

At each time in our life, we choose one or few behaviors, while suppressing many other behaviors. This is the basic mechanism in the basal ganglia, which is done by tonic inhibition and selective disinhibition. Dysfunctions of the basal ganglia then cause 2 types of disorders (difficulty in initiating necessary actions and difficulty in suppressing unnecessary actions) that occur in Parkinson’s disease. The basal ganglia generate such opposite outcomes through parallel circuits: The direct pathway for initiation and indirect pathway for suppression. Importantly, the direct pathway processes good information and the indirect pathway processes bad information, which enables the choice of good behavior and the rejection of bad behavior. This is mainly enabled by dopaminergic inputs to these circuits. However, the value judgment is complex because the world is complex. Sometimes, the value must be based on recent events, thus is based on short-term memories. Or, the value must be based on historical events, thus is based on long-term memories. Such memory-based value judgment is generated by another parallel circuit originating from the caudate head and caudate tail. These circuit-information mechanisms allow other brain areas (e.g., prefrontal cortex) to contribute to decisions by sending information to these basal ganglia circuits. Moreover, the basal ganglia mechanisms (i.e., what to choose) are associated with cerebellum mechanisms (i.e., when to choose). Overall, multiple levels of parallel circuits in and around the basal ganglia are essential for coordinated behaviors. Understanding these circuits is useful for creating clinical treatments of disorders resulting from the failure of these circuits.

[1]  O. Hikosaka,et al.  Indirect pathway from caudate tail mediates rejection of bad objects in periphery , 2019, Science Advances.

[2]  Hyoung F. Kim,et al.  Neuronal connections of direct and indirect pathways for stable value memory in caudal basal ganglia , 2018, The European journal of neuroscience.

[3]  Whitney S. Griggs,et al.  Visual Neurons in the Superior Colliculus Discriminate Many Objects by Their Historical Values , 2018, Front. Neurosci..

[4]  O. Hikosaka,et al.  Amygdala activity for the modulation of goal-directed behavior in emotional contexts , 2018, PLoS biology.

[5]  Hao Li,et al.  Optogenetic Editing Reveals the Hierarchical Organization of Learned Action Sequences , 2018, Cell.

[6]  Hyoung F. Kim,et al.  Indirect Pathway of Caudal Basal Ganglia for Rejection of Valueless Visual Objects , 2017, Neuron.

[7]  Okihide Hikosaka,et al.  To Wait or Not to Wait—Separate Mechanisms in the Oculomotor Circuit of Basal Ganglia , 2017, Front. Neuroanat..

[8]  S. Grillner,et al.  The Basal Ganglia Over 500 Million Years , 2016, Current Biology.

[9]  Ilya E Monosov,et al.  Neurons in the primate dorsal striatum signal the uncertainty of object–reward associations , 2016, Nature Communications.

[10]  Ali Ghazizadeh,et al.  Ecological Origins of Object Salience: Reward, Uncertainty, Aversiveness, and Novelty , 2016, Front. Neurosci..

[11]  Ali Ghazizadeh,et al.  Object-finding skill created by repeated reward experience , 2016, bioRxiv.

[12]  Philipp Sterzer,et al.  Priming in a shape task but not in a category task under continuous flash suppression. , 2016, Journal of vision.

[13]  Hyoung F. Kim,et al.  Dopamine Neurons Encoding Long-Term Memory of Object Value for Habitual Behavior , 2015, Cell.

[14]  O. Hikosaka,et al.  Functional territories in primate substantia nigra pars reticulata separately signaling stable and flexible values. , 2015, Journal of neurophysiology.

[15]  M. Husain,et al.  A dissociation between stopping and switching actions following a lesion of the pre-supplementary motor area , 2015, Cortex.

[16]  Hyoung F. Kim,et al.  Separate groups of dopamine neurons innervate caudate head and tail encoding flexible and stable value memories , 2014, Front. Neuroanat..

[17]  Carol A. Seger,et al.  The visual corticostriatal loop through the tail of the caudate: circuitry and function , 2013, Front. Syst. Neurosci..

[18]  Hyoung F. Kim,et al.  Distinct Basal Ganglia Circuits Controlling Behaviors Guided by Flexible and Stable Values , 2013, Neuron.

[19]  Shinya Yamamoto,et al.  Reward Value-Contingent Changes of Visual Responses in the Primate Caudate Tail Associated with a Visuomotor Skill , 2013, The Journal of Neuroscience.

[20]  Steven S. Vogel,et al.  Concurrent Activation of Striatal Direct and Indirect Pathways During Action Initiation , 2013, Nature.

[21]  O. Hikosaka,et al.  Robust Representation of Stable Object Values in the Oculomotor Basal Ganglia , 2012, The Journal of Neuroscience.

[22]  Ilya E. Monosov,et al.  What and Where Information in the Caudate Tail Guides Saccades to Visual Objects , 2012, The Journal of Neuroscience.

[23]  A. Nambu,et al.  Immunotoxin-Mediated Tract Targeting in the Primate Brain: Selective Elimination of the Cortico-Subthalamic “Hyperdirect” Pathway , 2012, PloS one.

[24]  S. Grillner,et al.  Evolutionary Conservation of the Basal Ganglia as a Common Vertebrate Mechanism for Action Selection , 2011, Current Biology.

[25]  Masaya Segawa,et al.  Initiation and inhibitory control of saccades with the progression of Parkinson's disease – Changes in three major drives converging on the superior colliculus , 2011, Neuropsychologia.

[26]  Simon Hong,et al.  Dopamine-Mediated Learning and Switching in Cortico-Striatal Circuit Explain Behavioral Changes in Reinforcement Learning , 2011, Front. Behav. Neurosci..

[27]  Guy M McKhann,et al.  Regulation of parkinsonian motor behaviors by optogenetic control of Basal Ganglia circuitry. , 2010, Neurosurgery.

[28]  Anatol C. Kreitzer,et al.  Regulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitry , 2010, Nature.

[29]  O. Hikosaka,et al.  Two types of dopamine neuron distinctly convey positive and negative motivational signals , 2009, Nature.

[30]  O. Hikosaka,et al.  Role for Subthalamic Nucleus Neurons in Switching from Automatic to Controlled Eye Movement , 2008, The Journal of Neuroscience.

[31]  Hitoshi Kita,et al.  Motor cortical control of internal pallidal activity through glutamatergic and GABAergic inputs in awake monkeys , 2007, The European journal of neuroscience.

[32]  Anders M. Dale,et al.  Three-Dimensional Atlas System for Mouse and Rat Brain Imaging Data , 2007, Frontiers Neuroinformatics.

[33]  B. Pakkenberg,et al.  Neocortical and hippocampal neuron and glial cell numbers in the rhesus monkey , 2007, Anatomical record.

[34]  O. Hikosaka,et al.  Switching from automatic to controlled action by monkey medial frontal cortex , 2007, Nature Neuroscience.

[35]  Kae Nakamura,et al.  Role of Dopamine in the Primate Caudate Nucleus in Reward Modulation of Saccades , 2006, The Journal of Neuroscience.

[36]  Kae Nakamura,et al.  Basal ganglia orient eyes to reward. , 2006, Journal of neurophysiology.

[37]  G. Pari,et al.  Deficits in saccadic eye-movement control in Parkinson's disease , 2005, Neuropsychologia.

[38]  Kae Nakamura,et al.  Emergence of rhythm during motor learning , 2004, Trends in Cognitive Sciences.

[39]  H. Kita,et al.  Role of ionotropic glutamatergic and GABAergic inputs on the firing activity of neurons in the external pallidum in awake monkeys. , 2004, Journal of neurophysiology.

[40]  Jonathan D. Cohen,et al.  Computational roles for dopamine in behavioural control , 2004, Nature.

[41]  L. Tremblay,et al.  Behavioural disorders induced by external globus pallidus dysfunction in primates II. Anatomical study. , 2004, Brain : a journal of neurology.

[42]  O. Hikosaka,et al.  Reward-predicting activity of dopamine and caudate neurons--a possible mechanism of motivational control of saccadic eye movement. , 2004, Journal of neurophysiology.

[43]  Masaya Segawa,et al.  Abnormalities of voluntary saccades in Gilles de la Tourette's syndrome: pathophysiological consideration , 2003, Brain and Development.

[44]  D. Sparks The brainstem control of saccadic eye movements , 2002, Nature Reviews Neuroscience.

[45]  O. Hikosaka,et al.  Differential activation of monkey striatal neurons in the early and late stages of procedural learning , 2002, Experimental Brain Research.

[46]  O. Hikosaka,et al.  A neural correlate of response bias in monkey caudate nucleus , 2002, Nature.

[47]  P. Strick,et al.  Imaging the premotor areas , 2001, Current Opinion in Neurobiology.

[48]  M. Hayhoe,et al.  In what ways do eye movements contribute to everyday activities? , 2001, Vision Research.

[49]  M. Lidow,et al.  Primates exposed to cocaine in utero display reduced density and number of cerebral cortical neurons , 2001, The Journal of comparative neurology.

[50]  H. Kita,et al.  Excitatory Cortical Inputs to Pallidal Neurons Via the Subthalamic Nucleus in the Monkey , 2000 .

[51]  M. Morris Movement disorders in people with Parkinson disease: a model for physical therapy. , 2000, Physical therapy.

[52]  O. Hikosaka,et al.  What and When: Parallel and Convergent Processing in Motor Control , 2000, The Journal of Neuroscience.

[53]  O Hikosaka,et al.  Neural Representation of a Rhythm Depends on Its Interval Ratio , 1999, The Journal of Neuroscience.

[54]  K. Doya,et al.  Parallel neural networks for learning sequential procedures , 1999, Trends in Neurosciences.

[55]  O Hikosaka,et al.  Effects of local inactivation of monkey medial frontal cortex in learning of sequential procedures. , 1999, Journal of neurophysiology.

[56]  Kae Nakamura,et al.  Neuronal activity in medial frontal cortex during learning of sequential procedures. , 1998, Journal of neurophysiology.

[57]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[58]  O. Hikosaka,et al.  Role of monkey cerebellar nuclei in skill for sequential movement. , 1998, Journal of neurophysiology.

[59]  S. Grillner,et al.  Intrinsic function of a neuronal network — a vertebrate central pattern generator 1 Published on the World Wide Web on 8 April 1998. 1 , 1998, Brain Research Reviews.

[60]  O. Hikosaka,et al.  Transition of Brain Activation from Frontal to Parietal Areas in Visuomotor Sequence Learning , 1998, The Journal of Neuroscience.

[61]  O. Hikosaka,et al.  Differential roles of monkey striatum in learning of sequential hand movement , 1997, Experimental Brain Research.

[62]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[63]  O. Hikosaka,et al.  Anticipatory saccades in sequential procedural learning in monkeys. , 1996, Journal of neurophysiology.

[64]  O. Hikosaka,et al.  Activation of human presupplementary motor area in learning of sequential procedures: a functional MRI study. , 1996, Journal of neurophysiology.

[65]  Andrew N. Rowan Guide for the Care and Use of Laboratory Animals , 1996 .

[66]  O. Hikosaka,et al.  Learning of sequential movements in the monkey: process of learning and retention of memory. , 1995, Journal of neurophysiology.

[67]  V. Brown,et al.  Responses of cells in the tail of the caudate nucleus during visual discrimination learning. , 1995, Journal of neurophysiology.

[68]  O. Hikosaka,et al.  Voluntary Saccades in Normal and in Dopamine-Deficient Subjects , 1995 .

[69]  O. Hikosaka,et al.  Eye movements in monkeys with local dopamine depletion in the caudate nucleus. I. Deficits in spontaneous saccades , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[70]  M. Glickstein,et al.  Paradoxical movement in Parkinson's disease , 1991, Trends in Neurosciences.

[71]  H. Kita,et al.  Intracellular study of rat entopeduncular nucleus neurons in an in vitro slice preparation: response to subthalamic stimulation , 1991, Brain Research.

[72]  Leslie G. Ungerleider,et al.  Organization of visual cortical inputs to the striatum and subsequent outputs to the pallido‐nigral complex in the monkey , 1990, The Journal of comparative neurology.

[73]  G. E. Alexander,et al.  Functional architecture of basal ganglia circuits: neural substrates of parallel processing , 1990, Trends in Neurosciences.

[74]  J. Penney,et al.  The functional anatomy of basal ganglia disorders , 1989, Trends in Neurosciences.

[75]  S. Keele,et al.  Timing Functions of The Cerebellum , 1989, Journal of Cognitive Neuroscience.

[76]  O. Hikosaka,et al.  Eye movements induced by microinjection of GABA agonist in the rat substantia nigra pars reticulata , 1989, Neuroscience Research.

[77]  A K Moschovakis,et al.  Nigral inhibitory termination on efferent neurons of the superior colliculus: An intracellular horseradish peroxidase study in the cat , 1985, The Journal of comparative neurology.

[78]  J. Deniau,et al.  Disinhibition as a basic process in the expression of striatal functions. I. The striato-nigral influence on tecto-spinal/tecto-diencephalic neurons , 1985, Brain Research.

[79]  W. Fries Cortical projections to the superior colliculus in the macaque monkey: A retrograde study using horseradish peroxidase , 1984, The Journal of comparative neurology.

[80]  J. Yelnik,et al.  Localization of nigrostriatal, nigrothalamic and nigrotectal neurons in ventricular coordinates in macaques , 1984, Neuroscience.

[81]  R. Wurtz,et al.  Visual and oculomotor functions of monkey substantia nigra pars reticulata. IV. Relation of substantia nigra to superior colliculus. , 1983, Journal of neurophysiology.

[82]  R. Wurtz,et al.  Visual and oculomotor functions of monkey substantia nigra pars reticulata. III. Memory-contingent visual and saccade responses. , 1983, Journal of neurophysiology.

[83]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[84]  E. Keller Participation of medial pontine reticular formation in eye movement generation in monkey. , 1974, Journal of neurophysiology.

[85]  L. Standing Learning 10000 pictures , 1973 .

[86]  D. Robinson Eye movements evoked by collicular stimulation in the alert monkey. , 1972, Vision research.

[87]  O. Hikosaka,et al.  Effects of caudate nucleus stimulation on substantia nigra cell activity in monkey , 2004, Experimental Brain Research.

[88]  O. Hikosaka,et al.  Long-term retention of motor skill in macaque monkeys and humans , 2002, Experimental Brain Research.

[89]  O. Hikosaka,et al.  Modulation of saccadic eye movements by predicted reward outcome , 2001, Experimental Brain Research.

[90]  Miya K. Rand,et al.  Characteristics of sequential movements during early learning period in monkeys , 2000, Experimental Brain Research.

[91]  Y. Smith,et al.  Microcircuitry of the direct and indirect pathways of the basal ganglia. , 1998, Neuroscience.

[92]  P. Strick,et al.  Dentate output channels: motor and cognitive components. , 1997, Progress in brain research.

[93]  P. Strick,et al.  Chapter 32 Dentate output channels: motor and cognitive components , 1997 .

[94]  R. Wurtz,et al.  Modification of saccadic eye movements by GABA-related substances. II. Effects of muscimol in monkey substantia nigra pars reticulata. , 1985, Journal of neurophysiology.

[95]  J. E. Albano,et al.  Visual-motor function of the primate superior colliculus. , 1980, Annual review of neuroscience.