Mechanisms of Action Selection and Timing in Substantia Nigra Neurons

The timing of actions is critical for adaptive behavior. In this study we measured neural activity in the substantia nigra as mice learned to change their action duration to earn food rewards. We observed dramatic changes in single unit activity during learning: both dopaminergic and GABAergic neurons changed their activity in relation to behavior to reflect the learned instrumental contingency and the action duration. We found the emergence of “action-on” neurons that increased firing for the duration of the lever press and mirror-image “action-off” neurons that paused at the same time. This pattern is especially common among GABAergic neurons. The activity of many neurons also reflected confidence about the just completed action and the prospect of reward. Being correlated with the relative duration of the completed action, their activity could predict the likelihood of reward collection. Compared with the GABAergic neurons, the activity of dopaminergic neurons was more commonly modulated by the discriminative stimulus signaling the start of each trial, suggesting that their phasic activity reflected sensory salience rather than any reward prediction error found in previous work. In short, these results suggest that (1) nigral activity is highly plastic and modified by the learning of the instrumental contingency; (2) GABAergic output from the substantia nigra can simultaneously inhibit and disinhibit downstream structures, while the dopaminergic output also provide bidirectional modulation of the corticostriatal circuits; (3) dopaminergic and GABAergic neurons show similar task-related activity, although DA neurons are more responsive to the trial start signal.

[1]  Bence P Ölveczky,et al.  Motoring ahead with rodents , 2011, Current Opinion in Neurobiology.

[2]  O Hikosaka,et al.  GABAergic output of the basal ganglia. , 2007, Progress in brain research.

[3]  A. Grace,et al.  Intracellular and extracellular electrophysiology of nigral dopaminergic neurons—1. Identification and characterization , 1983, Neuroscience.

[4]  Shigeru Shinomoto,et al.  Kernel bandwidth optimization in spike rate estimation , 2009, Journal of Computational Neuroscience.

[5]  J. Krakauer,et al.  Are We Ready for a Natural History of Motor Learning? , 2011, Neuron.

[6]  P. Redgrave,et al.  Is the short-latency dopamine response too short to signal reward error? , 1999, Trends in Neurosciences.

[7]  S. Grillner,et al.  Mechanisms for selection of basic motor programs – roles for the striatum and pallidum , 2005, Trends in Neurosciences.

[8]  B. Balleine,et al.  Reward‐guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico‐basal ganglia networks , 2008, The European journal of neuroscience.

[9]  J. Bolam,et al.  Structural correlates of heterogeneous in vivo activity of midbrain dopaminergic neurons , 2012, Nature Neuroscience.

[10]  Stanislav Herwik,et al.  A Wireless Multi-Channel Recording System for Freely Behaving Mice and Rats , 2011, PloS one.

[11]  Michael S. Brainard,et al.  Central Contributions to Acoustic Variation in Birdsong , 2008, The Journal of Neuroscience.

[12]  M. Shadlen,et al.  Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex , 2009, Science.

[13]  A. Nambu,et al.  Functional significance of the cortico–subthalamo–pallidal ‘hyperdirect’ pathway , 2002, Neuroscience Research.

[14]  C. Gerfen The neostriatal mosaic: multiple levels of compartmental organization in the basal ganglia. , 1992, Annual review of neuroscience.

[15]  W. Precht The synaptic organization of the brain G.M. Shepherd, Oxford University Press (1975). 364 pp., £3.80 (paperback) , 1976, Neuroscience.

[16]  Peter Redgrave,et al.  Basal Ganglia , 2020, Encyclopedia of Autism Spectrum Disorders.

[17]  Hatim A. Zariwala,et al.  Neural correlates, computation and behavioural impact of decision confidence , 2008, Nature.

[18]  Rafael Malach,et al.  Invariance of firing rate and field potential dynamics to stimulus modulation rate in human auditory cortex , 2011, Human brain mapping.

[19]  J. Tanji,et al.  Interval time coding by neurons in the presupplementary and supplementary motor areas , 2009, Nature Neuroscience.

[20]  J R Platt,et al.  Rats' lever-press durations as psychophysical judgements of time. , 1973, Journal of the experimental analysis of behavior.

[21]  G. Shepherd The Synaptic Organization of the Brain , 1979 .

[22]  W. Brown Animal Intelligence: Experimental Studies , 1912, Nature.

[23]  O. Hikosaka,et al.  Role of the basal ganglia in the control of purposive saccadic eye movements. , 2000, Physiological reviews.

[24]  M. A. Basso,et al.  Neuronal Activity in Substantia Nigra Pars Reticulata during Target Selection , 2002, The Journal of Neuroscience.

[25]  J. Bolam,et al.  Synaptic organisation of the basal ganglia , 2000, Journal of anatomy.

[26]  O. Hikosaka,et al.  Two types of dopamine neuron distinctly convey positive and negative motivational signals , 2009, Nature.

[27]  M. Abeles Quantification, smoothing, and confidence limits for single-units' histograms , 1982, Journal of Neuroscience Methods.

[28]  R. Wurtz,et al.  Visual and oculomotor functions of monkey substantia nigra pars reticulata. I. Relation of visual and auditory responses to saccades. , 1983, Journal of neurophysiology.

[29]  A. D. Smith,et al.  The substantia nigra as a site of synaptic integration of functionally diverse information arising from the ventral pallidum and the globus pallidus in the rat , 1996, Neuroscience.

[30]  M. Nicolelis,et al.  Differential Corticostriatal Plasticity during Fast and Slow Motor Skill Learning in Mice , 2004, Current Biology.

[31]  W. Smith The Integrative Action of the Nervous System , 1907, Nature.

[32]  A. Cooper,et al.  Predictive Reward Signal of Dopamine Neurons , 2011 .

[33]  Michale S Fee,et al.  A basal ganglia-forebrain circuit in the songbird biases motor output to avoid vocal errors , 2009, Proceedings of the National Academy of Sciences.

[34]  B. Roche,et al.  The Behavior of Organisms? , 1997 .

[35]  Y. Smith,et al.  Convergence of synaptic terminals from the striatum and the globus pallidus onto single neurones in the substantia nigra and the entopeduncular nucleus. , 1993, Progress in Brain Research.

[36]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[37]  D. Lovinger,et al.  Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill , 2009, Nature Neuroscience.

[38]  Michael S. Brainard,et al.  Auditory feedback in learning and maintenance of vocal behaviour , 2000, Nature Reviews Neuroscience.

[39]  H. Yin The Sensorimotor Striatum Is Necessary for Serial Order Learning , 2010, The Journal of Neuroscience.

[40]  P. Redgrave,et al.  The basal ganglia: a vertebrate solution to the selection problem? , 1999, Neuroscience.

[41]  W. Precht,et al.  Monosynaptic inhibition of neurons of the substantia nigra by caudato-nigral fibers. , 1971, Brain research.

[42]  M. Georger,et al.  Disruption of acquisition and performance of operant response-duration differentiation by unilateral nigrostriatal lesions , 2000, Behavioural Brain Research.

[43]  Henry H. Yin,et al.  The Role of the Murine Motor Cortex in Action Duration and Order , 2009, Front. Integr. Neurosci..

[44]  H. Yin,et al.  The role of the basal ganglia in habit formation , 2006, Nature Reviews Neuroscience.

[45]  D. Joel,et al.  The connections of the dopaminergic system with the striatum in rats and primates: an analysis with respect to the functional and compartmental organization of the striatum , 2000, Neuroscience.

[46]  M D Zeiler,et al.  Pure timing in temporal differentiation. , 1985, Journal of the experimental analysis of behavior.

[47]  H. Yin,et al.  The Role of Mediodorsal Thalamus in Temporal Differentiation of Reward-Guided Actions , 2010, Front. Integr. Neurosci..

[48]  C. Koch,et al.  On the origin of the extracellular action potential waveform: A modeling study. , 2006, Journal of neurophysiology.

[49]  P. Redgrave,et al.  A direct projection from superior colliculus to substantia nigra pars compacta in the cat , 2006, Neuroscience.

[50]  E. Miller,et al.  Microstimulation of Frontal Cortex Can Reorder a Remembered Spatial Sequence , 2006, PLoS biology.

[51]  J. Tepper,et al.  GABAergic control of substantia nigra dopaminergic neurons. , 2007, Progress in brain research.

[52]  Okihide Hikosaka Role of basal ganglia in saccades. , 1989, Revue neurologique.

[53]  E. Thorndike Animal Intelligence; Experimental Studies , 2009 .