A basal ganglia-forebrain circuit in the songbird biases motor output to avoid vocal errors

In songbirds, as in mammals, basal ganglia-forebrain circuits are necessary for the learning and production of complex motor behaviors; however, the precise role of these circuits remains unknown. It has recently been shown that a basal ganglia-forebrain circuit in the songbird, which projects directly to vocal–motor circuitry, has a premotor function driving exploration necessary for vocal learning. It has also been hypothesized that this circuit, known as the anterior forebrain pathway (AFP), may generate an instructive signal that improves performance in the motor pathway. Here, we show that the output of the AFP directly implements a motor correction that reduces vocal errors. We use disruptive auditory feedback, contingent on song pitch, to induce learned changes in song structure over the course of hours and find that reversible inactivation of the output of the AFP produces an immediate regression of these learned changes. Thus, the AFP is involved in generating an error-reducing bias, which could increase the efficiency of vocal exploration and instruct synaptic changes in the motor pathway. We also find that learned changes in the song generated by the AFP are incorporated into the motor pathway within 1 day. Our observations support a view that basal ganglia-related circuits directly implement behavioral adaptations that minimize errors and subsequently stabilize these adaptations by training premotor cortical areas.

[1]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[2]  O. Hikosaka,et al.  Expectation of reward modulates cognitive signals in the basal ganglia , 1998, Nature Neuroscience.

[3]  Fernando Nottebohm,et al.  Reafferent thalamo‐“cortical” loops in the song system of oscine songbirds , 1997, The Journal of comparative neurology.

[4]  M. Brainard,et al.  Performance variability enables adaptive plasticity of ‘crystallized’ adult birdsong , 2007, Nature.

[5]  Masakazu Konishi,et al.  Decrystallization of adult birdsong by perturbation of auditory feedback , 1999, Nature.

[6]  Samuel D. Gale,et al.  Physiological properties of zebra finch ventral tegmental area and substantia nigra pars compacta neurons. , 2006, Journal of neurophysiology.

[7]  Todd W Troyer,et al.  Birdsong: models and mechanisms , 2001, Current Opinion in Neurobiology.

[8]  D. Lovinger,et al.  Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill , 2009, Nature Neuroscience.

[9]  A. Arnold,et al.  Forebrain lesions disrupt development but not maintenance of song in passerine birds. , 1984, Science.

[10]  Jennifer A. Mangels,et al.  A Neostriatal Habit Learning System in Humans , 1996, Science.

[11]  D. Margoliash,et al.  Song replay during sleep and computational rules for sensorimotor vocal learning. , 2000, Science.

[12]  E. Nordeen,et al.  Selective impairment of song learning following lesions of a forebrain nucleus in the juvenile zebra finch. , 1990, Behavioral and neural biology.

[13]  P. Mitra,et al.  How sleep affects the developmental learning of bird song , 2005, Nature.

[14]  E. Miller,et al.  Different time courses of learning-related activity in the prefrontal cortex and striatum , 2005, Nature.

[15]  K. Doya,et al.  Representation of Action-Specific Reward Values in the Striatum , 2005, Science.

[16]  Aaron S. Andalman,et al.  Vocal Experimentation in the Juvenile Songbird Requires a Basal Ganglia Circuit , 2005, PLoS biology.

[17]  O Tchernichovski,et al.  Vocal imitation in zebra finches is inversely related to model abundance. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[18]  T W Troyer,et al.  An associational model of birdsong sensorimotor learning I. Efference copy and the learning of song syllables. , 2000, Journal of neurophysiology.

[19]  A. Doupe,et al.  Interruption of a basal ganglia–forebrain circuit prevents plasticity of learned vocalizations , 2000, Nature.

[20]  R. Stickgold,et al.  Dissociable stages of human memory consolidation and reconsolidation , 2003, Nature.

[21]  F. Nottebohm,et al.  Central control of song in the canary, Serinus canarius , 1976, The Journal of comparative neurology.

[22]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[23]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[24]  A. Graybiel Habits, rituals, and the evaluative brain. , 2008, Annual review of neuroscience.

[25]  C. Gerfen,et al.  The frontal cortex-basal ganglia system in primates. , 1996, Critical reviews in neurobiology.

[26]  F. Nottebohm,et al.  A comparative study of the behavioral deficits following lesions of various parts of the zebra finch song system: implications for vocal learning , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[27]  G. E. Vates,et al.  Feedback circuitry within a song-learning pathway. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[28]  M. Dresselhaus,et al.  A Specialized Forebrain Circuit for Vocal Babbling in the Juvenile Songbird , 2008 .

[29]  A. Doupe,et al.  Contributions of an avian basal ganglia–forebrain circuit to real-time modulation of song , 2005, Nature.

[30]  J. Brugge,et al.  Central Auditory Processing and Neural Modeling , 2012, Springer US.

[31]  H. Seung,et al.  Model of birdsong learning based on gradient estimation by dynamic perturbation of neural conductances. , 2007, Journal of neurophysiology.

[32]  M. Fee,et al.  Singing-related activity of identified HVC neurons in the zebra finch. , 2007, Journal of neurophysiology.

[33]  S P Wise,et al.  Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action. , 1995, Cerebral cortex.

[34]  Georg B. Keller,et al.  Neural processing of auditory feedback during vocal practice in a songbird , 2009, Nature.

[35]  M. Konishi The role of auditory feedback in the control of vocalization in the white-crowned sparrow. , 1965, Zeitschrift fur Tierpsychologie.

[36]  M. Farries,et al.  A Telencephalic Nucleus Essential for Song Learning Contains Neurons with Physiological Characteristics of Both Striatum and Globus Pallidus , 2002, The Journal of Neuroscience.

[37]  R. O’Reilly,et al.  Separate neural substrates for skill learning and performance in the ventral and dorsal striatum , 2007, Nature Neuroscience.