A Novel Reinforcement Model of Birdsong Vocalization Learning

Songbirds learn to imitate a tutor song through auditory and motor learning. We have developed a theoretical framework for song learning that accounts for response properties of neurons that have been observed in many of the nuclei that are involved in song learning. Specifically, we suggest that the anterior forebrain pathway, which is not needed for song production in the adult but is essential for song acquisition, provides synaptic perturbations and adaptive evaluations for syllable vocalization learning. A computer model based on reinforcement learning was constructed that could replicate a real zebra finch song with 90% accuracy based on a spectrographic measure. The second generation of the birdsong model replicated the tutor song with 96% accuracy.

[1]  M. Konishi The role of auditory feedback in the control of vocalization in the white-crowned sparrow. , 1965, Zeitschrift fur Tierpsychologie.

[2]  A. Arnold,et al.  Evidence for a catecholaminergic projection to area X in the zebra finch , 1981, The Journal of comparative neurology.

[3]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[4]  Richard M. Casey,et al.  Theoretical models of the avian syrinx , 1985 .

[5]  F. Nottebohm Reassessing the mechanisms and origins of vocal learning in birds , 1991, Trends in Neurosciences.

[6]  F. Nottebohm,et al.  A comparative study of the behavioral deficits following lesions of various parts of the zebra finch song system: implications for vocal learning , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  D. Vicario Neural mechanisms of vocal production in songbirds , 1991, Current Opinion in Neurobiology.

[8]  A. Doupe,et al.  Song-selective auditory circuits in the vocal control system of the zebra finch. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[9]  R. Mooney,et al.  Synaptic basis for developmental plasticity in a birdsong nucleus , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  José Carlos Príncipe,et al.  The gamma model--A new neural model for temporal processing , 1992, Neural Networks.

[11]  K. Sillar Dynamic Biological Networks: the Stomatogastric Nervous System edited by Ronald M. Harris-Warrick, Eve Marder, Allen I. Selverston and Maurice Moulins MIT Press, 1992. $65.00 (xvii + 328 pages) ISBN 0 262 08214 4 , 1993, Trends in Neurosciences.

[12]  A. Doupe A neural circuit specialized for vocal learning , 1993, Current Opinion in Neurobiology.

[13]  S. Volman,et al.  Development of neural selectivity for birdsong during vocal learning , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  E.C.L. Vu,et al.  Identification of a forebrain motor programming network for the learned song of zebra finches , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.