Offline learning and the role of autogenous speech: new suggestions from birdsong research

Vocal learning in humans is isolated in evolution, nevertheless the comparative approach can help give insight into mechanisms of speech. Birdsong and speech learning share similar computational problems and may share similar neural mechanisms. In birds, there is a well-known sensory representation of the individual's own song. A similar representation is postulated for speech, and the implications are explored. Auditory responses to own song are observed in an anterior forebrain pathway that is implicated in song recognition. By analogy, speech perception may be referenced to an internal representation of own voice. This also predicts sex differences in speech perception. In awake birds, auditory responses are reduced or absent in motor pathways, which argues against a theory of perception by reference to production. Recent evidence demonstrates that auditory responses in birds are much stronger while animals sleep, and that during sleep there is replay of song motor patterns. If humans exhibit similar phenomena, then there should be circadian patterns in speech production, and possibly in speech perception. Humans should exhibit strong responses (e.g., ERP) to playback of speech during sleep when playback is matched to the perception of own speech. Sleep should be important for speech maintenance, and learning.

[1]  Walter Heiligenberg,et al.  Neural Nets in Electric Fish , 1991 .

[2]  M. Konishi The role of auditory feedback in the control of vocalization in the white-crowned sparrow. , 1965, Zeitschrift fur Tierpsychologie.

[3]  D. Margoliash,et al.  Song replay during sleep and computational rules for sensorimotor vocal learning. , 2000, Science.

[4]  A M Liberman,et al.  Perception of the speech code. , 1967, Psychological review.

[5]  A. Doupe,et al.  Song-selective auditory circuits in the vocal control system of the zebra finch. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Richard S. Sutton,et al.  Learning to predict by the methods of temporal differences , 1988, Machine Learning.

[7]  W. Hopkins,et al.  Asymmetric Broca's area in great apes , 2001, Nature.

[8]  R. Fox Modularity and the Motor Theory of Speech Perception , 1994 .

[9]  M. Magnasco,et al.  Simple motor gestures for birdsongs. , 2001, Physical review letters.

[10]  D. Margoliash,et al.  The Neuroethology of Vocal Communication: Perception and Cognition , 2003 .

[11]  R J Dooling,et al.  Control of vocal intensity in budgerigars (Melopsittacus undulatus): differential reinforcement of vocal intensity and the Lombard effect. , 1998, The Journal of the Acoustical Society of America.

[12]  M. Konishi,et al.  A suboscine bird (eastern phoebe, Sayornis phoebe) develops normal song without auditory feedback , 1991, Animal Behaviour.

[13]  E. Nordeen,et al.  Long-term maintenance of song in adult zebra finches is not affected by lesions of a forebrain region involved in song learning. , 1993, Behavioral and neural biology.

[14]  E. Nordeen,et al.  Auditory feedback is necessary for the maintenance of stereotyped song in adult zebra finches. , 1992, Behavioral and neural biology.

[15]  U. Jürgens 2 – Neural Control of Vocalization in Nonhuman Primates , 1979 .

[16]  F. Nottebohm 2 – Asymmetries in Neural Control of Vocalization in the Canary , 1977 .

[17]  P. Kuhl Models and mechanisms in speech perception. Species comparisons provide further contributions. , 1979, Brain, behavior and evolution.

[18]  G. Ojemann Cortical organization of language , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  F. Nottebohm,et al.  Central control of song in the canary, Serinus canarius , 1976, The Journal of comparative neurology.

[20]  Philip H Smith,et al.  Coincidence Detection in the Auditory System 50 Years after Jeffress , 1998, Neuron.

[21]  Behavioral discrimination of sexually dimorphic calls by male zebra finches requires an intact vocal motor pathway. , 2001, Journal of neurobiology.

[22]  P. Kuhl,et al.  Birdsong and human speech: common themes and mechanisms. , 1999, Annual review of neuroscience.

[23]  H. Williams,et al.  Changes in adult zebra finch song require a forebrain nucleus that is not necessary for song production. , 1999, Journal of neurobiology.

[24]  Xiaoqin Wang,et al.  Differential representation of species-specific primate vocalizations in the auditory cortices of marmoset and cat. , 2001, Journal of neurophysiology.

[25]  D Margoliash,et al.  Preference for autogenous song by auditory neurons in a song system nucleus of the white-crowned sparrow , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[26]  D. Margoliash,et al.  Parallel pathways and convergence onto HVc and adjacent neostriatum of adult zebra finches (Taeniopygia guttata) , 1995, The Journal of comparative neurology.

[27]  H. Fukuyama,et al.  Cortical processing mechanism for vocalization with auditory verbal feedback , 1997, Neuroreport.

[28]  F. Goller,et al.  A new mechanism of sound generation in songbirds. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[29]  C. Schreiner,et al.  Modular organization of frequency integration in primary auditory cortex. , 2000, Annual review of neuroscience.

[30]  R. Stickgold,et al.  Sleep, Learning, and Dreams: Off-line Memory Reprocessing , 2001, Science.

[31]  D. Ploog Neurobiology of primate audio-vocal behavior , 1981, Brain Research Reviews.

[32]  H. Williams,et al.  Auditory responses in avian vocal motor neurons: a motor theory for song perception in birds. , 1985, Science.

[33]  S. Nowicki,et al.  Vocal tract resonances in oscine bird sound production: evidence from birdsongs in a helium atmosphere , 1987, Nature.

[34]  A. B.,et al.  SPEECH COMMUNICATION , 2001 .

[35]  S J Chew,et al.  A large-capacity memory system that recognizes the calls and songs of individual birds. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[36]  A. Doupe,et al.  Singing-Related Neural Activity in a Dorsal Forebrain–Basal Ganglia Circuit of Adult Zebra Finches , 1999, The Journal of Neuroscience.

[37]  W. Fitch The evolution of speech: a comparative review , 2000, Trends in Cognitive Sciences.

[38]  AN ASSOCIATIONAL HYPOTHESISFOR SENSORIMOTOR LEARNINGOF BIRDSONGTodd , 1996 .

[39]  P. Marler Three models of song learning: evidence from behavior. , 1997, Journal of neurobiology.

[40]  A. Lotto,et al.  Perceptual compensation for coarticulation by Japanese quail (Coturnix coturnix japonica). , 1997, The Journal of the Acoustical Society of America.

[41]  P. Marler A comparative approach to vocal learning: Song development in white-crowned sparrows. , 1970 .

[42]  M. Mishkin,et al.  Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex , 1999, Nature Neuroscience.

[43]  P. Denes On the Motor Theory of Speech Perception , 1965 .

[44]  J. D. Miller,et al.  Speech perception by the chinchilla: voiced-voiceless distinction in alveolar plosive consonants , 1975, Science.

[45]  Charles T. Snowdon,et al.  Social Influences on Vocal Development , 2005 .

[46]  D Margoliash,et al.  Behavioral state modulation of auditory activity in a vocal motor system. , 1998, Science.

[47]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[48]  H. Williams,et al.  Temporal patterning of song production: participation of nucleus uvaeformis of the thalamus. , 1993, Journal of neurobiology.

[49]  A. Doupe,et al.  Interruption of a basal ganglia–forebrain circuit prevents plasticity of learned vocalizations , 2000, Nature.

[50]  Stephen M. Rao,et al.  Human Brain Language Areas Identified by Functional Magnetic Resonance Imaging , 1997, The Journal of Neuroscience.

[51]  Daniel R. Brooks,et al.  Phylogeny, Ecology, and Behavior , 1992 .

[52]  Social influences on vocal development in New World primates , 1997 .

[53]  J. S. McCasland,et al.  Neuronal control of bird song production , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[54]  A. King,et al.  Female visual displays affect the development of male song in the cowbird , 1988, Nature.

[55]  Gerald Langner,et al.  Laminar fine structure of frequency organization in auditory midbrain , 1997, Nature.

[56]  G. E. Vates,et al.  Auditory pathways of caudal telencephalon and their relation to the song system of adult male zebra finches (Taenopygia guttata) , 1996, The Journal of comparative neurology.

[57]  D Margoliash,et al.  Distributed representation in the song system of oscines: evolutionary implications and functional consequences. , 1994, Brain, behavior and evolution.

[58]  S. Durand,et al.  Vocal control pathways through the anterior forebrain of a parrot (Melopsittacus undulatus) , 1997, The Journal of comparative neurology.

[59]  M. Arbib,et al.  Language within our grasp , 1998, Trends in Neurosciences.

[60]  Peter D. Eimas,et al.  Perspectives on the study of speech , 1981 .

[61]  D. Vicario,et al.  Song-selective auditory input to a forebrain vocal control nucleus in the zebra finch. , 1993, Journal of neurobiology.

[62]  A. Doupe,et al.  Temporal and Spectral Sensitivity of Complex Auditory Neurons in the Nucleus HVc of Male Zebra Finches , 1998, The Journal of Neuroscience.

[63]  G Buzsáki,et al.  Memory consolidation during sleep: a neurophysiological perspective. , 1998, Journal of sleep research.

[64]  M Konishi,et al.  Dynamic control of auditory activity during sleep: Correlation between song response and EEG , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[65]  C. Müller,et al.  Feature extraction and tonotopic organization in the avian auditory forebrain , 2004, Experimental Brain Research.

[66]  A. C. Yu,et al.  Temporal Hierarchical Control of Singing in Birds , 1996, Science.

[67]  T. Troyer,et al.  An associational model of birdsong sensorimotor learning II. Temporal hierarchies and the learning of song sequence. , 2000, Journal of neurophysiology.

[68]  T W Troyer,et al.  An associational model of birdsong sensorimotor learning I. Efference copy and the learning of song syllables. , 2000, Journal of neurophysiology.

[69]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[70]  P. Marler Birdsong and speech development: could there be parallels? , 1970, American scientist.

[71]  D Margoliash,et al.  Gradual Emergence of Song Selectivity in Sensorimotor Structures of the Male Zebra Finch Song System , 1999, The Journal of Neuroscience.

[72]  D Margoliash,et al.  An introduction to birdsong and the avian song system. , 1997, Journal of neurobiology.

[73]  P. Marler,et al.  Developmental overproduction and selective attrition: new processes in the epigenesis of birdsong. , 1982, Developmental psychobiology.

[74]  J. Cynx,et al.  Amplitude regulation of vocalizations in noise by a songbird,Taeniopygia guttata , 1998, Animal Behaviour.

[75]  E C Schwab,et al.  Some Effects of Training on the Perception of Synthetic Speech , 1985, Human factors.

[76]  L A JEFFRESS,et al.  A place theory of sound localization. , 1948, Journal of comparative and physiological psychology.

[77]  M. Konishi,et al.  Axonal delay lines for time measurement in the owl's brainstem. , 1988, Proceedings of the National Academy of Sciences of the United States of America.

[78]  G. Striedter,et al.  Auditory responses in the vocal motor system of budgerigars. , 2000, Journal of neurobiology.

[79]  L. Baptista,et al.  Song development in the white-crowned sparrow: social factors and sex differences , 1986, Animal Behaviour.

[80]  Terrence J. Sejnowski,et al.  A Novel Reinforcement Model of Birdsong Vocalization Learning , 1994, NIPS.

[81]  Nobuo Suga,et al.  Cortical computational maps for auditory imaging , 1990, Neural Networks.

[82]  B. Truax Acoustic Communication , 1985 .

[83]  J. S. McCasland,et al.  Interaction between auditory and motor activities in an avian song control nucleus. , 1981, Proceedings of the National Academy of Sciences of the United States of America.

[84]  J. Rauschecker,et al.  Imprinting and cortical plasticity , 1987 .

[85]  H. Williams,et al.  Hemispheric differences in avian song discrimination. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[86]  D Margoliash,et al.  Auditory representation of autogenous song in the song system of white-crowned sparrows. , 1985, Proceedings of the National Academy of Sciences of the United States of America.

[87]  M. Konishi,et al.  A circuit for detection of interaural time differences in the brain stem of the barn owl , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[88]  M. Sachs,et al.  Encoding of steady-state vowels in the auditory nerve: representation in terms of discharge rate. , 1979, The Journal of the Acoustical Society of America.

[89]  Cory T. Miller,et al.  Amodal completion of acoustic signals by a nonhuman primate , 2001, Nature Neuroscience.

[90]  B. McNaughton,et al.  Replay of Neuronal Firing Sequences in Rat Hippocampus During Sleep Following Spatial Experience , 1996, Science.

[91]  S. Shamma,et al.  Analysis of dynamic spectra in ferret primary auditory cortex. II. Prediction of unit responses to arbitrary dynamic spectra. , 1996, Journal of neurophysiology.

[92]  Y Yonekura,et al.  Cortical speech processing mechanisms while vocalizing visually presented languages , 1996, Neuroreport.

[93]  M M Merzenich,et al.  Representation of a species-specific vocalization in the primary auditory cortex of the common marmoset: temporal and spectral characteristics. , 1995, Journal of neurophysiology.

[94]  P R Killeen,et al.  Japanese quail can learn phonetic categories. , 1987, Science.

[95]  Fernando Nottebohm,et al.  The Origins of Vocal Learning , 1972, The American Naturalist.

[96]  A. Arnold,et al.  Forebrain lesions disrupt development but not maintenance of song in passerine birds. , 1984, Science.

[97]  K. Sen,et al.  Feature analysis of natural sounds in the songbird auditory forebrain. , 2001, Journal of neurophysiology.

[98]  A. Liberman,et al.  The motor theory of speech perception revised , 1985, Cognition.

[99]  Masakazu Konishi,et al.  Gating of auditory responses in the vocal control system of awake songbirds , 1998, Nature Neuroscience.

[100]  J. Rauschecker Cortical processing of complex sounds , 1998, Current Opinion in Neurobiology.

[101]  Eric L. Schwartz,et al.  Computational Neuroscience , 1993, Neuromethods.

[102]  Fernando Nottebohm,et al.  Descending auditory pathways in the adult male zebra finch (Taeniopygia Guttata) , 1998, The Journal of comparative neurology.

[103]  R. Doty,et al.  Lateralization in the nervous system , 1977 .

[104]  B. McNaughton,et al.  Reactivation of hippocampal ensemble memories during sleep. , 1994, Science.

[105]  Masakazu Konishi,et al.  Decrystallization of adult birdsong by perturbation of auditory feedback , 1999, Nature.

[106]  J D Miller,et al.  Speech perception by the chinchilla: identification function for synthetic VOT stimuli. , 1978, The Journal of the Acoustical Society of America.

[107]  D Margoliash,et al.  Functional organization of forebrain pathways for song production and perception. , 1997, Journal of neurobiology.

[108]  Bijan Pesaran,et al.  The role of nonlinear dynamics of the syrinx in the vocalizations of a songbird , 1998, Nature.

[109]  S. Shamma,et al.  Analysis of dynamic spectra in ferret primary auditory cortex. I. Characteristics of single-unit responses to moving ripple spectra. , 1996, Journal of neurophysiology.

[110]  G. Striedter,et al.  The vocal control pathways in budgerigars differ from those in songbirds , 1994, The Journal of comparative neurology.

[111]  M Konishi Similar algorithms in different sensory systems and animals. , 1990, Cold Spring Harbor symposia on quantitative biology.

[112]  P. Kuhl Models and Mechanisms in Speech Perception; pp. 374–390 , 1979 .

[113]  D. Margoliash Acoustic parameters underlying the responses of song-specific neurons in the white-crowned sparrow , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[114]  J. Rauschecker,et al.  Mechanisms and streams for processing of "what" and "where" in auditory cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[115]  F. Nottebohm,et al.  Dynamics of the Vocal Imitation Process: How a Zebra Finch Learns Its Song , 2001, Science.