A Compact Statistical Model of the Song Syntax in Bengalese Finch

Songs of many songbird species consist of variable sequences of a finite number of syllables. A common approach for characterizing the syntax of these complex syllable sequences is to use transition probabilities between the syllables. This is equivalent to the Markov model, in which each syllable is associated with one state, and the transition probabilities between the states do not depend on the state transition history. Here we analyze the song syntax in Bengalese finch. We show that the Markov model fails to capture the statistical properties of the syllable sequences. Instead, a state transition model that accurately describes the statistics of the syllable sequences includes adaptation of the self-transition probabilities when states are revisited consecutively, and allows associations of more than one state to a given syllable. Such a model does not increase the model complexity significantly. Mathematically, the model is a partially observable Markov model with adaptation (POMMA). The success of the POMMA supports the branching chain network model of how syntax is controlled within the premotor song nucleus HVC, but also suggests that adaptation and many-to-one mapping from the syllable-encoding chain networks in HVC to syllables should be included in the network model.

[1]  Michael S Brainard,et al.  Linked Control of Syllable Sequence and Phonology in Birdsong , 2010, The Journal of Neuroscience.

[2]  Amaury Habrard,et al.  A Polynomial Algorithm for the Inference of Context Free Languages , 2008, ICGI.

[3]  Tetsuro Nishino,et al.  Pattern Extraction Improves Automata-Based Syntax Analysis in Songbirds , 2007, ACAL.

[4]  Richard Hans Robert Hahnloser,et al.  Neural Mechanisms of Vocal Sequence Generation in the Songbird , 2004, Annals of the New York Academy of Sciences.

[5]  K. Berridge,et al.  Ontogeny of action syntax in altricial and precocial rodents : Grooming sequences of rat and guinea pig pups , 1996 .

[6]  Pierre Dupont,et al.  A Markovian Approach to the Induction of Regular String Distributions , 2004, ICGI.

[7]  Zhiyi Chi,et al.  Temporal Precision and Temporal Drift in Brain and Behavior of Zebra Finch Song , 2001, Neuron.

[8]  Ping Du,et al.  A segmentation algorithm for zebra finch song at the note level , 2006, Neurocomputing.

[9]  T. Speed,et al.  Biological Sequence Analysis , 1998 .

[10]  Marcus Randall,et al.  Progress in Artificial Life, Third Australian Conference, ACAL 2007, Gold Coast, Australia, December 4-6, 2007, Proceedings , 2007, ACAL.

[11]  H. Sebastian Seung,et al.  Intrinsic bursting enhances the robustness of a neural network model of sequence generation by avian brain area HVC , 2007, Journal of Computational Neuroscience.

[12]  Dezhe Z. Jin,et al.  Support for a synaptic chain model of neuronal sequence generation , 2010, Nature.

[13]  Ann M Graybiel,et al.  Neural representation of time in cortico-basal ganglia circuits , 2009, Proceedings of the National Academy of Sciences.

[14]  P. Slater,et al.  Bird song learning: causes and consequences , 1989 .

[15]  Henrike Hultsch,et al.  How songbirds deal with large amounts of serial information: retrieval rules suggest a hierarchical song memory , 1998, Biological Cybernetics.

[16]  Kazuo Okanoya,et al.  Lesion of a higher‐order song nucleus disrupts phrase level complexity in Bengalese finches , 2000, Neuroreport.

[17]  D. Jin Generating variable birdsong syllable sequences with branching chain networks in avian premotor nucleus HVC. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  K. D. Punta,et al.  An ultra-sparse code underlies the generation of neural sequences in a songbird , 2002 .

[19]  P. Slater,et al.  SONG ORGANISATION AND SINGING PATTERNS OF THE WILLOW WARBLER, PHYLLOSCOPUS TROCHILUS , 2000 .

[20]  A. C. Yu,et al.  Temporal Hierarchical Control of Singing in Birds , 1996, Science.

[21]  A. Krogh,et al.  Predicting transmembrane protein topology with a hidden Markov model: application to complete genomes. , 2001, Journal of molecular biology.

[22]  Julian M. Kupiec,et al.  Robust part-of-speech tagging using a hidden Markov model , 1992 .

[23]  Clive K. Catchpole,et al.  TEMPORAL AND SEQUENTIAL ORGANISATION OF SONG IN THE SEDGE WARBLER (ACROCEPHALUS SCHOENOBAENUS) , 1976 .

[24]  James H. Martin,et al.  Speech and language processing: an introduction to natural language processing, computational linguistics, and speech recognition, 2nd Edition , 2000, Prentice Hall series in artificial intelligence.

[25]  Kentaro Katahira,et al.  A neural network model for generating complex birdsong syntax , 2007, Biological Cybernetics.

[26]  Kazuo Okanoya,et al.  Acoustical and Syntactical Comparisons between Songs of the White-backed Munia (Lonchura striata) and Its Domesticated Strain, the Bengalese Finch (Lonchura striata var. domestica) , 1999 .

[27]  Dezhe Z Jin,et al.  Spike propagation in driven chain networks with dominant global inhibition. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  A. Arnold,et al.  The development of afferent projections to the robust archistriatal nucleus in male zebra finches: a quantitative electron microscopic study , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  Terrence J. Sejnowski,et al.  A Novel Reinforcement Model of Birdsong Vocalization Learning , 1994, NIPS.

[30]  H. Markram,et al.  Redistribution of synaptic efficacy between neocortical pyramidal neurons , 1996, Nature.

[31]  K. Okanoya The Bengalese Finch: A Window on the Behavioral Neurobiology of Birdsong Syntax , 2004, Annals of the New York Academy of Sciences.

[32]  Aaron S. Andalman,et al.  Vocal Experimentation in the Juvenile Songbird Requires a Basal Ganglia Circuit , 2005, PLoS biology.

[33]  P Janata Quantitative assessment of vocal development in the zebra finch using self-organizing neural networks. , 2001, The Journal of the Acoustical Society of America.

[34]  Jack W. Tsao,et al.  Observed brain dynamics, P.P. Mitra, H. Bokil. Oxford University Press (2008), ISBN-13: 978-0-19-517808-1, 381 pages, $65.00 , 2009 .

[35]  M. Fee,et al.  Using temperature to analyze temporal dynamics in the songbird motor pathway , 2008, Nature.

[36]  F. Nottebohm,et al.  Connections of vocal control nuclei in the canary telencephalon , 1982, The Journal of comparative neurology.

[37]  J. Sakata,et al.  Real-Time Contributions of Auditory Feedback to Avian Vocal Motor Control , 2006, The Journal of Neuroscience.

[38]  F. Nottebohm,et al.  Central control of song in the canary, Serinus canarius , 1976, The Journal of comparative neurology.

[39]  Sarah M. N. Woolley,et al.  Bengalese Finches Lonchura Striata Domestica Depend upon Auditory Feedback for the Maintenance of Adult Song , 1997, The Journal of Neuroscience.

[40]  L. A. Jeffress Cerebral mechanisms in behavior : the Hixon symposium , 1951 .

[41]  Jun Tani,et al.  Developmental learning of complex syntactical song in the Bengalese finch: A neural network model , 2008, Neural Networks.

[42]  K. Lashley The problem of serial order in behavior , 1951 .

[43]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[44]  Ila R Fiete,et al.  Temporal sparseness of the premotor drive is important for rapid learning in a neural network model of birdsong. , 2004, Journal of neurophysiology.

[45]  F. Nottebohm,et al.  A comparative study of the behavioral deficits following lesions of various parts of the zebra finch song system: implications for vocal learning , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  Maria V. Sanchez-Vives,et al.  Cellular Mechanisms of Long-Lasting Adaptation in Visual Cortical Neurons In Vitro , 2000, The Journal of Neuroscience.

[47]  Kiyoshi Aoki,et al.  The Role of Auditory Feedback in the Maintenance of Song in Adult Male Bengalese Finches Lonchura striata var. domestica , 1998 .

[48]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[49]  J. S. McCasland,et al.  Neuronal control of bird song production , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.