A reafferent and feed-forward model of song syntax generation in the Bengalese finch

Adult Bengalese finches generate a variable song that obeys a distinct and individual syntax. The syntax is gradually lost over a period of days after deafening and is recovered when hearing is restored. We present a spiking neuronal network model of the song syntax generation and its loss, based on the assumption that the syntax is stored in reafferent connections from the auditory to the motor control area. Propagating synfire activity in the HVC codes for individual syllables of the song and priming signals from the auditory network reduce the competition between syllables to allow only those transitions that are permitted by the syntax. Both imprinting of song syntax within HVC and the interaction of the reafferent signal with an efference copy of the motor command are sufficient to explain the gradual loss of syntax in the absence of auditory feedback. The model also reproduces for the first time experimental findings on the influence of altered auditory feedback on the song syntax generation, and predicts song- and species-specific low frequency components in the LFP. This study illustrates how sequential compositionality following a defined syntax can be realized in networks of spiking neurons.

[1]  M S Lewicki,et al.  Mechanisms underlying the sensitivity of songbird forebrain neurons to temporal order. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Masakazu Konishi,et al.  New brain pathways found in the vocal control system of a songbird , 2010, The Journal of comparative neurology.

[3]  Markus Diesmann,et al.  Compositionality of arm movements can be realized by propagating synchrony , 2010, Journal of Computational Neuroscience.

[4]  Kiyoshi Aoki,et al.  The Role of Auditory Feedback in the Maintenance of Song in Adult Male Bengalese Finches Lonchura striata var. domestica , 1998 .

[5]  L. F Abbott,et al.  Lapicque’s introduction of the integrate-and-fire model neuron (1907) , 1999, Brain Research Bulletin.

[6]  E. Jarvis,et al.  Early onset of deafening‐induced song deterioration and differential requirements of the pallial‐basal ganglia vocal pathway , 2008, The European journal of neuroscience.

[7]  Sarah M. N. Woolley,et al.  High-Frequency Auditory Feedback Is Not Required for Adult Song Maintenance in Bengalese Finches , 1999, The Journal of Neuroscience.

[8]  Jonathan F Prather,et al.  A Synaptic Basis for Auditory–Vocal Integration in the Songbird , 2008, The Journal of Neuroscience.

[9]  R. Mooney Different Subthreshold Mechanisms Underlie Song Selectivity in Identified HVc Neurons of the Zebra Finch , 2000, The Journal of Neuroscience.

[10]  Naoki Masuda,et al.  Formation of feedforward networks and frequency synchrony by spike-timing-dependent plasticity , 2007, Journal of Computational Neuroscience.

[11]  A. Arnold,et al.  The role of feedback from the vocal organ. I. Maintenance of stereotypical vocalizations by adult zebra finches , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  Adam Prügel-Bennett,et al.  Analysis of synfire chains , 1995 .

[13]  Jun Tani,et al.  Developmental learning of complex syntactical song in the Bengalese finch: A neural network model , 2008, Neural Networks.

[14]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[15]  Joseph K Jun,et al.  Development of Neural Circuitry for Precise Temporal Sequences through Spontaneous Activity, Axon Remodeling, and Synaptic Plasticity , 2007, PloS one.

[16]  E. Nordeen,et al.  Deafening-Induced Vocal Deterioration in Adult Songbirds Is Reversed by Disrupting a Basal Ganglia-Forebrain Circuit , 2010, The Journal of Neuroscience.

[17]  Masakazu Konishi,et al.  Decrystallization of adult birdsong by perturbation of auditory feedback , 1999, Nature.

[18]  Frédéric E Theunissen,et al.  Functional connectivity between auditory areas field L and CLM and song system nucleus HVC in anesthetized zebra finches. , 2007, Journal of neurophysiology.

[19]  D. Jin Generating variable birdsong syllable sequences with branching chain networks in avian premotor nucleus HVC. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[20]  K. D. Punta,et al.  An ultra-sparse code underlies the generation of neural sequences in a songbird , 2002 .

[21]  H. Seung,et al.  Model of birdsong learning based on gradient estimation by dynamic perturbation of neural conductances. , 2007, Journal of neurophysiology.

[22]  G. Edelman,et al.  Spike-timing dynamics of neuronal groups. , 2004, Cerebral cortex.

[23]  M. Fee,et al.  Singing-related activity of identified HVC neurons in the zebra finch. , 2007, Journal of neurophysiology.

[24]  Adrián Ponce-Alvarez,et al.  Comparison of local measures of spike time irregularity and relating variability to firing rate in motor cortical neurons , 2010, Journal of Computational Neuroscience.

[25]  Markus Diesmann,et al.  Simplicity and Efficiency of Integrate-and-Fire Neuron Models , 2009, Neural Computation.

[26]  A. Aertsen,et al.  Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding , 2010, Nature Reviews Neuroscience.

[27]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[28]  Ekkehard Pröve,et al.  Der Einfluß von Kastration und Testosteronsubstitution auf das Sexualverhalten männlicher Zebrafinken (Taeniopygia guttata castanotis Gould) , 1974, Journal für Ornithologie.

[29]  E. Nordeen,et al.  Selective impairment of song learning following lesions of a forebrain nucleus in the juvenile zebra finch. , 1990, Behavioral and neural biology.

[30]  Markus Diesmann,et al.  The mechanism of synchronization in feed-forward neuronal networks , 2008 .

[31]  F. Nottebohm,et al.  For Whom The Bird Sings Context-Dependent Gene Expression , 1998, Neuron.

[32]  E. Nordeen,et al.  Auditory feedback is necessary for the maintenance of stereotyped song in adult zebra finches. , 1992, Behavioral and neural biology.

[33]  Daqing Guo,et al.  Signal propagation in feedforward neuronal networks with unreliable synapses , 2011, Journal of Computational Neuroscience.

[34]  Richard Mooney,et al.  Synaptic interactions underlying song-selectivity in the avian nucleus HVC revealed by dual intracellular recordings. , 2006, Journal of neurophysiology.

[35]  Samuel D. Gale,et al.  A Basal Ganglia Pathway Drives Selective Auditory Responses in Songbird Dopaminergic Neurons via Disinhibition , 2010, The Journal of Neuroscience.

[36]  K. Okanoya,et al.  Song Motor control organizes acoustic patterns on two levels in Bengalese finches (Lonchura striata var. domestica) , 2008, Journal of Comparative Physiology A.

[37]  R. Mooney,et al.  The HVC Microcircuit: The Synaptic Basis for Interactions between Song Motor and Vocal Plasticity Pathways , 2005, The Journal of Neuroscience.

[38]  M S Brainard,et al.  Postlearning Consolidation of Birdsong: Stabilizing Effects of Age and Anterior Forebrain Lesions , 2001, The Journal of Neuroscience.

[39]  Dezhe Z. Jin,et al.  A Compact Statistical Model of the Song Syntax in Bengalese Finch , 2010, PLoS Comput. Biol..

[40]  J. F. Prather,et al.  Precise auditory–vocal mirroring in neurons for learned vocal communication , 2008, Nature.

[41]  Richard Hans Robert Hahnloser,et al.  Spike-Time-Dependent Plasticity and Heterosynaptic Competition Organize Networks to Produce Long Scale-Free Sequences of Neural Activity , 2010, Neuron.

[42]  Michael S Brainard,et al.  Linked Control of Syllable Sequence and Phonology in Birdsong , 2010, The Journal of Neuroscience.

[43]  Tohru Ikeguchi,et al.  STDP Provides the Substrate for Igniting Synfire Chains by Spatiotemporal Input Patterns , 2008, Neural Computation.

[44]  A. C. Yu,et al.  Temporal Hierarchical Control of Singing in Birds , 1996, Science.

[45]  Dean V Buonomano,et al.  A learning rule for the emergence of stable dynamics and timing in recurrent networks. , 2005, Journal of neurophysiology.

[46]  Masato Okada,et al.  Population coding of song element sequence in the Bengalese finch HVC , 2008, The European journal of neuroscience.

[47]  A. Arnold,et al.  Forebrain lesions disrupt development but not maintenance of song in passerine birds. , 1984, Science.

[48]  M. Verhoye,et al.  Own-Song Recognition in the Songbird Auditory Pathway: Selectivity and Lateralization , 2009, The Journal of Neuroscience.

[49]  Dean V Buonomano,et al.  Embedding Multiple Trajectories in Simulated Recurrent Neural Networks in a Self-Organizing Manner , 2009, The Journal of Neuroscience.

[50]  Daniel Lehmann,et al.  Modeling Compositionality by Dynamic Binding of Synfire Chains , 2004, Journal of Computational Neuroscience.

[51]  Jun Tani,et al.  Emergence of Functional Hierarchy in a Multiple Timescale Neural Network Model: A Humanoid Robot Experiment , 2008, PLoS Comput. Biol..

[52]  Tomoki Fukai,et al.  Complex evolution of spike patterns during burst propagation through feed-forward networks , 2008, Biological Cybernetics.

[53]  Markus Diesmann,et al.  An Imperfect Dopaminergic Error Signal Can Drive Temporal-Difference Learning , 2011, PLoS Comput. Biol..

[54]  Dezhe Z. Jin,et al.  Support for a synaptic chain model of neuronal sequence generation , 2010, Nature.

[55]  Michael S Brainard,et al.  An avian basal ganglia-forebrain circuit contributes differentially to syllable versus sequence variability of adult Bengalese finch song. , 2009, Journal of neurophysiology.

[56]  Richard Hans Robert Hahnloser,et al.  Neural Mechanisms of Vocal Sequence Generation in the Songbird , 2004, Annals of the New York Academy of Sciences.

[57]  M. Dresselhaus,et al.  A Specialized Forebrain Circuit for Vocal Babbling in the Juvenile Songbird , 2008 .

[58]  Kentaro Katahira,et al.  A neural network model for generating complex birdsong syntax , 2007, Biological Cybernetics.

[59]  Masakazu Konishi,et al.  The Role of Auditory Feedback in Birdsong , 2004, Annals of the New York Academy of Sciences.

[60]  Stefan Rotter,et al.  Exact digital simulation of time-invariant linear systems with applications to neuronal modeling , 1999, Biological Cybernetics.

[61]  Sarah M. N. Woolley,et al.  Vocal Memory and Learning in Adult Bengalese Finches with Regenerated Hair Cells , 2002, The Journal of Neuroscience.

[62]  Dezhe Z Jin,et al.  Spike propagation in driven chain networks with dominant global inhibition. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[63]  S. Nelson,et al.  Homeostatic plasticity in the developing nervous system , 2004, Nature Reviews Neuroscience.

[64]  Markus Diesmann,et al.  Frontiers in Computational Neuroscience , 2022 .

[65]  A. Leonardo,et al.  Ensemble Coding of Vocal Control in Birdsong , 2005, The Journal of Neuroscience.

[66]  J. Sakata,et al.  Social modulation of sequence and syllable variability in adult birdsong. , 2008, Journal of neurophysiology.

[67]  Ralf Der,et al.  Building Nonlinear Data Models with Self-Organizing Maps , 1996, ICANN.

[68]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[69]  C. Bell An efference copy which is modified by reafferent input. , 1981, Science.

[70]  F. Nottebohm,et al.  Age at Deafening Affects the Stability of Learned Song in Adult Male Zebra Finches , 2000, The Journal of Neuroscience.

[71]  Michael S. Brainard,et al.  What songbirds teach us about learning , 2002, Nature.

[72]  Wulfram Gerstner,et al.  Phenomenological models of synaptic plasticity based on spike timing , 2008, Biological Cybernetics.

[73]  Daniel Lehmann,et al.  A Model for Representing the Dynamics of a System of Synfire Chains , 2005, Journal of Computational Neuroscience.

[74]  M. Lewicki Intracellular Characterization of Song-Specific Neurons in the Zebra Finch Auditory Forebrain , 1996, The Journal of Neuroscience.

[75]  A. C. Webb,et al.  The spontaneous activity of neurones in the cat’s cerebral cortex , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[76]  Mengru Li,et al.  Stable propagation of a burst through a one-dimensional homogeneous excitatory chain model of songbird nucleus HVC. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[77]  Jessica A. Cardin,et al.  Sensorimotor nucleus NIf is necessary for auditory processing but not vocal motor output in the avian song system. , 2005, Journal of neurophysiology.

[78]  E. Holst,et al.  Das Reafferenzprinzip , 2004, Naturwissenschaften.

[79]  P. Marler,et al.  Neuroscience of Birdsong , 2012 .

[80]  E. Bienenstock,et al.  The self-organized growth of synfire patterns , 2006 .

[81]  D Margoliash,et al.  Behavioral state modulation of auditory activity in a vocal motor system. , 1998, Science.

[82]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[83]  Masato Okada,et al.  Complex Sequencing Rules of Birdsong Can be Explained by Simple Hidden Markov Processes , 2010, PloS one.

[84]  A. Doupe,et al.  Contributions of an avian basal ganglia–forebrain circuit to real-time modulation of song , 2005, Nature.

[85]  L. Abbott,et al.  Model of song selectivity and sequence generation in area HVc of the songbird. , 2003, Journal of neurophysiology.

[86]  K Okanoya,et al.  Adult Bengalese finches (Lonchura striata var. domestica) require real-time auditory feedback to produce normal song syntax. , 1997, Journal of neurobiology.

[87]  Fernando Nottebohm,et al.  Birdsong's clockwork , 2002, Nature Neuroscience.

[88]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[89]  Germán Mato,et al.  On Numerical Simulations of Integrate-and-Fire Neural Networks , 1998, Neural Computation.

[90]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[91]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[92]  J. Cynx,et al.  Immediate and transitory effects of delayed auditory feedback on bird song production , 2001, Animal Behaviour.

[93]  F. Nottebohm,et al.  A comparative study of the behavioral deficits following lesions of various parts of the zebra finch song system: implications for vocal learning , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[94]  H. Williams,et al.  Temporal patterning of song production: participation of nucleus uvaeformis of the thalamus. , 1993, Journal of neurobiology.

[95]  A. Doupe,et al.  Interruption of a basal ganglia–forebrain circuit prevents plasticity of learned vocalizations , 2000, Nature.

[96]  J. S. McCasland,et al.  Neuronal control of bird song production , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[97]  Kazuo Okanoya,et al.  Song syntax changes in Bengalese finches singing in a helium atmosphere , 2003, Neuroreport.

[98]  Moritz Helias,et al.  A General and Efficient Method for Incorporating Precise Spike Times in Globally Time-Driven Simulations , 2010, Front. Neuroinform..

[99]  Michael S Brainard,et al.  Lesions of an avian basal ganglia circuit prevent context-dependent changes to song variability. , 2006, Journal of neurophysiology.

[100]  Timothy Q Gentner,et al.  Inhibition and recurrent excitation in a computational model of sparse bursting in song nucleus HVC. , 2009, Journal of neurophysiology.

[101]  H. Sebastian Seung,et al.  Intrinsic bursting enhances the robustness of a neural network model of sequence generation by avian brain area HVC , 2007, Journal of Computational Neuroscience.

[102]  Markus Diesmann,et al.  Exact Subthreshold Integration with Continuous Spike Times in Discrete-Time Neural Network Simulations , 2007, Neural Computation.

[103]  D. Perkel,et al.  Multiple cell types distinguished by physiological, pharmacological, and anatomic properties in nucleus HVc of the adult zebra finch. , 1998, Journal of neurophysiology.

[104]  J. Cynx Experimental determination of a unit of song production in the zebra finch (Taeniopygia guttata). , 1990, Journal of comparative psychology.

[105]  Aaron S. Andalman,et al.  Vocal Experimentation in the Juvenile Songbird Requires a Basal Ganglia Circuit , 2005, PLoS biology.

[106]  T. Troyer,et al.  An associational model of birdsong sensorimotor learning II. Temporal hierarchies and the learning of song sequence. , 2000, Journal of neurophysiology.

[107]  T W Troyer,et al.  An associational model of birdsong sensorimotor learning I. Efference copy and the learning of song syllables. , 2000, Journal of neurophysiology.

[108]  Markus Diesmann,et al.  Limits to the Development of Feed-Forward Structures in Large Recurrent Neuronal Networks , 2011, Front. Comput. Neurosci..

[109]  M. Coleman,et al.  Recovery of impaired songs following unilateral but not bilateral lesions of nucleus uvaeformis of adult zebra finches. , 2005, Journal of neurobiology.

[110]  Gerald E. Hough,et al.  Avian brains and a new understanding of vertebrate brain evolution , 2005, Nature Reviews Neuroscience.

[111]  Günther Palm,et al.  Controlling the Speed of Synfire Chains , 1996, ICANN.

[112]  Michael S. Brainard,et al.  Online Contributions of Auditory Feedback to Neural Activity in Avian Song Control Circuitry , 2008, The Journal of Neuroscience.

[113]  J. Sakata,et al.  Real-Time Contributions of Auditory Feedback to Avian Vocal Motor Control , 2006, The Journal of Neuroscience.

[114]  J. Wild,et al.  Visual and somatosensory inputs to the avian song system via nucleus uvaeformis (Uva) and a comparison with the projections of a similar thalamic nucleus in a nonsongbird, columbia livia , 1994, The Journal of comparative neurology.

[115]  Timothy Q Gentner,et al.  Brain stem feedback in a computational model of birdsong sequencing. , 2009, Journal of neurophysiology.

[116]  M. Fee,et al.  Using temperature to analyze temporal dynamics in the songbird motor pathway , 2008, Nature.

[117]  Gerald E. Hough,et al.  Short-Term and Long-Term Effects of Vocal Distortion on Song Maintenance in Zebra Finches , 2002, The Journal of Neuroscience.

[118]  Chris M. Glaze,et al.  Neuroscience: Cool songs , 2008, Nature.

[119]  Markus Diesmann,et al.  Spike-Timing-Dependent Plasticity in Balanced Random Networks , 2007, Neural Computation.

[120]  Georg B. Keller,et al.  Neural processing of auditory feedback during vocal practice in a songbird , 2009, Nature.

[121]  Sarah M. N. Woolley,et al.  Bengalese Finches Lonchura Striata Domestica Depend upon Auditory Feedback for the Maintenance of Adult Song , 1997, The Journal of Neuroscience.

[122]  S. Peters,et al.  Neural Correlates of Categorical Perception in Learned Vocal Communication , 2009, Nature Neuroscience.

[123]  R. Mooney,et al.  Inhibitory and Excitatory Mechanisms Underlying Auditory Responses to Learned Vocalizations in the Songbird Nucleus HVC , 2003, Neuron.

[124]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[125]  E.C.L. Vu,et al.  Identification of a forebrain motor programming network for the learned song of zebra finches , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[126]  Peter A. Appleby,et al.  Triphasic spike-timing-dependent plasticity organizes networks to produce robust sequences of neural activity , 2012, Front. Comput. Neurosci..

[127]  Markus Diesmann,et al.  A reafferent model of song syntax generation in the Bengalese finch , 2010, BMC Neuroscience.

[128]  Richard Mooney,et al.  Song decrystallization in adult zebra finches does not require the song nucleus NIf. , 2009, Journal of neurophysiology.

[129]  E. Marder,et al.  Similar network activity from disparate circuit parameters , 2004, Nature Neuroscience.

[130]  Richard H. R. Hahnloser,et al.  Spike Correlations in a Songbird Agree with a Simple Markov Population Model , 2007, PLoS Comput. Biol..

[131]  Marc-Oliver Gewaltig,et al.  Towards Reproducible Descriptions of Neuronal Network Models , 2009, PLoS Comput. Biol..