Songbirds work around computational complexity by learning song vocabulary independently of sequence

While acquiring motor skills, animals transform their plastic motor sequences to match desired targets. However, because both the structure and temporal position of individual gestures are adjustable, the number of possible motor transformations increases exponentially with sequence length. Identifying the optimal transformation towards a given target is therefore a computationally intractable problem. Here we show an evolutionary workaround for reducing the computational complexity of song learning in zebra finches. We prompt juveniles to modify syllable phonology and sequence in a learned song to match a newly introduced target song. Surprisingly, juveniles match each syllable to the most spectrally similar sound in the target, regardless of its temporal position, resulting in unnecessary sequence errors, that they later try to correct. Thus, zebra finches prioritize efficient learning of syllable vocabulary, at the cost of inefficient syntax learning. This strategy provides a non-optimal but computationally manageable solution to the task of vocal sequence learning.Efficiently imitating a complex motor sequence such as birdsong is a computationally intensive problem. Here the authors show that young zebra finches learn new songs using a non-optimal strategy that prioritizes efficient learning of syllable vocabulary over syllable sequence.

[1]  O. Hikosaka,et al.  Learning of sequential movements in the monkey: process of learning and retention of memory. , 1995, Journal of neurophysiology.

[2]  F. Nottebohm,et al.  Dynamics of the Vocal Imitation Process: How a Zebra Finch Learns Its Song , 2001, Science.

[3]  P. Mitra,et al.  How sleep affects the developmental learning of bird song , 2005, Nature.

[4]  J. F. Prather,et al.  Precise auditory–vocal mirroring in neurons for learned vocal communication , 2008, Nature.

[5]  R. Zann The Zebra Finch: A Synthesis of Field and Laboratory Studies , 1996 .

[6]  T. Sejnowski,et al.  3 3 A Computational Model of Avian Song Learning , 2000 .

[7]  G. Theraulaz,et al.  Inspiration for optimization from social insect behaviour , 2000, Nature.

[8]  Franz Goller,et al.  Species-typical songs in white-crowned sparrows tutored with only phrase pairs , 2004, Nature.

[9]  Hideki Kawahara,et al.  YIN, a fundamental frequency estimator for speech and music. , 2002, The Journal of the Acoustical Society of America.

[10]  C. E. Ho,et al.  A procedure for an automated measurement of song similarity , 2000, Animal Behaviour.

[11]  G Gigerenzer,et al.  Reasoning the fast and frugal way: models of bounded rationality. , 1996, Psychological review.

[12]  Gus Wiseman,et al.  A Partition of Connected Graphs , 2005, Electron. J. Comb..

[13]  Matt J. Kusner,et al.  Supervised Word Mover's Distance , 2016, NIPS.

[14]  Fernando Nottebohm,et al.  Juvenile zebra finches can use multiple strategies to learn the same song , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[15]  R. J. Beers,et al.  Motor Learning Is Optimally Tuned to the Properties of Motor Noise , 2009, Neuron.

[16]  F R Robinson,et al.  Visual error is the stimulus for saccade gain adaptation. , 2001, Brain research. Cognitive brain research.

[17]  Richard Bertram,et al.  Independent Premotor Encoding of the Sequence and Structure of Birdsong in Avian Cortex , 2014, The Journal of Neuroscience.

[18]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[19]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[20]  Daniel Bullock,et al.  Learning and production of movement sequences: behavioral, neurophysiological, and modeling perspectives. , 2004, Human movement science.

[21]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[22]  R. Zann Song and call learning in wild zebra finches in south-east Australia , 1990, Animal Behaviour.

[23]  Ofer Tchernichovski,et al.  Quantification of developmental birdsong learning from the subsyllabic scale to cultural evolution , 2011, Proceedings of the National Academy of Sciences.

[24]  M. Long,et al.  Inhibition protects acquired song segments during vocal learning in zebra finches , 2016, Science.

[25]  M. Konishi The role of auditory feedback in the control of vocalization in the white-crowned sparrow. , 1965, Zeitschrift fur Tierpsychologie.

[26]  Carlos Diuk,et al.  Hierarchical Learning Induces Two Simultaneous, But Separable, Prediction Errors in Human Basal Ganglia , 2013, The Journal of Neuroscience.

[27]  H. Williams Models for song learning in the zebra finch: fathers or others? , 1990, Animal Behaviour.

[28]  Zoubin Ghahramani,et al.  Modular decomposition in visuomotor learning , 1997, Nature.

[29]  D. Robinson The mechanics of human smooth pursuit eye movement. , 1965, The Journal of physiology.

[30]  R. Shadmehr,et al.  Interacting Adaptive Processes with Different Timescales Underlie Short-Term Motor Learning , 2006, PLoS biology.

[31]  Ryan P. Adams,et al.  Mapping Sub-Second Structure in Mouse Behavior , 2015, Neuron.

[32]  G. Marcus Kluge : the haphazard evolution of the human mind , 2009 .

[33]  Peter Dayan,et al.  Interplay of approximate planning strategies , 2015, Proceedings of the National Academy of Sciences.

[34]  L. Parra,et al.  Vocal Exploration Is Locally Regulated during Song Learning , 2012, The Journal of Neuroscience.

[35]  Rainer E. Burkard,et al.  Linear Assignment Problems and Extensions , 1999, Handbook of Combinatorial Optimization.

[36]  J. Krakauer,et al.  Error correction, sensory prediction, and adaptation in motor control. , 2010, Annual review of neuroscience.

[37]  C. Scharff,et al.  Incomplete and Inaccurate Vocal Imitation after Knockdown of FoxP2 in Songbird Basal Ganglia Nucleus Area X , 2007, PLoS biology.

[38]  M. Fee,et al.  A hypothesis for basal ganglia-dependent reinforcement learning in the songbird , 2011, Neuroscience.

[39]  Panos M. Pardalos,et al.  Handbook of combinatorial optimization. Supplement , 2005 .

[40]  Hanna M. Wallach,et al.  Topic modeling: beyond bag-of-words , 2006, ICML.

[41]  Yoram Burak,et al.  The Basal Ganglia Is Necessary for Learning Spectral, but Not Temporal, Features of Birdsong , 2013, Neuron.

[42]  O. Tchernichovski,et al.  A rhythm landscape approach to the developmental dynamics of birdsong , 2015, Journal of The Royal Society Interface.

[43]  H. Seung,et al.  Model of birdsong learning based on gradient estimation by dynamic perturbation of neural conductances. , 2007, Journal of neurophysiology.

[44]  M. Fee,et al.  A role for descending auditory cortical projections in songbird vocal learning , 2014, eLife.

[45]  Petr Kolman,et al.  Minimum Common String Partition Problem: Hardness and Approximations , 2004, Electron. J. Comb..

[46]  Michael I. Jordan,et al.  Forward Models: Supervised Learning with a Distal Teacher , 1992, Cogn. Sci..

[47]  Teofilo F. Gonzalez,et al.  P-Complete Approximation Problems , 1976, J. ACM.

[48]  Michael S. Brainard,et al.  Auditory feedback in learning and maintenance of vocal behaviour , 2000, Nature Reviews Neuroscience.

[49]  Nesa L'abbe Wu,et al.  Linear programming and extensions , 1981 .

[50]  Gary F. Marcus,et al.  Stepwise acquisition of vocal combinatorial capacity in songbirds and human infants , 2013, Nature.

[51]  P. Marler,et al.  Song "Dialects" in Three Populations of White-Crowned Sparrows , 1962 .

[52]  S. Radtke Book Review Kluge: The Haphazard Evolution of the Human Mind , 2013 .

[53]  Richard Hans Robert Hahnloser,et al.  Neural Mechanisms of Vocal Sequence Generation in the Songbird , 2004, Annals of the New York Academy of Sciences.

[54]  Georg B. Keller,et al.  Rapid Interhemispheric Switching during Vocal Production in a Songbird , 2008, PLoS biology.

[55]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[56]  D. Vicario Using Learned Calls to Study Sensory‐Motor Integration in Songbirds , 2004, Annals of the New York Academy of Sciences.

[57]  Tatsuo S. Okubo,et al.  Growth and splitting of neural sequences in songbird vocal development , 2015, Nature.

[58]  T. Koopmans,et al.  Assignment Problems and the Location of Economic Activities , 1957 .

[59]  L. A. Eales Song learning in zebra finches: some effects of song model availability on what is learnt and when , 1985, Animal Behaviour.

[60]  Donald B. Rubin,et al.  Max-imum Likelihood from Incomplete Data , 1972 .

[61]  Miya K. Rand,et al.  Characteristics of sequential movements during early learning period in monkeys , 2000, Experimental Brain Research.

[62]  Georg B. Keller,et al.  Neural processing of auditory feedback during vocal practice in a songbird , 2009, Nature.

[63]  Daniel M. Wolpert,et al.  Signal-dependent noise determines motor planning , 1998, Nature.

[64]  M. Fee,et al.  Two Distinct Modes of Forebrain Circuit Dynamics Underlie Temporal Patterning in the Vocalizations of Young Songbirds , 2011, The Journal of Neuroscience.

[65]  Matt J. Kusner,et al.  From Word Embeddings To Document Distances , 2015, ICML.

[66]  J. Cynx Experimental determination of a unit of song production in the zebra finch (Taeniopygia guttata). , 1990, Journal of comparative psychology.

[67]  Daniel M. Wolpert,et al.  The Main Sequence of Saccades Optimizes Speed-accuracy Trade-off , 2006, Biological Cybernetics.

[68]  T. Troyer,et al.  An associational model of birdsong sensorimotor learning II. Temporal hierarchies and the learning of song sequence. , 2000, Journal of neurophysiology.

[69]  R A Abrams,et al.  Optimality in human motor performance: ideal control of rapid aimed movements. , 1988, Psychological review.

[70]  T W Troyer,et al.  An associational model of birdsong sensorimotor learning I. Efference copy and the learning of song syllables. , 2000, Journal of neurophysiology.