Optimal spectral templates for triggered feedback experiments

In the field of songbird neuroscience, researchers have used playback of aversive noise bursts to drive changes in song behavior for specific syllables within a bird’s song. Typically, a short (~5-10 msec) slice of the syllable is selected for targeting and the average spectrum of the slice is used as a template. Sounds that are sufficiently close to the template are considered a match. If other syllables have portions that are spectrally similar to the target, false positive errors will weaken the operant contingency. We present a gradient descent method for template optimization that increases the separation in distance between target and distractors slices, greatly improving targeting accuracy. Applied to songs from five adult Bengalese finches, the fractional reduction in errors for sub-syllabic slices was 51.54±22.92%. At the level of song syllables, we use an error metric that controls for the vastly greater number of distractors vs. target syllables. Setting 5% average error (misses + false positives) as a minimal performance criterion, the number of targetable syllables increased from 3 to 16 out of 61 syllables. At 10% error, targetable syllables increased from 11 to 26. By using simple and robust linear discriminant methods, the algorithm reaches near asymptotic performance when using 10 songs as training data, and the error increases by <2.3% on average when using only a single song for training. Targeting is temporally precise, with average jitter of 3.33 msec for the 16 accurately targeted syllables. Because the algorithm is concerned only with the problem of template selection, it can be used as a simple and robust front end for existing hardware and software implementations for triggered feedback.

[1]  Michael S Brainard,et al.  Mechanisms and time course of vocal learning and consolidation in the adult songbird. , 2011, Journal of neurophysiology.

[2]  J. Goldberg,et al.  Dopamine neurons encode performance error in singing birds , 2016, Science.

[3]  Michael S. Brainard,et al.  Covert skill learning in a cortical-basal ganglia circuit , 2012, Nature.

[4]  W. Schultz Neuronal Reward and Decision Signals: From Theories to Data. , 2015, Physiological reviews.

[5]  Richard H R Hahnloser,et al.  A Higher Sensory Brain Region Is Involved in Reversing Reinforcement-Induced Vocal Changes in a Songbird , 2014, The Journal of Neuroscience.

[6]  Georg B. Keller,et al.  Neural processing of auditory feedback during vocal practice in a songbird , 2009, Nature.

[7]  T. Maia Reinforcement learning, conditioning, and the brain: Successes and challenges , 2009, Cognitive, affective & behavioral neuroscience.

[8]  Chihiro Mori,et al.  The Songbird as a Percussionist: Syntactic Rules for Non-Vocal Sound and Song Production in Java Sparrows , 2015, PloS one.

[9]  C. Jagger,et al.  Gender Differences in Health Expectancies across the Disablement Process among Older Thais , 2015, PloS one.

[10]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[11]  A. Doupe,et al.  Contributions of an avian basal ganglia–forebrain circuit to real-time modulation of song , 2005, Nature.

[12]  K. Okanoya The Bengalese Finch: A Window on the Behavioral Neurobiology of Birdsong Syntax , 2004, Annals of the New York Academy of Sciences.

[13]  T. Roberts,et al.  A Basal Ganglia Circuit Sufficient to Guide Birdsong Learning , 2017, Neuron.

[14]  S. Sober,et al.  Adult birdsong is actively maintained by error correction , 2009, Nature Neuroscience.

[15]  Lucas Y Tian,et al.  Discrete Circuits Support Generalized versus Context-Specific Vocal Learning in the Songbird , 2017, Neuron.

[16]  Michale S Fee,et al.  A basal ganglia-forebrain circuit in the songbird biases motor output to avoid vocal errors , 2009, Proceedings of the National Academy of Sciences.

[17]  Michael S. Brainard,et al.  Variable Sequencing Is Actively Maintained in a Well Learned Motor Skill , 2012, The Journal of Neuroscience.

[18]  Bruce R Donald,et al.  Auditory synapses to song premotor neurons are gated off during vocalization in zebra finches , 2014, eLife.

[19]  C. E. Ho,et al.  A procedure for an automated measurement of song similarity , 2000, Animal Behaviour.

[20]  David A. Nicholson,et al.  Comparison of machine learning methods applied to birdsong element classification , 2016, SciPy.

[21]  Samuel J Sober,et al.  Vocal Generalization Depends on Gesture Identity and Sequence , 2014, The Journal of Neuroscience.

[22]  M. Fee,et al.  A role for descending auditory cortical projections in songbird vocal learning , 2014, eLife.

[23]  M. Brainard,et al.  Performance variability enables adaptive plasticity of ‘crystallized’ adult birdsong , 2007, Nature.

[24]  Erin Hisey,et al.  A common neural circuit mechanism for internally guided and externally reinforced forms of motor learning , 2018, Nature Neuroscience.

[25]  L. Nathan Perkins,et al.  A fast and accurate zebra finch syllable detector , 2017, PloS one.

[26]  Bence P. Ölveczky,et al.  Motor circuits are required to encode a sensory model for imitative learning , 2012, Nature Neuroscience.

[27]  Mike Skocik,et al.  Real-time system for studies of the effects of acoustic feedback on animal vocalizations , 2013, Front. Neural Circuits.

[28]  Kosuke Hamaguchi,et al.  Recurrent Interactions between the Input and Output of a Songbird Cortico-Basal Ganglia Pathway Are Implicated in Vocal Sequence Variability , 2012, The Journal of Neuroscience.

[29]  Michael S. Brainard,et al.  Learning the microstructure of successful behavior , 2011, Nature Neuroscience.

[30]  J. Goldberg,et al.  Songbird Ventral Pallidum Sends Diverse Performance Error Signals to Dopaminergic Midbrain , 2019, Neuron.

[31]  Yoram Burak,et al.  The Basal Ganglia Is Necessary for Learning Spectral, but Not Temporal, Features of Birdsong , 2013, Neuron.

[32]  R. Mooney,et al.  Discrete Evaluative and Premotor Circuits Enable Vocal Learning in Songbirds , 2019, Neuron.