Evidence for a causal inverse model in an avian cortico-basal ganglia circuit

Significance Auditory neural responses mirror motor activity in a songbird cortical area. The average temporal offset of mirrored responses is roughly equal to short sensorimotor loop delays. This correspondence between mirroring offsets and loop delays constitutes evidence for a causal inverse model. Causal inverse models can map a desired sensation into the required action. Learning by imitation is fundamental to both communication and social behavior and requires the conversion of complex, nonlinear sensory codes for perception into similarly complex motor codes for generating action. To understand the neural substrates underlying this conversion, we study sensorimotor transformations in songbird cortical output neurons of a basal-ganglia pathway involved in song learning. Despite the complexity of sensory and motor codes, we find a simple, temporally specific, causal correspondence between them. Sensory neural responses to song playback mirror motor-related activity recorded during singing, with a temporal offset of roughly 40 ms, in agreement with short feedback loop delays estimated using electrical and auditory stimulation. Such matching of mirroring offsets and loop delays is consistent with a recent Hebbian theory of motor learning and suggests that cortico-basal ganglia pathways could support motor control via causal inverse models that can invert the rich correspondence between motor exploration and sensory feedback.

[1]  F. Nottebohm,et al.  Central control of song in the canary, Serinus canarius , 1976, The Journal of comparative neurology.

[2]  J. S. McCasland,et al.  Interaction between auditory and motor activities in an avian song control nucleus. , 1981, Proceedings of the National Academy of Sciences of the United States of America.

[3]  C. Bell An efference copy which is modified by reafferent input. , 1981, Science.

[4]  A. Arnold,et al.  Forebrain lesions disrupt development but not maintenance of song in passerine birds. , 1984, Science.

[5]  J. S. McCasland,et al.  Neuronal control of bird song production , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  A. Doupe,et al.  Song-selective auditory circuits in the vocal control system of the zebra finch. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[7]  D. Margoliash,et al.  Temporal and harmonic combination-sensitive neurons in the zebra finch's HVc , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  C. Gross,et al.  Visuospatial properties of ventral premotor cortex. , 1997, Journal of neurophysiology.

[9]  V. Han,et al.  Synaptic plasticity in a cerebellum-like structure depends on temporal order , 1997, Nature.

[10]  Christopher G. Atkeson,et al.  A comparison of direct and model-based reinforcement learning , 1997, Proceedings of International Conference on Robotics and Automation.

[11]  D Margoliash,et al.  Behavioral state modulation of auditory activity in a vocal motor system. , 1998, Science.

[12]  Masakazu Konishi,et al.  Gating of auditory responses in the vocal control system of awake songbirds , 1998, Nature Neuroscience.

[13]  A. Doupe,et al.  Social context modulates singing-related neural activity in the songbird forebrain , 1999, Nature Neuroscience.

[14]  A. Doupe,et al.  Singing-Related Neural Activity in a Dorsal Forebrain–Basal Ganglia Circuit of Adult Zebra Finches , 1999, The Journal of Neuroscience.

[15]  T. Troyer,et al.  An associational model of birdsong sensorimotor learning II. Temporal hierarchies and the learning of song sequence. , 2000, Journal of neurophysiology.

[16]  K. Sen,et al.  Feature analysis of natural sounds in the songbird auditory forebrain. , 2001, Journal of neurophysiology.

[17]  F. Nottebohm,et al.  Dynamics of the Vocal Imitation Process: How a Zebra Finch Learns Its Song , 2001, Science.

[18]  Berthold Hedwig,et al.  A corollary discharge maintains auditory sensitivity during sound production , 2002, Nature.

[19]  K. D. Punta,et al.  An ultra-sparse code underlies the generation of neural sequences in a songbird , 2002 .

[20]  M. Konishi,et al.  Long Memory in Song Learning by Zebra Finches , 2003, The Journal of Neuroscience.

[21]  A. Meltzoff,et al.  What imitation tells us about social cognition: a rapprochement between developmental psychology and cognitive neuroscience. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[22]  B. Webb Neural mechanisms for prediction: do insects have forward models? , 2004, Trends in Neurosciences.

[23]  Christian K. Machens,et al.  Testing the Efficiency of Sensory Coding with Optimal Stimulus Ensembles , 2005, Neuron.

[24]  J. Glowinski,et al.  Bidirectional Activity-Dependent Plasticity at Corticostriatal Synapses , 2005, The Journal of Neuroscience.

[25]  Aaron S. Andalman,et al.  Vocal Experimentation in the Juvenile Songbird Requires a Basal Ganglia Circuit , 2005, PLoS biology.

[26]  Berthold Hedwig,et al.  The Cellular Basis of a Corollary Discharge , 2006, Science.

[27]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[28]  György Gergely,et al.  Sylvia's Recipe: The Role of Imitation and Pedagogy in the Transmission of Cultural Knowledge , 2006 .

[29]  Michael S Brainard,et al.  Lesions of an avian basal ganglia circuit prevent context-dependent changes to song variability. , 2006, Journal of neurophysiology.

[30]  M. Brainard,et al.  Performance variability enables adaptive plasticity of ‘crystallized’ adult birdsong , 2007, Nature.

[31]  H. Seung,et al.  Model of birdsong learning based on gradient estimation by dynamic perturbation of neural conductances. , 2007, Journal of neurophysiology.

[32]  T. Nick,et al.  Top-down regulation of plasticity in the birdsong system: "premotor" activity in the nucleus HVC predicts song variability better than it predicts song features. , 2008, Journal of neurophysiology.

[33]  Xiaoqin Wang,et al.  Neural substrates of vocalization feedback monitoring in primate auditory cortex , 2008, Nature.

[34]  Michael A Farries,et al.  Organization of the songbird basal ganglia, including area X , 2008, The Journal of comparative neurology.

[35]  Georg B. Keller,et al.  Rapid Interhemispheric Switching during Vocal Production in a Songbird , 2008, PLoS biology.

[36]  Samuel D. Gale,et al.  A novel basal ganglia pathway forms a loop linking a vocal learning circuit with its dopaminergic input , 2008, The Journal of comparative neurology.

[37]  M. Sommer,et al.  Corollary discharge circuits in the primate brain , 2008, Current Opinion in Neurobiology.

[38]  Allison J. Doupe,et al.  Neurons in a Forebrain Nucleus Required for Vocal Plasticity Rapidly Switch between Precise Firing and Variable Bursting Depending on Social Context , 2008, The Journal of Neuroscience.

[39]  J. F. Prather,et al.  Precise auditory–vocal mirroring in neurons for learned vocal communication , 2008, Nature.

[40]  Georg B. Keller,et al.  Neural processing of auditory feedback during vocal practice in a songbird , 2009, Nature.

[41]  Allison J Doupe,et al.  Activity in a cortical-basal ganglia circuit for song is required for social context-dependent vocal variability. , 2010, Journal of neurophysiology.

[42]  Henning Sprekeler,et al.  Functional Requirements for Reward-Modulated Spike-Timing-Dependent Plasticity , 2010, The Journal of Neuroscience.

[43]  Dezhe Z. Jin,et al.  Support for a synaptic chain model of neuronal sequence generation , 2010, Nature.

[44]  S. Bottjer,et al.  Parallel pathways for vocal learning in basal ganglia of songbirds , 2009, Nature Neuroscience.

[45]  Context-related vocalizations in African grey parrots (Psittacus erithacus) , 2012, acta ethologica.

[46]  Gregory F Ball,et al.  Neural Mechanisms for the Coordination of Duet Singing in Wrens , 2011, Science.

[47]  P. Ferrari,et al.  Evolution of mirror systems: a simple mechanism for complex cognitive functions , 2011, Annals of the New York Academy of Sciences.

[48]  Drew N. Robson,et al.  Brain-wide neuronal dynamics during motor adaptation in zebrafish , 2012, Nature.

[49]  Michael S. Brainard,et al.  Covert skill learning in a cortical-basal ganglia circuit , 2012, Nature.

[50]  Richard Hans Robert Hahnloser,et al.  Vocal learning with inverse models , 2013 .

[51]  William A Liberti,et al.  A carbon-fiber electrode array for long-term neural recording , 2013, Journal of neural engineering.

[52]  M. Arbib,et al.  Mirror neurons: Functions, mechanisms and models , 2013, Neuroscience Letters.

[53]  Richard Hans Robert Hahnloser,et al.  A Hebbian learning rule gives rise to mirror neurons and links them to control theoretic inverse models , 2013, Front. Neural Circuits.