A Hebbian learning rule gives rise to mirror neurons and links them to control theoretic inverse models

Mirror neurons are neurons whose responses to the observation of a motor act resemble responses measured during production of that act. Computationally, mirror neurons have been viewed as evidence for the existence of internal inverse models. Such models, rooted within control theory, map-desired sensory targets onto the motor commands required to generate those targets. To jointly explore both the formation of mirrored responses and their functional contribution to inverse models, we develop a correlation-based theory of interactions between a sensory and a motor area. We show that a simple eligibility-weighted Hebbian learning rule, operating within a sensorimotor loop during motor explorations and stabilized by heterosynaptic competition, naturally gives rise to mirror neurons as well as control theoretic inverse models encoded in the synaptic weights from sensory to motor neurons. Crucially, we find that the correlational structure or stereotypy of the neural code underlying motor explorations determines the nature of the learned inverse model: random motor codes lead to causal inverses that map sensory activity patterns to their motor causes; such inverses are maximally useful, by allowing the imitation of arbitrary sensory target sequences. By contrast, stereotyped motor codes lead to less useful predictive inverses that map sensory activity to future motor actions. Our theory generalizes previous work on inverse models by showing that such models can be learned in a simple Hebbian framework without the need for error signals or backpropagation, and it makes new conceptual connections between the causal nature of inverse models, the statistical structure of motor variability, and the time-lag between sensory and motor responses of mirror neurons. Applied to bird song learning, our theory can account for puzzling aspects of the song system, including necessity of sensorimotor gating and selectivity of auditory responses to bird's own song (BOS) stimuli.

[1]  F. Nottebohm,et al.  Central control of song in the canary, Serinus canarius , 1976, The Journal of comparative neurology.

[2]  G. Lynch,et al.  Heterosynaptic depression: a postsynaptic correlate of long-term potentiation , 1977, Nature.

[3]  J. S. McCasland,et al.  Interaction between auditory and motor activities in an avian song control nucleus. , 1981, Proceedings of the National Academy of Sciences of the United States of America.

[4]  L. C. Katz,et al.  Auditory responses in the zebra finch's motor system for song , 1981, Brain Research.

[5]  D. Margoliash Acoustic parameters underlying the responses of song-specific neurons in the white-crowned sparrow , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  A. Arnold,et al.  Forebrain lesions disrupt development but not maintenance of song in passerine birds. , 1984, Science.

[7]  H. Williams,et al.  Auditory responses in avian vocal motor neurons: a motor theory for song perception in birds. , 1985, Science.

[8]  D Margoliash,et al.  Preference for autogenous song by auditory neurons in a song system nucleus of the white-crowned sparrow , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[10]  W. Thomas Miller,et al.  Sensor-based control of robotic manipulators using a general learning algorithm , 1987, IEEE J. Robotics Autom..

[11]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. I. Relations between single cell discharge and direction of movement , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  Mitsuo Kawato,et al.  Feedback-Error-Learning Neural Network for Supervised Motor Learning , 1990 .

[13]  Lakmal Seneviratne,et al.  Adaptive Control Of Robot Manipulators , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Michael I. Jordan,et al.  Forward Models: Supervised Learning with a Distal Teacher , 1992, Cogn. Sci..

[15]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[16]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[17]  M. Lewicki Intracellular Characterization of Song-Specific Neurons in the Zebra Finch Auditory Forebrain , 1996, The Journal of Neuroscience.

[18]  J. Mcgeown,et al.  The temporal profile of calcium transients in voltage clamped gastric myocytes from Bufo marinus. , 1996, The Journal of physiology.

[19]  E. Nordeen,et al.  Blockade of NMDA Receptors in the Anterior Forebrain Impairs Sensory Acquisition in the Zebra Finch (Poephila guttata) , 1996, Neurobiology of Learning and Memory.

[20]  D Margoliash,et al.  Behavioral state modulation of auditory activity in a vocal motor system. , 1998, Science.

[21]  Masakazu Konishi,et al.  Gating of auditory responses in the vocal control system of awake songbirds , 1998, Nature Neuroscience.

[22]  A. Doupe,et al.  Contributions of Tutor and Bird’s Own Song Experience to Neural Selectivity in the Songbird Anterior Forebrain , 1999, The Journal of Neuroscience.

[23]  D. Margoliash,et al.  Song replay during sleep and computational rules for sensorimotor vocal learning. , 2000, Science.

[24]  K. D. Punta,et al.  An ultra-sparse code underlies the generation of neural sequences in a songbird , 2002 .

[25]  Jessica A. Cardin,et al.  Song system auditory responses are stable and highly tuned during sedation, rapidly modulated and unselective during wakefulness, and suppressed by arousal. , 2003, Journal of neurophysiology.

[26]  H. Seung,et al.  Learning in Spiking Neural Networks by Reinforcement of Stochastic Synaptic Transmission , 2003, Neuron.

[27]  Stephen D. Shea,et al.  Basal Forebrain Cholinergic Modulation of Auditory Activity in the Zebra Finch Song System , 2003, Neuron.

[28]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[29]  Jessica A. Cardin,et al.  Auditory responses in multiple sensorimotor song system nuclei are co-modulated by behavioral state. , 2004, Journal of neurophysiology.

[30]  Anthony Leonardo,et al.  Experimental test of the birdsong error-correction model. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[31]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[32]  A. Doupe,et al.  Contributions of an avian basal ganglia–forebrain circuit to real-time modulation of song , 2005, Nature.

[33]  A. Leonardo,et al.  Ensemble Coding of Vocal Control in Birdsong , 2005, The Journal of Neuroscience.

[34]  Aaron S. Andalman,et al.  Vocal Experimentation in the Juvenile Songbird Requires a Basal Ganglia Circuit , 2005, PLoS biology.

[35]  Michael A. Arbib,et al.  Mirror neurons and imitation: A computationally guided review , 2006, Neural Networks.

[36]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[37]  J. Sakata,et al.  Real-Time Contributions of Auditory Feedback to Avian Vocal Motor Control , 2006, The Journal of Neuroscience.

[38]  Satrajit S. Ghosh,et al.  Neural modeling and imaging of the cortical interactions underlying syllable production , 2006, Brain and Language.

[39]  Byron M. Yu,et al.  A high-performance brain–computer interface , 2006, Nature.

[40]  H. Seung,et al.  Model of birdsong learning based on gradient estimation by dynamic perturbation of neural conductances. , 2007, Journal of neurophysiology.

[41]  Richard Mooney,et al.  Thalamic Gating of Auditory Responses in Telencephalic Song Control Nuclei , 2007, The Journal of Neuroscience.

[42]  M. Fee,et al.  Singing-related activity of identified HVC neurons in the zebra finch. , 2007, Journal of neurophysiology.

[43]  Richard Mooney,et al.  Auditory Plasticity in a Basal Ganglia–Forebrain Pathway during Decrystallization of Adult Birdsong , 2007, The Journal of Neuroscience.

[44]  M. Dresselhaus,et al.  A Specialized Forebrain Circuit for Vocal Babbling in the Juvenile Songbird , 2008 .

[45]  Richard H R Hahnloser,et al.  Spikes and Bursts in Two Types of Thalamic Projection Neurons Differentially Shape Sleep Patterns and Auditory Responses in a Songbird , 2008, The Journal of Neuroscience.

[46]  Damian J. Wallace,et al.  Single-spike detection in vitro and in vivo with a genetic Ca2+ sensor , 2008, Nature Methods.

[47]  J. F. Prather,et al.  Precise auditory–vocal mirroring in neurons for learned vocal communication , 2008, Nature.

[48]  Michael S. Brainard,et al.  Online Contributions of Auditory Feedback to Neural Activity in Avian Song Control Circuitry , 2008, The Journal of Neuroscience.

[49]  M. Volgushev,et al.  Heterosynaptic plasticity in the neocortex , 2009, Experimental Brain Research.

[50]  Allison J Doupe,et al.  Activity in a cortical-basal ganglia circuit for song is required for social context-dependent vocal variability. , 2010, Journal of neurophysiology.

[51]  Richard Hans Robert Hahnloser,et al.  Spike-Time-Dependent Plasticity and Heterosynaptic Competition Organize Networks to Produce Long Scale-Free Sequences of Neural Activity , 2010, Neuron.

[52]  Markus Diesmann,et al.  A reafferent and feed-forward model of song syntax generation in the Bengalese finch , 2011, Journal of Computational Neuroscience.

[53]  Bence P. Ölveczky,et al.  Motor circuits are required to encode a sensory model for imitative learning , 2012, Nature Neuroscience.

[54]  Christopher D. Harvey,et al.  Choice-specific sequences in parietal cortex during a virtual-navigation decision task , 2012, Nature.

[55]  L. Miller,et al.  Restoration of grasp following paralysis through brain-controlled stimulation of muscles , 2012, Nature.

[56]  Richard Hans Robert Hahnloser,et al.  Vocal learning with inverse models , 2013 .

[57]  A. Dickinson,et al.  Associative (not Hebbian) learning and the mirror neuron system , 2013, Neuroscience Letters.

[58]  M. Arbib,et al.  Mirror neurons: Functions, mechanisms and models , 2013, Neuroscience Letters.

[59]  C. Catmur Sensorimotor learning and the ontogeny of the mirror neuron system , 2013, Neuroscience Letters.