Learning temporal integration from internal feedback

There has been much focus on the mechanisms of temporal integration, but little on how circuits learn to integrate. In the adult oculomotor system, where a neural integrator maintains fixations, changes in integration dynamics can be driven by visual error signals. However, we show through dark-rearing experiments that visual inputs are not necessary for initial integrator development. We therefore propose a vision-independent learning mechanism whereby a recurrent network learns to integrate via a ‘teaching’ signal formed by low-pass filtered feedback of its population activity. The key is the segregation of local recurrent inputs onto a dendritic compartment and teaching inputs onto a somatic compartment of an integrator neuron. Model instantiation for oculomotor control shows how a self-corrective teaching signal through the cerebellum can generate an integrator with both the dynamical and tuning properties necessary to drive eye muscles and maintain gaze angle. This bootstrap learning paradigm may be relevant for development and plasticity of temporal integration more generally. Highlights - A neuronal architecture that learns to integrate saccadic commands for eye position. - Learning is based on the recurrent dendritic prediction of somatic teaching signals. - Experiment and model show that no visual feedback is required for initial integrator learning. - Cerebellum is an internal teacher for motor nuclei and integrator population.

[1]  Y Trotter,et al.  Role of extraocular muscle proprioception in the development of depth perception in cats. , 1987, Journal of neurophysiology.

[2]  I. Donaldson,et al.  The functions of the proprioceptors of the eye muscles. , 2000, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[3]  A. Fuchs,et al.  Role of primate flocculus during rapid behavioral modification of vestibuloocular reflex. II. Mossy fiber firing patterns during horizontal head rotation and eye movement. , 1978, Journal of neurophysiology.

[4]  R. Llinás,et al.  Mossy and climbing fiber projections of extraocular muscle afferents to the cerebellum. , 1972, Brain research.

[5]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[6]  A. Brodal,et al.  THE CEREBELLAR PROJECTION OF THE PERI‐HYPOGLOSSAL NUCLEI (NUCLEUS INTERCALATUS, NUCLEUS PRAEPOSITUS HYPOGLOSSI AND NUCLEUS OF ROLLER) IN THE CAT , 1954, Journal of neuropathology and experimental neurology.

[7]  W. Senn,et al.  Learning by the Dendritic Prediction of Somatic Spiking , 2014, Neuron.

[8]  Alexandro D. Ramirez,et al.  Electron Microscopic Reconstruction of Functionally Identified Cells in a Neural Integrator , 2017, Current Biology.

[9]  R. Pfeifer,et al.  Self-Organization, Embodiment, and Biologically Inspired Robotics , 2007, Science.

[10]  D. Tank,et al.  Functional dissection of circuitry in a neural integrator , 2007, Nature Neuroscience.

[11]  S. D. Lac,et al.  Diverse Precerebellar Neurons Share Similar Intrinsic Excitability , 2011, The Journal of Neuroscience.

[12]  Timothy D. Hanks,et al.  Neural underpinnings of the evidence accumulator , 2016, Current Opinion in Neurobiology.

[13]  D. Sornette,et al.  The US Stock Market Leads the Federal Funds Rate and Treasury Bond Yields , 2011, PloS one.

[14]  Robert Baker,et al.  Chapter 21 Characterization of Purkinje cells in the goldfish cerebellum during eye movement and adaptive modification of the vestibulo-ocular reflex , 1997 .

[15]  H. Markram,et al.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[16]  R. Baker,et al.  Discharge characteristics of medial rectus and abducens motoneurons in the goldfish. , 1991, Journal of neurophysiology.

[17]  Guy Major,et al.  NMDA and GABAB (KIR) Conductances: The “Perfect Couple” for Bistability , 2013, The Journal of Neuroscience.

[18]  H. Seung,et al.  Robust persistent neural activity in a model integrator with multiple hysteretic dendrites per neuron. , 2003, Cerebral cortex.

[19]  A. Koulakov,et al.  Correlated Connectivity and the Distribution of Firing Rates in the Neocortex , 2008, The Journal of Neuroscience.

[20]  Johanni Brea,et al.  Prospective Coding by Spiking Neurons , 2016, PLoS Comput. Biol..

[21]  P. Goldman-Rakic Cellular basis of working memory , 1995, Neuron.

[22]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[23]  Robert Baker,et al.  Morphology and physiology of the cerebellar vestibulolateral lobe pathways linked to oculomotor function in the goldfish. , 2006, Journal of neurophysiology.

[24]  Richard Hans Robert Hahnloser,et al.  Evidence for a causal inverse model in an avian cortico-basal ganglia circuit , 2014, Proceedings of the National Academy of Sciences.

[25]  D. W. Tank,et al.  Spontaneous eye movements in goldfish: oculomotor integrator performance, plasticity, and dependence on visual feedback , 2004, Vision Research.

[26]  Christian K. Machens,et al.  Efficient codes and balanced networks , 2016, Nature Neuroscience.

[27]  A. Pastor,et al.  Dual Encoding of Muscle Tension and Eye Position by Abducens Motoneurons , 2011, The Journal of Neuroscience.

[28]  Ranulfo Romo,et al.  Basic mechanisms for graded persistent activity: discrete attractors, continuous attractors, and dynamic representations , 2003, Current Opinion in Neurobiology.

[29]  Toru Yanagawa,et al.  Measuring Integrated Information from the Decoding Perspective , 2015, PLoS Comput. Biol..

[30]  Sukbin Lim,et al.  Balanced cortical microcircuitry for maintaining information in working memory , 2013, Nature Neuroscience.

[31]  D. Zee,et al.  Oculomotor function in the rhesus monkey after deafferentation of the extraocular muscles , 2001, Experimental Brain Research.

[32]  H S Seung,et al.  How the brain keeps the eyes still. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[33]  A. Fuchs,et al.  Discharge patterns in nucleus prepositus hypoglossi and adjacent medial vestibular nucleus during horizontal eye movement in behaving macaques. , 1992, Journal of neurophysiology.

[34]  R. Baker,et al.  Characterization of Purkinje cells in the goldfish cerebellum during eye movement and adaptive modification of the vestibulo-ocular reflex. , 1997, Progress in brain research.

[35]  L. Maffei,et al.  Instability of the eye in the dark and proprioception , 1977, Nature.

[36]  H. Seung,et al.  Plasticity and tuning of the time course of analog persistent firing in a neural integrator. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[37]  A. Fuchs,et al.  Extraocular muscle afferents to the cerebellum of the cat , 1969, The Journal of physiology.

[38]  H. Sompolinsky,et al.  Temporal integration by calcium dynamics in a model neuron , 2003, Nature Neuroscience.

[39]  A. Koulakov,et al.  Model for a robust neural integrator , 2002, Nature Neuroscience.

[40]  David W Tank,et al.  Instrumentation for measuring oculomotor performance and plasticity in larval organisms. , 2004, Methods in cell biology.

[41]  H. Seung,et al.  Anatomy and discharge properties of pre-motor neurons in the goldfish medulla that have eye-position signals during fixations. , 2000, Journal of neurophysiology.

[42]  Reza Shadmehr,et al.  A memory of errors in sensorimotor learning , 2014, Science.

[43]  Patrick Cavanagh,et al.  A jitter after-effect reveals motion-based stabilization of vision , 1998, Nature.

[44]  Daniel D. Lee,et al.  Stability of the Memory of Eye Position in a Recurrent Network of Conductance-Based Model Neurons , 2000, Neuron.

[45]  H. Seung,et al.  In vivo intracellular recording and perturbation of persistent activity in a neural integrator , 2001, Nature Neuroscience.

[46]  Robert A McCrea,et al.  Nucleus prepositus. , 2006, Progress in brain research.

[47]  Ulises Pereira,et al.  Attractor dynamics in networks with learning rules inferred from in vivo data , 2017 .

[48]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[49]  M. Steinbach Proprioceptive knowledge of eye position , 1987, Vision Research.

[50]  Mark S. Goldman,et al.  A Modeling Framework for Deriving the Structural and Functional Architecture of a Short-Term Memory Microcircuit , 2013, Neuron.

[51]  S. Easter,et al.  The development of eye movements in the zebrafish (Danio rerio). , 1997, Developmental psychobiology.

[52]  Aristides B. Arrenberg,et al.  A Structural and Genotypic Scaffold Underlying Temporal Integration , 2015, The Journal of Neuroscience.

[53]  Blas Torres,et al.  Diminution of Voltage Threshold Plays a Key Role in Determining Recruitment of Oculomotor Nucleus Motoneurons during Postnatal Development , 2011, PloS one.