The Autapse: A Simple Illustration of Short-Term Analog Memory Storage by Tuned Synaptic Feedback

According to a popular hypothesis, short-term memories are stored as persistent neural activity maintained by synaptic feedback loops. This hypothesis has been formulated mathematically in a number of recurrent network models. Here we study an abstraction of these models, a single neuron with a synapse onto itself, or autapse. This abstraction cannot simulate the way in which persistent activity patterns are distributed over neural populations in the brain. However, with proper tuning of parameters, it does reproduce the continuously graded, or analog, nature of many examples of persistent activity. The conditions for tuning are derived for the dynamics of a conductance-based model neuron with a slow excitatory autapse. The derivation uses the method of averaging to approximate the spiking model with a nonspiking, reduced model. Short-term analog memory storage is possible if the reduced model is approximately linear and if its feedforward bias and autapse strength are precisely tuned.

[1]  R. L. Nó,et al.  VESTIBULO-OCULAR REFLEX ARC , 1933 .

[2]  J. Craggs.  Applied Mathematical Sciences , 1973 .

[3]  B. Cohen.  The Vestibulo-Ocular Reflex Arc , 1974 .

[4]  Edward L. Keller,et al.  A neurological integrator for the oculomotor control system , 1976 .

[5]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[6]  F. Verhulst,et al.  Averaging Methods in Nonlinear Dynamical Systems , 1985 .

[7]  C. Stevens,et al.  Excitatory and inhibitory autaptic currents in isolated hippocampal neurons maintained in cell culture. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[9]  M. Segal,et al.  Epileptiform activity in microcultures containing one excitatory hippocampal neuron. , 1991, Journal of neurophysiology.

[10]  D B Arnold,et al.  A neural network model of the vestibulo-ocular reflex using a local synaptic learning rule. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[11]  John Rinzel,et al.  Activity Patterns of a Slow Synapse Network Predicted by Explicitly Averaging Spike Dynamics , 1992, Neural Computation.

[12]  Xiao-Jing Wang,et al.  Alternating and Synchronous Rhythms in Reciprocally Inhibitory Model Neurons , 1992, Neural Computation.

[13]  Daniel J. Amit,et al.  Conversion of Temporal Correlations Between Stimuli to Spatial Correlations Between Attractors , 1999, Neural Computation.

[14]  A. Georgopoulos,et al.  Cognitive neurophysiology of the motor cortex. , 1993, Science.

[15]  D. Zipser,et al.  A spiking network model of short-term active memory , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  M. Segal.  Endogenous bursts underlie seizurelike activity in solitary excitatory hippocampal neurons in microcultures. , 1994, Journal of neurophysiology.

[17]  Bard Ermentrout,et al.  Reduction of Conductance-Based Models with Slow Synapses to Neural Nets , 1994, Neural Computation.

[18]  N Brunel,et al.  Correlations of cortical Hebbian reverberations: theory versus experiment , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  Walter J. Freeman,et al.  The Hebbian paradigm reintegrated: Local reverberations as internal representations , 1995, Behavioral and Brain Sciences.

[20]  Adam Prügel-Bennett,et al.  Analysis of synfire chains , 1995 .

[21]  J. Fuster.  Memory in the cerebral cortex : an empirical approach to neural networks in the human and nonhuman primate , 1996 .

[22]  H. Markram,et al.  Frequency and Dendritic Distribution of Autapses Established by Layer 5 Pyramidal Neurons in the Developing Rat Neocortex: Comparison with Synaptic Innervation of Adjacent Neurons of the Same Class , 1996, The Journal of Neuroscience.

[23]  J. Hertz,et al.  Learning short synfire chains by self-organization. , 1996, Network.

[24]  K. Zhang,et al.  Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[25]  H S Seung,et al.  How the brain keeps the eyes still. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Robert U Muller,et al.  Head direction cells: properties and functional significance , 1996, Current Opinion in Neurobiology.

[27]  P. Somogyi,et al.  Massive Autaptic Self-Innervation of GABAergic Neurons in Cat Visual Cortex , 1997, The Journal of Neuroscience.

[28]  H. Sebastian Seung,et al.  Learning Continuous Attractors in Recurrent Networks , 1997, NIPS.

[29]  Wolfgang Maass,et al.  Networks of spiking neurons can emulate arbitrary Hopfield nets in temporal coding , 1997 .

[30]  Bard Ermentrout,et al.  Linearization of F-I Curves by Adaptation , 1998, Neural Computation.

[31]  X J Wang,et al.  Calcium coding and adaptive temporal computation in cortical pyramidal neurons. , 1998, Journal of neurophysiology.

[32]  Kenji Doya,et al.  Near-Saddle-Node Bifurcation Behavior as Dynamics in Working Memory for Goal-Directed Behavior , 1998, Neural Computation.

[33]  B. Ermentrout.  Neural networks as spatio-temporal pattern-forming systems , 1998 .

[34]  R. Romo,et al.  Neuronal correlates of parametric working memory in the prefrontal cortex , 1999, Nature.

[35]  E. Fetz,et al.  Primate spinal interneurons show pre-movement instructed delay activity , 1999, Nature.

[36]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[37]  Daniel D. Lee,et al.  Stability of the Memory of Eye Position in a Recurrent Network of Conductance-Based Model Neurons , 2000, Neuron.

[38]  Oren Shriki,et al.  Rate Models for Conductance-Based Cortical Neuronal Networks , 2003, Neural Computation.

[39]  Stephen C. Cannon,et al.  A proposed neural network for the integrator of the oculomotor system , 1983, Biological Cybernetics.

[40]  Xiao-Jing Wang,et al.  A Model of Visuospatial Working Memory in Prefrontal Cortex: Recurrent Network and Cellular Bistability , 1998, Journal of Computational Neuroscience.

[41]  D. Robinson,et al.  The oculomotor integrator: testing of a neural network model , 2006, Experimental Brain Research.