Learning and retrieval behavior in recurrent neural networks with pre-synaptic dependent homeostatic plasticity

The plastic character of brain synapses is considered to be one of the foundations for the formation of memories. There are numerous kinds of such phenomenon currently described in the literature, but their role in the development of information pathways in neural networks with recurrent architectures is still not completely clear. In this paper we study the role of an activity-based process, called pre-synaptic dependent homeostatic scaling, in the organization of networks that yield precise-timed spiking patterns. It encodes spatio-temporal information in the synaptic weights as it associates a learned input with a specific response. We introduce a correlation measure to evaluate the precision of the spiking patterns and explore the effects of different inhibitory interactions and learning parameters. We find that large learning periods are important in order to improve the network learning capacity and discuss this ability in the presence of distinct inhibitory currents.

[1]  Everton J. Agnes,et al.  Associative Memory in Neuronal Networks of Spiking Neurons: Architecture and Storage Analysis , 2012, ICANN.

[2]  M. London,et al.  Sensitivity to perturbations in vivo implies high noise and suggests rate coding in cortex , 2010, Nature.

[3]  Dean V Buonomano,et al.  Embedding Multiple Trajectories in Simulated Recurrent Neural Networks in a Self-Organizing Manner , 2009, The Journal of Neuroscience.

[4]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[5]  E. Bienenstock.  A model of neocortex , 1995 .

[6]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[7]  Romain Brette,et al.  Philosophy of the Spike: Rate-Based vs. Spike-Based Theories of the Brain , 2015, Front. Syst. Neurosci..

[8]  Maxim Bazhenov,et al.  Pathological Effect of Homeostatic Synaptic Scaling on Network Dynamics in Diseases of the Cortex , 2008, The Journal of Neuroscience.

[9]  Leonardo Gregory Brunnet,et al.  Physica a Model Architecture for Associative Memory in a Neural Network of Spiking Neurons , 2022 .

[10]  A. Zador,et al.  Balanced inhibition underlies tuning and sharpens spike timing in auditory cortex , 2003, Nature.

[11]  A. Aertsen,et al.  Conditions for Propagating Synchronous Spiking and Asynchronous Firing Rates in a Cortical Network Model , 2008, The Journal of Neuroscience.

[12]  N. Logothetis,et al.  Millisecond encoding precision of auditory cortex neurons , 2010, Proceedings of the National Academy of Sciences.

[13]  M. Maravall,et al.  Variable Temporal Integration of Stimulus Patterns in the Mouse Barrel Cortex , 2016, Cerebral cortex.

[14]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[15]  G. Turrigiano,et al.  Rapid Synaptic Scaling Induced by Changes in Postsynaptic Firing , 2008, Neuron.

[16]  W. Maass,et al.  State-dependent computations: spatiotemporal processing in cortical networks , 2009, Nature Reviews Neuroscience.

[17]  Mark C. W. van Rossum,et al.  Stable Hebbian Learning from Spike Timing-Dependent Plasticity , 2000, The Journal of Neuroscience.

[18]  Wulfram Gerstner,et al.  Synaptic Plasticity in Neural Networks Needs Homeostasis with a Fast Rate Detector , 2013, PLoS Comput. Biol..

[19]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[20]  Christian K. Machens,et al.  Efficient codes and balanced networks , 2016, Nature Neuroscience.

[21]  Peter A. Appleby,et al.  Triphasic spike-timing-dependent plasticity organizes networks to produce robust sequences of neural activity , 2012, Front. Comput. Neurosci..

[22]  G. Edelman,et al.  Spike-timing dynamics of neuronal groups. , 2004, Cerebral cortex.

[23]  G. Edelman,et al.  Large-scale model of mammalian thalamocortical systems , 2008, Proceedings of the National Academy of Sciences.

[24]  Youping Deng,et al.  Feature Selection and Classification of MAQC-II Breast Cancer and Multiple Myeloma Microarray Gene Expression Data , 2009, PloS one.

[25]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[26]  Moshe Abeles,et al.  On Embedding Synfire Chains in a Balanced Network , 2003, Neural Computation.

[27]  Everton J. Agnes,et al.  Diverse synaptic plasticity mechanisms orchestrated to form and retrieve memories in spiking neural networks , 2015, Nature Communications.

[28]  Bard Ermentrout,et al.  A model for complex sequence learning and reproduction in neural populations , 2011, Journal of Computational Neuroscience.

[29]  Zhen-Su She,et al.  A Spike-Timing Pattern Based Neural Network Model for the Study of Memory Dynamics , 2009, PloS one.

[30]  G. Turrigiano.  Homeostatic synaptic plasticity: local and global mechanisms for stabilizing neuronal function. , 2012, Cold Spring Harbor perspectives in biology.

[31]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[32]  T. Sejnowski,et al.  Regulation of spike timing in visual cortical circuits , 2008, Nature Reviews Neuroscience.

[33]  Dean V Buonomano,et al.  Timing of neural responses in cortical organotypic slices , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[34]  Richard Hans Robert Hahnloser,et al.  Spike-Time-Dependent Plasticity and Heterosynaptic Competition Organize Networks to Produce Long Scale-Free Sequences of Neural Activity , 2010, Neuron.

[35]  Joseph K Jun,et al.  Development of Neural Circuitry for Precise Temporal Sequences through Spontaneous Activity, Axon Remodeling, and Synaptic Plasticity , 2007, PloS one.

[36]  Markus Diesmann,et al.  High-capacity embedding of synfire chains in a cortical network model , 2012, Journal of Computational Neuroscience.

[37]  Naoki Masuda,et al.  Formation of feedforward networks and frequency synchrony by spike-timing-dependent plasticity , 2007, Journal of Computational Neuroscience.

[38]  A. Litwin-Kumar,et al.  Formation and maintenance of neuronal assemblies through synaptic plasticity , 2014, Nature Communications.

[39]  B. McNaughton,et al.  Packet-based communication in the cortex , 2015, Nature Reviews Neuroscience.

[40]  Heinrich H. Bülthoff,et al.  Learned Non-Rigid Object Motion is a View-Invariant Cue to Recognizing Novel Objects , 2012, Front. Comput. Neurosci..

[41]  Dean V Buonomano,et al.  A learning rule for the emergence of stable dynamics and timing in recurrent networks. , 2005, Journal of neurophysiology.