Extended Temporal Association Memory by Modulations of Inhibitory Circuits.

Hebbian learning of excitatory synapses plays a central role in storing activity patterns in associative memory models. Interstimulus Hebbian learning associates multiple items by converting temporal correlation to spatial correlation between attractors. Growing evidence suggests the importance of inhibitory plasticity in memory processing, but the consequence of such regulation in associative memory has not been understood. Noting that Hebbian learning of inhibitory synapses yields an anti-Hebbian effect, we show that the combination of Hebbian and anti-Hebbian learning can significantly increase the span of temporal association between correlated attractors as well as the sensitivity of these states to external input. Furthermore, these effects are regulated by changing the ratio of local and global recurrent inhibition after learning weights for excitation-inhibition balance. Our results suggest a nontrivial role of plasticity and modulation of inhibitory circuits in associative memory.

[1]  M. Tsodyks,et al.  The Enhanced Storage Capacity in Neural Networks with Low Activity Level , 1988 .

[2]  Daniel J. Amit,et al.  Conversion of Temporal Correlations Between Stimuli to Spatial Correlations Between Attractors , 1999, Neural Computation.

[3]  Brent Doiron,et al.  Inhibitory stabilization and visual coding in cortical circuits with multiple interneuron subtypes. , 2016, Journal of neurophysiology.

[4]  Joshua I. Sanders,et al.  Cortical interneurons that specialize in disinhibitory control , 2013, Nature.

[5]  J. Buhmann,et al.  Associative memory with high information content. , 1989, Physical review. A, General physics.

[6]  Sompolinsky,et al.  Spin-glass models of neural networks. , 1985, Physical review. A, General physics.

[7]  Jonathan W. Pillow,et al.  Discovering Event Structure in Continuous Narrative Perception and Memory , 2016, Neuron.

[8]  M. Tsodyks,et al.  Capacity of networks with correlated attractors , 1994 .

[9]  J. J. Couey,et al.  Lateral inhibition by Martinotti interneurons is facilitated by cholinergic inputs in human and mouse neocortex , 2018, Nature Communications.

[10]  E. Zohary,et al.  Inter-trial neuronal activity in inferior temporal cortex: a putative vehicle to generate long-term visual associations , 1998, Nature Neuroscience.

[11]  Tobias Navarro Schröder,et al.  An event map of memory space in the hippocampus , 2016, eLife.

[12]  M. Stryker,et al.  A Cortical Circuit for Gain Control by Behavioral State , 2014, Cell.

[13]  Timothy E. J. Behrens,et al.  Inhibitory engrams in perception and memory , 2017, Proceedings of the National Academy of Sciences.

[14]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[15]  Y. Miyashita.  Neuronal correlate of visual associative long-term memory in the primate temporal cortex , 1988, Nature.

[16]  Front , 2020, 2020 Fourth World Conference on Smart Trends in Systems, Security and Sustainability (WorldS4).

[17]  M. Botvinick,et al.  Statistical learning of temporal community structure in the hippocampus , 2016, Hippocampus.

[18]  P. Jonas,et al.  Symmetric spike timing-dependent plasticity at CA3–CA3 synapses optimizes storage and recall in autoassociative networks , 2016, Nature Communications.

[19]  Henning Sprekeler,et al.  Inhibitory Plasticity Balances Excitation and Inhibition in Sensory Pathways and Memory Networks , 2011, Science.

[20]  Yang Dan,et al.  Cell-type-specific modulation of neocortical activity by basal forebrain input , 2013, Front. Syst. Neurosci..

[21]  N Brunel,et al.  Correlations of cortical Hebbian reverberations: theory versus experiment , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  Nicolas Brunel,et al.  Hebbian Learning of Context in Recurrent Neural Networks , 1996, Neural Computation.

[23]  David A Lewis,et al.  Cholinergic modulation of neuronal excitability and recurrent excitation‐inhibition in prefrontal cortex circuits: implications for gamma oscillations , 2013, The Journal of physiology.

[24]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[25]  Peter Dayan,et al.  Acetylcholine in cortical inference , 2002, Neural Networks.

[26]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[27]  Mriganka Sur,et al.  An acetylcholine-activated microcircuit drives temporal dynamics of cortical activity , 2015, Nature Neuroscience.

[28]  H. Adesnik,et al.  A neural circuit for spatial summation in visual cortex , 2012, Nature.