Study of Recall Time of Associative Memory in a Memristive Hopfield Neural Network

By associative memory, people can remember a pattern in microseconds to seconds. In order to emulate human memory, an artificial neural network should also spend a reasonable time in recalling matters of different task difficulties or task familiarities. In this paper, we study the recall time in a memristive Hopfield network (MHN) implemented with memristor-based synapses. With the operating frequencies of 1–100 kHz, patterns can be stored into the network by altering the resistance of the memristors, and the pre-stored patterns can be successfully recalled, being similar to the associative memory behavior. For the same target pattern (the same familiarity), recall time of the MHN varies with the inputs, which is similar to the effect in the human brain that recall time depends on task difficulty. On the other hand, for the same input (i.e., the same initial state), the recall time may be different for different target patterns, which is similar to the effect in the brain that recall time depends on the familiarity. In addition, the effect of stimulation (updating frequency) on recall time may be complicated: a higher stimulation frequency may not always lead to a faster recall (it may even slow the recalling process in some circumstances). Our memristive Hopfield network shows good potential in mimicking the characteristics of human associative memory.

[1]  Sandro Romani,et al.  Neural Network Model of Memory Retrieval , 2015, Front. Comput. Neurosci..

[2]  Peter Meerlo,et al.  The role of sleep in regulating structural plasticity and synaptic strength: Implications for memory and cognitive function. , 2017, Sleep medicine reviews.

[3]  David C Rowland,et al.  Place cells, grid cells, and memory. , 2015, Cold Spring Harbor perspectives in biology.

[4]  Ming-Feng Ge,et al.  Finite-time synchronization of memristor chaotic systems and its application in image encryption , 2019, Appl. Math. Comput..

[5]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[6]  Gisbert Schneider,et al.  Deep Learning in Drug Discovery , 2016, Molecular informatics.

[7]  V. Castellucci,et al.  Associative learning signals in the brain , 2008 .

[8]  X. Miao,et al.  Ultrafast Synaptic Events in a Chalcogenide Memristor , 2013, Scientific Reports.

[9]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[10]  R. Johnson,et al.  A spatio-temporal comparison of semantic and episodic cued recall and recognition using event-related brain potentials. , 1998, Brain research. Cognitive brain research.

[11]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[12]  Yang Liu,et al.  Review of Nanostructured Resistive Switching Memristor and Its Applications , 2014 .

[13]  Junwei Sun,et al.  Autonomous memristor chaotic systems of infinite chaotic attractors and circuitry realization , 2018, Nonlinear Dynamics.

[14]  Yiqiang Zhan,et al.  Optimized Near-Zero Quantization Method for Flexible Memristor Based Neural Network , 2018, IEEE Access.

[15]  A. Lansner Associative memory models: from the cell-assembly theory to biophysically detailed cortex simulations , 2009, Trends in Neurosciences.

[16]  Haipeng Peng,et al.  Anti-synchronization of coupled memristive neutral-type neural networks with mixed time-varying delays via randomly occurring control , 2016 .

[17]  Pritish Narayanan,et al.  Experimental Demonstration and Tolerancing of a Large-Scale Neural Network (165 000 Synapses) Using Phase-Change Memory as the Synaptic Weight Element , 2014, IEEE Transactions on Electron Devices.

[18]  Rajanish K. Kamat,et al.  Modelling of nanostructured memristor device characteristics using Artificial Neural Network (ANN) , 2015, J. Comput. Sci..

[19]  Haibo Jiang,et al.  A unified associative memory model based on external inputs of continuous recurrent neural networks , 2016, Neurocomputing.

[20]  Jongin Kim,et al.  Electronic system with memristive synapses for pattern recognition , 2015, Scientific Reports.

[21]  Lixiang Li,et al.  Synchronization control of memristor-based recurrent neural networks with perturbations , 2014, Neural Networks.

[22]  Yu-Fen Wang,et al.  Characterization and Modeling of Nonfilamentary Ta/TaOx/TiO2/Ti Analog Synaptic Device , 2015, Scientific Reports.

[23]  M. Moscovitch,et al.  The effects of spatial contextual familiarity on remembered scenes, episodic memories, and imagined future events. , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[24]  L. Chua Memristor-The missing circuit element , 1971 .

[25]  Sumio Hosaka,et al.  Design of an electronic synapse with spike time dependent plasticity based on resistive memory device , 2013 .

[26]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[27]  D. Kullmann,et al.  Long-term synaptic plasticity in hippocampal interneurons , 2007, Nature Reviews Neuroscience.

[28]  Y. Liu,et al.  Synaptic Learning and Memory Functions Achieved Using Oxygen Ion Migration/Diffusion in an Amorphous InGaZnO Memristor , 2012 .

[29]  J. Hopfield,et al.  Computing with neural circuits: a model. , 1986, Science.

[30]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[31]  David Li,et al.  Deep Learning in Drug Discovery and Medicine; Scratching the Surface , 2018, Molecules.

[32]  Michael Burke,et al.  Topography and Dynamics of Associative Long-term Memory Retrieval in Humans , 2007, Journal of Cognitive Neuroscience.

[33]  Paul E. Gilbert,et al.  Impaired spatial pattern separation performance in temporal lobe epilepsy is associated with visuospatial memory deficits and hippocampal volume loss , 2018, Neuropsychologia.

[34]  Lixiang Li,et al.  Finite-time stability and synchronization of memristor-based fractional-order fuzzy cellular neural networks , 2018, Commun. Nonlinear Sci. Numer. Simul..

[35]  Zhen Liu,et al.  Synaptic long-term potentiation realized in Pavlov's dog model based on a NiOx-based memristor , 2014 .

[36]  Sumio Hosaka,et al.  Associative memory realized by a reconfigurable memristive Hopfield neural network , 2015, Nature Communications.