Implementation of Memristive Neural Network With Full-Function Pavlov Associative Memory

In this paper, implementation of memristive neural network with full-function Pavlov associative memory is designed based on a proposed associative memory rule. The designed neural network can well perform the Pavlov associative memory in the network with at least three interconnected neurons. This neural network and the associative memory rule that is partly based on spike-rate-dependent plasticity (SRDP) protocol are inspired by the famous Pavlov's dog-experiment that demonstrated the interrelation between the “sight of food” and the “ringing.” Besides the learning activity, the proposed network can also perform two kinds of forgetting activities after the learning process is completed: on one hand, when the salivation neuron is stimulated by the food neuron alone, after a period of time, the ring neuron can no longer trigger the salivation neuron; on the other hand, when the salivation neuron is stimulated by the ring neuron alone, at first the salivation neuron can be triggered but after the salivation neuron realizes that the “ringing” is not associated with “food,” the salivation neuron will not be triggered any longer. How to integrate the proposed network into large scale memristive neural network with multiple associations is also introduced. Simulations results demonstrate the correctness of the designs.

[1]  Peng Li,et al.  Nonvolatile memristor memory: Device characteristics and design implications , 2009, 2009 IEEE/ACM International Conference on Computer-Aided Design - Digest of Technical Papers.

[2]  G. Malliaras,et al.  A light-emitting memristor , 2010 .

[3]  Massimiliano Di Ventra,et al.  Experimental demonstration of associative memory with memristive neural networks , 2009, Neural Networks.

[4]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[5]  Richard A. Chapman,et al.  Neural Learning Circuits Utilizing Nano-Crystalline Silicon Transistors and Memristors , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[6]  E. Tsymbal,et al.  Ferroelectric tunnel memristor. , 2012, Nano letters.

[7]  Toshinori Munakata,et al.  Fundamentals of the New Artificial Intelligence: Neural, Evolutionary, Fuzzy and More (Texts in Computer Science) , 2008 .

[8]  Richard A. Chapman,et al.  SPICE simulation of nanoscale non-crystalline silicon TFTs in spiking neuron circuits , 2010, 2010 53rd IEEE International Midwest Symposium on Circuits and Systems.

[9]  Y. Liu,et al.  Synaptic Learning and Memory Functions Achieved Using Oxygen Ion Migration/Diffusion in an Amorphous InGaZnO Memristor , 2012 .

[10]  Leon N. Cooper,et al.  MEMORIES AND MEMORY: A PHYSICIST'S APPROACH TO THE BRAIN , 2000 .

[11]  C. Toumazou,et al.  A Versatile Memristor Model With Nonlinear Dopant Kinetics , 2011, IEEE Transactions on Electron Devices.

[12]  Xin Wang,et al.  Associate learning and correcting in a memristive neural network , 2013, Neural Computing and Applications.

[13]  Hao Yu,et al.  SPICE simulator for hybrid CMOS memristor circuit and system , 2012, 2012 13th International Workshop on Cellular Nanoscale Networks and their Applications.

[14]  Zhigang Zeng,et al.  Circuit design and exponential stabilization of memristive neural networks , 2015, Neural Networks.

[15]  Gregory S. Snider,et al.  ‘Memristive’ switches enable ‘stateful’ logic operations via material implication , 2010, Nature.

[16]  Xiaoping Wang,et al.  A Novel Design for Memristor-Based Logic Switch and Crossbar Circuits , 2015, IEEE Transactions on Circuits and Systems I: Regular Papers.

[17]  Cong Xu,et al.  Impact of process variations on emerging memristor , 2010, Design Automation Conference.

[18]  K. D. Cantley,et al.  Hebbian Learning in Spiking Neural Networks With Nanocrystalline Silicon TFTs and Memristive Synapses , 2011, IEEE Transactions on Nanotechnology.

[19]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[20]  Janusz A. Starzyk,et al.  Memristor Crossbar Architecture for Synchronous Neural Networks , 2014, IEEE Transactions on Circuits and Systems I: Regular Papers.

[21]  Dalibor Biolek,et al.  SPICE Model of Memristor with Nonlinear Dopant Drift , 2009 .

[22]  Zhigang Zeng,et al.  Synchronization control of a class of memristor-based recurrent neural networks , 2012, Inf. Sci..

[23]  Leon O. Chua,et al.  Neural Synaptic Weighting With a Pulse-Based Memristor Circuit , 2012, IEEE Transactions on Circuits and Systems I: Regular Papers.

[24]  M. Bear,et al.  A biophysically-based neuromorphic model of spike rate- and timing-dependent plasticity , 2011, Proceedings of the National Academy of Sciences.

[25]  Masahiko Morita,et al.  Associative memory with nonmonotone dynamics , 1993, Neural Networks.

[26]  Peng Li,et al.  Dynamical Properties and Design Analysis for Nonvolatile Memristor Memories , 2011, IEEE Transactions on Circuits and Systems I: Regular Papers.

[27]  Fabien Alibart,et al.  Pavlov's Dog Associative Learning Demonstrated on Synaptic-Like Organic Transistors , 2013, Neural Computation.

[28]  Leon O. Chua,et al.  Memristor Bridge Synapse-Based Neural Network and Its Learning , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Huamin Wang,et al.  Pavlov associative memory in a memristive neural network and its circuit implementation , 2016, Neurocomputing.

[30]  Stephen J. Wolf,et al.  The elusive memristor: properties of basic electrical circuits , 2008, 0807.3994.

[31]  R. Williams,et al.  Sub-nanosecond switching of a tantalum oxide memristor , 2011, Nanotechnology.

[32]  M. Ziegler,et al.  An Electronic Version of Pavlov's Dog , 2012 .

[33]  Leon O. Chua,et al.  A Circuit-Based Learning Architecture for Multilayer Neural Networks With Memristor Bridge Synapses , 2015, IEEE Transactions on Circuits and Systems I: Regular Papers.

[34]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[35]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[36]  René Schüffny,et al.  A model based comparison of BiFeO3 device applicability in neuromorphic hardware , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[37]  L. Chua.  Memristor-The missing circuit element , 1971 .

[38]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[39]  Sumio Hosaka,et al.  Associative memory realized by a reconfigurable memristive Hopfield neural network , 2015, Nature Communications.

[40]  Hai Helen Li,et al.  Spintronic Memristor Through Spin-Torque-Induced Magnetization Motion , 2009, IEEE Electron Device Letters.

[41]  Zhigang Zeng,et al.  Implementation of memristive neural networks with spike-rate-dependent plasticity synapses , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[42]  J. Grollier,et al.  A ferroelectric memristor. , 2012, Nature materials.

[43]  G. Snider,et al.  Self-organized computation with unreliable, memristive nanodevices , 2007 .

[44]  D. Suh,et al.  An associative memory device using a magnetic tunnel junction , 2015, 2015 IEEE Magnetics Conference (INTERMAG).