Memristor-Based Neural Network Circuit of Full-Function Pavlov Associative Memory With Time Delay and Variable Learning Rate

Most memristor-based Pavlov associative memory neural networks strictly require that only simultaneous food and ring appear to generate associative memory. In this article, the time delay is considered, in order to form associative memory when the food stimulus lags behind the ring stimulus for a certain period of time. In addition, the rate of learning can be changed with the length of time between the ring stimulus and food stimulus. A memristive neural network circuit that can realize Pavlov associative memory with time delay is designed and verified by the simulation results. The designed circuit consists of a synapse module, a voltage control module, and a time-delay module. The functions, such as learning, forgetting, fast learning, slow forgetting, and time-delay learning, are implemented by the circuit. The Pavlov associative memory neural network with time-delay learning provides a reference for further development of the brain-like systems.

[1]  Balwinder Raj,et al.  An accurate and generic window function for nonlinear memristor models , 2019 .

[2]  Zhigang Zeng,et al.  Multiple Lagrange Stability Under Perturbation for Recurrent Neural Networks With Time-Varying Delays , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[3]  Song Zhu,et al.  Finite-Time Stability of Delayed Memristor-Based Fractional-Order Neural Networks , 2020, IEEE Transactions on Cybernetics.

[4]  Zhigang Zeng,et al.  Hierarchical Type Stability Criteria for Delayed Neural Networks via Canonical Bessel–Legendre Inequalities , 2018, IEEE Transactions on Cybernetics.

[5]  Frank L. Lewis,et al.  Exponential Stabilization of Fuzzy Memristive Neural Networks With Hybrid Unbounded Time-Varying Delays , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Qing-Long Han,et al.  Admissible Delay Upper Bounds for Global Asymptotic Stability of Neural Networks With Time-Varying Delays , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Xiaoping Wang,et al.  A Novel Memristor-Based Circuit Implementation of Full-Function Pavlov Associative Memory Accorded With Biological Feature , 2018, IEEE Transactions on Circuits and Systems I: Regular Papers.

[8]  Zhigang Zeng,et al.  Distributed Adaptive Tracking Synchronization for Coupled Reaction–Diffusion Neural Network , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Leon O. Chua,et al.  Memristor Bridge Synapse-Based Neural Network and Its Learning , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[11]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Zhigang Zeng,et al.  Implementation of Memristive Neural Network With Full-Function Pavlov Associative Memory , 2016, IEEE Transactions on Circuits and Systems I: Regular Papers.

[14]  Qing-Long Han,et al.  Global asymptotic stability analysis for delayed neural networks using a matrix-based quadratic convex approach , 2014, Neural Networks.

[15]  Eby G. Friedman,et al.  Memristive Model for Synaptic Circuits , 2017, IEEE Transactions on Circuits and Systems II: Express Briefs.

[16]  Massimiliano Di Ventra,et al.  Experimental demonstration of associative memory with memristive neural networks , 2009, Neural Networks.

[17]  Liang Zhao,et al.  Novel circuit designs of memristor synapse and neuron , 2019, Neurocomputing.

[18]  Junwei Sun,et al.  Autonomous memristor chaotic systems of infinite chaotic attractors and circuitry realization , 2018, Nonlinear Dynamics.

[19]  Junwei Sun,et al.  Quasi-Ideal Memory System , 2015, IEEE Transactions on Cybernetics.

[20]  Song Zhu,et al.  Global Anti-Synchronization of Complex-Valued Memristive Neural Networks With Time Delays , 2019, IEEE Transactions on Cybernetics.

[21]  Guodong Zhang,et al.  Exponential synchronization of delayed memristor-based chaotic neural networks via periodically intermittent control , 2014, Neural Networks.

[22]  Lin Chen,et al.  Efficient Memristor Model Implementation for Simulation and Application , 2017, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[23]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[24]  Eby G. Friedman,et al.  Synaptic Characteristics of Ag/AgInSbTe/Ta-Based Memristor for Pattern Recognition Applications , 2017, IEEE Transactions on Electron Devices.

[25]  Frank Z. Wang,et al.  Delayed switching applied to memristor neural networks , 2012 .

[26]  Chuan Chen,et al.  Fixed-time synchronization of memristor-based BAM neural networks with time-varying discrete delay , 2017, Neural Networks.

[27]  Xin Wang,et al.  Associate learning and correcting in a memristive neural network , 2013, Neural Computing and Applications.

[28]  Chuan Chen,et al.  Adaptive synchronization of memristor-based BAM neural networks with mixed delays , 2018, Appl. Math. Comput..

[29]  Fuad E. Alsaadi,et al.  A general memristor model and its applications in programmable analog circuits , 2017, Neurocomputing.

[30]  L. Chua Memristor-The missing circuit element , 1971 .

[31]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[32]  Zhigang Zeng,et al.  Exponential Stabilization of Memristive Neural Networks With Time Delays , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[33]  Haipeng Peng,et al.  Finite-time modified projective synchronization of memristor-based neural network with multi-links and leakage delay , 2018, Chaos, Solitons & Fractals.

[34]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[35]  Qing-Long Han,et al.  Neuronal State Estimation for Neural Networks With Two Additive Time-Varying Delay Components , 2017, IEEE Transactions on Cybernetics.

[36]  Frank Z. Wang,et al.  Delayed Switching Applied to Memristor Content Addressable Memory Cell , 2013 .

[37]  Dalibor Biolek,et al.  SPICE Model of Memristor with Nonlinear Dopant Drift , 2009 .

[38]  Xiaohong Zhang,et al.  Improved Learning Experience Memristor Model and Application as Neural Network Synapse , 2019, IEEE Access.

[39]  Yike Guo,et al.  Delayed Switching in Memristors and Memristive Systems , 2010, IEEE Electron Device Letters.

[40]  Zhigang Zeng,et al.  Stabilization of Nonautonomous Recurrent Neural Networks With Bounded and Unbounded Delays on Time Scales , 2020, IEEE Transactions on Cybernetics.

[41]  Huamin Wang,et al.  Pavlov associative memory in a memristive neural network and its circuit implementation , 2016, Neurocomputing.

[42]  Shiping Wen,et al.  A full-function Pavlov associative memory implementation with memristance changing circuit , 2018, Neurocomputing.