A Novel Chaotic Neural Network Using Memristive Synapse with Applications in Associative Memory

Chaotic Neural Network, also denoted by the acronym CNN, has rich dynamical behaviors that can be harnessed in promising engineering applications. However, due to its complex synapse learning rules and network structure, it is difficult to update its synaptic weights quickly and implement its large scale physical circuit. This paper addresses an implementation scheme of a novel CNN with memristive neural synapses that may provide a feasible solution for further development of CNN. Memristor, widely known as the fourth fundamental circuit element, was theoretically predicted by Chua in 1971 and has been developed in 2008 by the researchers in Hewlett-Packard Laboratory. Memristor based hybrid nanoscale CMOS technology is expected to revolutionize the digital and neuromorphic computation. The proposed memristive CNN has four significant features: (1) nanoscale memristors can simplify the synaptic circuit greatly and enable the synaptic weights update easily; (2) it can separate stored patterns from superimposed input; (3) it can deal with one-to-many associative memory; (4) it can deal with many-to-many associative memory. Simulation results are provided to illustrate the effectiveness of the proposed scheme.

[1]  L. Chua Memristor-The missing circuit element , 1971 .

[2]  K. Kaneko Clustering, coding, switching, hierarchical ordering, and control in a network of chaotic elements , 1990 .

[3]  Yong Yao,et al.  Model of biological pattern recognition with spatially chaotic dynamics , 1990, Neural Networks.

[4]  Masafumi Hagiwara,et al.  Chaotic bidirectional associative memory , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[5]  Shin Ishii,et al.  A network of chaotic elements for information processing , 1996, Neural Networks.

[6]  Masafumi Hagiwara,et al.  Separation of superimposed pattern and many-to-many associations by chaotic neural networks , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[7]  Masafumi Hagiwara,et al.  Successive learning in chaotic neural network , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[8]  Masafumi Hagiwara,et al.  Chaotic associative memory for successive learning using internal patterns , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[9]  Shukai Duan,et al.  A novel chaotic neural network for many-to-many associations and successive learning , 2003, International Conference on Neural Networks and Signal Processing, 2003. Proceedings of the 2003.

[10]  Liu Guang A Chaotic Neural Network and its Applications in Separation of Superimposed Pattern and Many-to-Many Associative Memory , 2003 .

[11]  Yuko Osana,et al.  Improved chaotic associative memory using distributed patterns for image retrieval , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[12]  Shukai Duan,et al.  A Novel Chaotic Neural Network for Automatic Material Ratio System , 2004, ISNN.

[13]  Shukai Duan,et al.  Adaptive Chaotic Controlling Method of a Chaotic Neural Network Model , 2005, ISNN.

[14]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[15]  R. Williams,et al.  How We Found The Missing Memristor , 2008, IEEE Spectrum.

[16]  Emilio Del-Moral-Hernandez,et al.  Chaotic Neural Networks , 2009, Encyclopedia of Artificial Intelligence.

[17]  Samiha Mourad,et al.  Digital logic implementation in memristor-based crossbars , 2009, 2009 International Conference on Communications, Circuits and Systems.

[18]  Juebang Yu,et al.  A memristor based chaotic oscillator , 2009, 2009 International Conference on Communications, Circuits and Systems.

[19]  Kyungmin Kim,et al.  Memristor-based fine resolution programmable resistance and its applications , 2009, 2009 International Conference on Communications, Circuits and Systems.

[20]  Bharathwaj Muthuswamy,et al.  Memristor-Based Chaotic Circuits , 2009 .

[21]  P. Vontobel,et al.  Writing to and reading from a nano-scale crossbar memory based on memristors , 2009, Nanotechnology.

[22]  M. Pickett,et al.  A memristor-based nonvolatile latch circuit , 2010, Nanotechnology.

[23]  Ahmad Ayatollahi,et al.  Efficient Hybrid CMOS-Nano Circuit Design for Spiking Neurons and Memristive Synapses with STDP , 2010, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[24]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[25]  Timothée Masquelier,et al.  Learning to recognize objects using waves of spikes and Spike Timing-Dependent Plasticity , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[26]  Shukai Duan,et al.  Memristive crossbar array with applications in image processing , 2012, Science China Information Sciences.

[27]  Leon O. Chua Resistance switching memories are memristors , 2011 .

[28]  William D. Jemison,et al.  Variable gain amplifier circuit using titanium dioxide memristors , 2011, IET Circuits Devices Syst..