Memristor crossbar based winner take all circuit design for self-organization

Self-organizing mechanism is an important feature of the human perception system. It is an unsupervised learning process which does not require labeled data. In this paper, we have designed a novel mixed signal architecture for training a self-organizing system. A memristor1 crossbar is utilized for higher synaptic weight density and parallel analog operation. The system essentially implements the winner take all learning algorithm. A novel neuron circuit is designed for the winning neuron detection and lateral inhibition operations. Our experimental results show that the proposed system can self-organize based on unlabeled training data.

[1]  Teuvo Kohonen,et al.  The self-organizing map , 1990, Neurocomputing.

[2]  Witold Pedrycz,et al.  Realization of the Conscience Mechanism in CMOS Implementation of Winner-Takes-All Self-Organizing Neural Networks , 2010, IEEE Transactions on Neural Networks.

[3]  Avinoam Kolodny,et al.  Memristor-Based Multilayer Neural Networks With Online Gradient Descent Training , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Xuehai Zhou,et al.  PuDianNao: A Polyvalent Machine Learning Accelerator , 2015, ASPLOS.

[5]  Fabien Alibart,et al.  Pattern classification by memristive crossbar circuits using ex situ and in situ training , 2013, Nature Communications.

[6]  B. V. K. Vijaya Kumar,et al.  Competitive learning with generalized winner-take-all activation , 1992, IEEE Trans. Neural Networks.

[7]  Mikko H. Lipasti,et al.  Cortical columns: Building blocks for intelligent systems , 2009, 2009 IEEE Symposium on Computational Intelligence for Multimedia Signal and Vision Processing.

[8]  Wei Lu,et al.  Two-terminal resistive switches (memristors) for memory and logic applications , 2011, 16th Asia and South Pacific Design Automation Conference (ASP-DAC 2011).

[9]  Teuvo Kohonen,et al.  Physiological interpretationm of the self-organizing map algorithm , 1993 .

[10]  Chris Yakopcic,et al.  Memristor SPICE model and crossbar simulation based on devices with nanosecond switching time , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[11]  Jia Wang,et al.  DaDianNao: A Machine-Learning Supercomputer , 2014, 2014 47th Annual IEEE/ACM International Symposium on Microarchitecture.

[12]  Shimeng Yu,et al.  Investigating the switching dynamics and multilevel capability of bipolar metal oxide resistive switching memory , 2011 .

[13]  Teuvo Kohonen,et al.  Physiological interpretation of the Self-Organizing Map algorithm , 1993, Neural Networks.

[14]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[15]  Wei D. Lu,et al.  Data Clustering using Memristor Networks , 2015, Scientific Reports.

[16]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[17]  Kyeong-Sik Min,et al.  Ta2O5-memristor synaptic array with winner-take-all method for neuromorphic pattern matching , 2016 .

[18]  L. Chua.  Memristor-The missing circuit element , 1971 .

[19]  Shimeng Yu,et al.  Orientation classification by a winner-take-all network with oxide RRAM based synaptic devices , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).