Design of memristor-based image convolution calculation in convolutional neural network

In this paper, an architecture based on memristors is proposed to implement image convolution computation in convolutional neural networks. This architecture could extract different features of input images when using different convolutional kernels. Bipolar memristors with threshold are employed in this work, which vary their conductance values under different voltages. Various kernels are needed to extract information of input images, while different kernels contain different weights. The memristances of bipolar memristors with threshold are convenient to be varied and kept, which make them suitable to act as the weights of kernels. The performances of the design are verified by simulation results.

[1]  Dong Wang,et al.  Development of a neuromorphic computing system , 2015, 2015 IEEE International Electron Devices Meeting (IEDM).

[2]  Stefan Wermter,et al.  Effectiveness of feature extraction in neural network architectures for novelty detection , 1999 .

[3]  Leon O. Chua,et al.  A Circuit-Based Learning Architecture for Multilayer Neural Networks With Memristor Bridge Synapses , 2015, IEEE Transactions on Circuits and Systems I: Regular Papers.

[4]  Catherine Graves,et al.  Dot-product engine for neuromorphic computing: Programming 1T1M crossbar to accelerate matrix-vector multiplication , 2016, 2016 53nd ACM/EDAC/IEEE Design Automation Conference (DAC).

[5]  Jianhua Wang,et al.  Convolutional neural network for 3D object recognition based on RGB-D dataset , 2015, 2015 IEEE 10th Conference on Industrial Electronics and Applications (ICIEA).

[6]  Pinaki Mazumder,et al.  CMOS and Memristor-Based Neural Network Design for Position Detection , 2012, Proceedings of the IEEE.

[7]  Yu Wang,et al.  RRAM-Based Analog Approximate Computing , 2015, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[8]  Jinde Cao,et al.  Exponential Synchronization of Linearly Coupled Neural Networks With Impulsive Disturbances , 2011, IEEE Transactions on Neural Networks.

[9]  Peng Li,et al.  Dynamical Properties and Design Analysis for Nonvolatile Memristor Memories , 2011, IEEE Transactions on Circuits and Systems I: Regular Papers.

[10]  Guanghui Wen,et al.  Neuro-Adaptive Consensus Tracking of Multiagent Systems With a High-Dimensional Leader , 2017, IEEE Transactions on Cybernetics.

[11]  Yu Wang,et al.  ICE: Inline calibration for memristor crossbar-based computing engine , 2014, 2014 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[12]  Derong Liu,et al.  Neural-network-based zero-sum game for discrete-time nonlinear systems via iterative adaptive dynamic programming algorithm , 2013, Neurocomputing.

[13]  Hao Jiang,et al.  Spiking-based matrix computation by leveraging memristor crossbar array , 2015, 2015 IEEE Symposium on Computational Intelligence for Security and Defense Applications (CISDA).

[14]  Zhigang Zeng,et al.  Implementation of Memristive Neural Network With Full-Function Pavlov Associative Memory , 2016, IEEE Transactions on Circuits and Systems I: Regular Papers.

[15]  Hyunsang Hwang,et al.  Neuromorphic Character Recognition System With Two PCMO Memristors as a Synapse , 2014, IEEE Transactions on Industrial Electronics.

[16]  Zhigang Zeng,et al.  Lag Synchronization of Switched Neural Networks via Neural Activation Function and Applications in Image Encryption , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Zhigang Zeng,et al.  Synchronization of Switched Neural Networks With Communication Delays via the Event-Triggered Control , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Zhengya Zhang,et al.  A Native Stochastic Computing Architecture Enabled by Memristors , 2014, IEEE Transactions on Nanotechnology.

[19]  Yiran Chen,et al.  STDP learning rule based on memristor with STDP property , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[20]  Henk Corporaal,et al.  Memristor based computation-in-memory architecture for data-intensive applications , 2015, 2015 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[21]  Fabien Alibart,et al.  Pattern classification by memristive crossbar circuits using ex situ and in situ training , 2013, Nature Communications.

[22]  L. Chua.  Memristor-The missing circuit element , 1971 .

[23]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[24]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[25]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[26]  Yiran Chen,et al.  PCMO Device With High Switching Stability , 2010, IEEE Electron Device Letters.

[27]  Sherif M. Abuelenin,et al.  Memristor model based on fuzzy window function , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[28]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Piotr Dudek,et al.  Practical gradient-descent for memristive crossbars , 2015, 2015 International Conference on Memristive Systems (MEMRISYS).

[30]  D. Biolek,et al.  Reliable SPICE Simulations of Memristors, Memcapacitors and Meminductors , 2013, 1307.2717.

[31]  Alpha Agape Gopalai,et al.  Malaysia traffic sign recognition with convolutional neural network , 2015, 2015 IEEE International Conference on Digital Signal Processing (DSP).

[32]  Long Cheng,et al.  Neural-Network-Based Adaptive Leader-Following Control for Multiagent Systems With Uncertainties , 2010, IEEE Transactions on Neural Networks.

[33]  Luigi Fortuna,et al.  Memristor-Based Adaptive Coupling for Consensus and Synchronization , 2015, IEEE Transactions on Circuits and Systems I: Regular Papers.