Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO2 Memristive Spiking-Neuron

Although there is a huge progress in complementary-metal-oxide-semiconductor (CMOS) technology, construction of an artificial neural network using CMOS technology to realize the functionality comparable with that of human cerebral cortex containing 1010–1011 neurons is still of great challenge. Recently, phase change memristor neuron has been proposed to realize a human-brain level neural network operating at a high speed while consuming a small amount of power and having a high integration density. Although memristor neuron can be scaled down to nanometer, integration of 1010–1011 neurons still faces many problems in circuit complexity, chip area, power consumption, etc. In this work, we propose a CMOS compatible HfO2 memristor neuron that can be well integrated with silicon circuits. A hybrid Convolutional Neural Network (CNN) based on the HfO2 memristor neuron is proposed and constructed. In the hybrid CNN, one memristive neuron can behave as multiple physical neurons based on the Time Division Multiplexing Access (TDMA) technique. Handwritten digit recognition is demonstrated in the hybrid CNN with a memristive neuron acting as 784 physical neurons. This work paves the way towards substantially shrinking the amount of neurons required in hardware and realization of more complex or even human cerebral cortex level memristive neural networks.

[1]  Frederick T. Chen,et al.  28-nm 2T High-$K$ Metal Gate Embedded RRAM With Fully Compatible CMOS Logic Processes , 2013, IEEE Electron Device Letters.

[2]  M. Prezioso,et al.  Modeling and implementation of firing-rate neuromorphic-network classifiers with bilayer Pt/Al2O3/TiO2−x/Pt Memristors , 2015, 2015 IEEE International Electron Devices Meeting (IEDM).

[3]  Lei Wang,et al.  Recent Advances on Neuromorphic Systems Using Phase-Change Materials , 2017, Nanoscale Research Letters.

[4]  Frederick T. Chen,et al.  Evidence and solution of over-RESET problem for HfOX based resistive memory with sub-ns switching speed and high endurance , 2010, 2010 International Electron Devices Meeting.

[5]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[6]  Igor L. Markov,et al.  Limits on fundamental limits to computation , 2014, Nature.

[7]  Fabien Alibart,et al.  Pattern classification by memristive crossbar circuits using ex situ and in situ training , 2013, Nature Communications.

[8]  Y. Liu,et al.  Synaptic Learning and Memory Functions Achieved Using Oxygen Ion Migration/Diffusion in an Amorphous InGaZnO Memristor , 2012 .

[9]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[10]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[11]  Nicolas Locatelli,et al.  Learning through ferroelectric domain dynamics in solid-state synapses , 2017, Nature Communications.

[12]  Massimiliano Di Ventra,et al.  Experimental demonstration of associative memory with memristive neural networks , 2009, Neural Networks.

[13]  Wei D. Lu,et al.  Sparse coding with memristor networks. , 2017, Nature nanotechnology.

[14]  V JoshiRajiv,et al.  Distributed In-Memory Computing on Binary RRAM Crossbar , 2017 .

[15]  Fei-Fei Li,et al.  Large-Scale Video Classification with Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Evangelos Eleftheriou,et al.  Detecting Correlations Using Phase-Change Neurons and Synapses , 2016, IEEE Electron Device Letters.

[17]  L.O. Chua,et al.  Memristive devices and systems , 1976, Proceedings of the IEEE.

[18]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  S. Yuasa,et al.  A magnetic synapse: multilevel spin-torque memristor with perpendicular anisotropy , 2016, Scientific Reports.

[20]  Ali Khiat,et al.  Unsupervised learning in probabilistic neural networks with multi-state metal-oxide memristive synapses , 2016, Nature Communications.

[21]  Yang Liu,et al.  Review of Nanostructured Resistive Switching Memristor and Its Applications , 2014 .

[22]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[23]  J Joshua Yang,et al.  Memristive devices for computing. , 2013, Nature nanotechnology.

[24]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[25]  Shimeng Yu,et al.  Synaptic electronics: materials, devices and applications , 2013, Nanotechnology.

[26]  Jan M. Rabaey,et al.  Physical principles for scalable neural recording , 2013, Front. Comput. Neurosci..

[27]  L. Chua.  Memristor-The missing circuit element , 1971 .

[28]  Manuel Le Gallo,et al.  Stochastic phase-change neurons. , 2016, Nature nanotechnology.

[29]  E. Eleftheriou,et al.  All-memristive neuromorphic computing with level-tuned neurons , 2016, Nanotechnology.

[30]  Rajiv V. Joshi,et al.  An Energy-Efficient Digital ReRAM-Crossbar-Based CNN With Bitwise Parallelism , 2017, IEEE Journal on Exploratory Solid-State Computational Devices and Circuits.

[31]  J. Yang,et al.  Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing. , 2017, Nature materials.

[32]  M. Marinella,et al.  A non-volatile organic electrochemical device as a low-voltage artificial synapse for neuromorphic computing. , 2017, Nature materials.

[33]  Sumio Hosaka,et al.  Associative memory realized by a reconfigurable memristive Hopfield neural network , 2015, Nature Communications.

[34]  Jagan Singh Meena,et al.  Overview of emerging nonvolatile memory technologies , 2014, Nanoscale Research Letters.

[35]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.

[36]  Shimeng Yu,et al.  An Electronic Synapse Device Based on Metal Oxide Resistive Switching Memory for Neuromorphic Computation , 2011, IEEE Transactions on Electron Devices.

[37]  Qing Wan,et al.  Artificial synapse network on inorganic proton conductor for neuromorphic systems. , 2014, Nature communications.

[38]  Masakazu Matsugu,et al.  Subject independent facial expression recognition with robust face detection using a convolutional neural network , 2003, Neural Networks.

[39]  Sumio Hosaka,et al.  Emulating the Ebbinghaus forgetting curve of the human brain with a NiO-based memristor , 2013 .

[40]  M. Ziegler,et al.  An Electronic Version of Pavlov's Dog , 2012 .

[41]  Yusuf Leblebici,et al.  Neuromorphic system with phase-change synapses for pattern learning and feature extraction , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[42]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[43]  Chung Lam,et al.  Brain-like associative learning using a nanoscale non-volatile phase change synaptic device array , 2014, Front. Neurosci..

[44]  Peng Lin,et al.  Fully memristive neural networks for pattern classification with unsupervised learning , 2018 .

[45]  H.-S. Philip Wong,et al.  Face classification using electronic synapses , 2017, Nature Communications.

[46]  Yusuf Leblebici,et al.  Neuromorphic Architecture With 1M Memristive Synapses for Detection of Weakly Correlated Inputs , 2017, IEEE Transactions on Circuits and Systems II: Express Briefs.