Self-Activation Neural Network Based on Self-Selective Memory Device With Rectified Multilevel States

In a digital–analog mixed neuromorphic system, various complex peripheral circuits may offset the integration and energy efficiency advantages of the dense crossbar. To simplify the peripheral circuits, a self-activation neural network (SANN) is proposed based on a passive crossbar array formed by the rectified memristive (ReMem) cell. The ReMem cell is a dual-mode resistive switching device with a VO2/TaOx bilayer structure. It shows a hybrid switching behavior including volatile threshold switching and multilevel nonvolatile resistive switching. This unique feature enables not only simultaneously self-selection and distributed activation, but also weight storage. The concept of SANN is theoretically examined, and a neural network is constructed and trained with SANN based on the proposed devices to perform recognition on handwritten digits in the MNIST database. Compared with neuromorphic computing systems using the CMOS-based activation module and additional selective element, the results show comparable recognition accuracy with reduced circuitry complexity. The proposed SANN can be a promising alternative to realize neural network computing systems with simplified peripheral circuits.

[1]  Lifeng Liu,et al.  Unified Physical Model of Bipolar Oxide-Based Resistive Switching Memory , 2009, IEEE Electron Device Letters.

[2]  Shimeng Yu,et al.  Investigating the switching dynamics and multilevel capability of bipolar metal oxide resistive switching memory , 2011 .

[3]  Yanfeng Gao,et al.  Significant changes in phase-transition hysteresis for Ti-doped VO2 films prepared by polymer-assisted deposition , 2011 .

[4]  H. Hwang,et al.  Excellent Selector Characteristics of Nanoscale $ \hbox{VO}_{2}$ for High-Density Bipolar ReRAM Applications , 2011, IEEE Electron Device Letters.

[5]  Hyunsang Hwang,et al.  Self-Selective Characteristics of Nanoscale $ \hbox{VO}_{x}$ Devices for High-Density ReRAM Applications , 2012, IEEE Electron Device Letters.

[6]  Iuliana Radu,et al.  The VO2 interface, the metal-insulator transition tunnel junction, and the metal-insulator transition switch On-Off resistance , 2012 .

[7]  Tara N. Sainath,et al.  Improving deep neural networks for LVCSR using rectified linear units and dropout , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  M. Pickett,et al.  A scalable neuristor built with Mott memristors. , 2013, Nature materials.

[9]  G. W. Burr,et al.  Experimental demonstration and tolerancing of a large-scale neural network (165,000 synapses), using phase-change memory as the synaptic weight element , 2015, 2014 IEEE International Electron Devices Meeting.

[10]  Wei Lu,et al.  Utilizing multiple state variables to improve the dynamic range of analog switching in a memristor , 2015 .

[11]  You Zhou,et al.  Mott Memory and Neuromorphic Devices , 2015, Proceedings of the IEEE.

[12]  Pritish Narayanan,et al.  Experimental Demonstration and Tolerancing of a Large-Scale Neural Network (165 000 Synapses) Using Phase-Change Memory as the Synaptic Weight Element , 2014, IEEE Transactions on Electron Devices.

[13]  Ru Huang,et al.  Engineering incremental resistive switching in TaOx based memristors for brain-inspired computing. , 2016, Nanoscale.

[14]  Fang Wang,et al.  VO2-Based Selection Device for Passive Resistive Random Access Memory Application , 2016, IEEE Electron Device Letters.

[15]  Shimeng Yu,et al.  A Compact Model for Metal–Oxide Resistive Random Access Memory With Experiment Verification , 2016, IEEE Transactions on Electron Devices.

[16]  Yunus Babacan,et al.  A spiking and bursting neuron circuit based on memristor , 2016, Neurocomputing.

[17]  Shimeng Yu,et al.  Ferroelectric FET analog synapse for acceleration of deep neural network training , 2017, 2017 IEEE International Electron Devices Meeting (IEDM).

[18]  F. Merrikh Bayat,et al.  Fast, energy-efficient, robust, and reproducible mixed-signal neuromorphic classifier based on embedded NOR flash memory technology , 2017, 2017 IEEE International Electron Devices Meeting (IEDM).

[19]  Ru Huang,et al.  Modulation of nonlinear resistive switching behavior of a TaOx-based resistive device through interface engineering , 2017, Nanotechnology.

[20]  Jae-Joon Kim,et al.  Input Voltage Mapping Optimized for Resistive Memory-Based Deep Neural Network Hardware , 2017, IEEE Electron Device Letters.

[21]  Dirk Wouters,et al.  Different threshold and bipolar resistive switching mechanisms in reactively sputtered amorphous undoped and Cr-doped vanadium oxide thin films , 2018 .

[22]  Wei Lu,et al.  The future of electronics based on memristive systems , 2018, Nature Electronics.

[23]  Peng Lin,et al.  Fully memristive neural networks for pattern classification with unsupervised learning , 2018 .

[24]  H.-S. Philip Wong,et al.  In-memory computing with resistive switching devices , 2018, Nature Electronics.

[25]  Xiong Cao,et al.  A Neuromorphic Design Using Chaotic Mott Memristor with Relaxation Oscillation , 2018, 2018 55th ACM/ESDA/IEEE Design Automation Conference (DAC).

[26]  Shimeng Yu,et al.  A Methodology to Improve Linearity of Analog RRAM for Neuromorphic Computing , 2018, 2018 IEEE Symposium on VLSI Technology.

[27]  Jiaming Zhang,et al.  Analogue signal and image processing with large memristor crossbars , 2017, Nature Electronics.

[28]  Qing Wu,et al.  In situ training of feed-forward and recurrent convolutional memristor networks , 2019, Nature Machine Intelligence.

[29]  J. Yang,et al.  Memristive crossbar arrays for brain-inspired computing , 2019, Nature Materials.

[30]  Ru Huang,et al.  Artificial Neural Network Based on Doped HfO2 Ferroelectric Capacitors With Multilevel Characteristics , 2019, IEEE Electron Device Letters.

[31]  Ru Huang,et al.  Self-Selective Resistive Device With Hybrid Switching Mode for Passive Crossbar Memory Application , 2020, IEEE Electron Device Letters.

[32]  Ru Huang,et al.  Early-Stage Fluctuation in Low-Power Analog Resistive Memory: Impacts on Neural Network and Mitigation Approach , 2020, IEEE Electron Device Letters.