Metal oxide resistive random access memory based synaptic devices for brain-inspired computing

The traditional Boolean computing paradigm based on the von Neumann architecture is facing great challenges for future information technology applications such as big data, the Internet of Things (IoT), and wearable devices, due to the limited processing capability issues such as binary data storage and computing, non-parallel data processing, and the buses requirement between memory units and logic units. The brain-inspired neuromorphic computing paradigm is believed to be one of the promising solutions for realizing more complex functions with a lower cost. To perform such brain-inspired computing with a low cost and low power consumption, novel devices for use as electronic synapses are needed. Metal oxide resistive random access memory (ReRAM) devices have emerged as the leading candidate for electronic synapses. This paper comprehensively addresses the recent work on the design and optimization of metal oxide ReRAM-based synaptic devices. A performance enhancement methodology and optimized operation scheme to achieve analog resistive switching and low-energy training behavior are provided. A three-dimensional vertical synapse network architecture is proposed for high-density integration and low-cost fabrication. The impacts of the ReRAM synaptic device features on the performances of neuromorphic systems are also discussed on the basis of a constructed neuromorphic visual system with a pattern recognition function. Possible solutions to achieve the high recognition accuracy and efficiency of neuromorphic systems are presented.

[1]  Wei Lu,et al.  Short-term Memory to Long-term Memory Transition in a Nanoscale Memristor , 2022 .

[2]  Luping Shi,et al.  Enabling an Integrated Rate-temporal Learning Scheme on Memristor , 2014, Scientific Reports.

[3]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[4]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[5]  R. Dittmann,et al.  Redox‐Based Resistive Switching Memories – Nanoionic Mechanisms, Prospects, and Challenges , 2009, Advanced materials.

[6]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[7]  Lifeng Liu,et al.  Unified Physical Model of Bipolar Oxide-Based Resistive Switching Memory , 2009, IEEE Electron Device Letters.

[8]  Jongin Kim,et al.  Electronic system with memristive synapses for pattern recognition , 2015, Scientific Reports.

[9]  Fabien Alibart,et al.  Pattern classification by memristive crossbar circuits using ex situ and in situ training , 2013, Nature Communications.

[10]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[11]  R. Waser,et al.  Nanoionics-based resistive switching memories. , 2007, Nature materials.

[12]  Olivier Bichler,et al.  Phase change memory as synapse for ultra-dense neuromorphic systems: Application to complex visual pattern extraction , 2011, 2011 International Electron Devices Meeting.

[13]  Bing Sun,et al.  Ionic doping effect in ZrO2 resistive switching memory , 2010 .

[14]  Y. Liu,et al.  Synaptic Learning and Memory Functions Achieved Using Oxygen Ion Migration/Diffusion in an Amorphous InGaZnO Memristor , 2012 .

[15]  D. Drachman.  Do we have brain to spare? , 2005, Neurology.

[16]  A. Sawa.  Resistive switching in transition metal oxides , 2008 .

[17]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.

[18]  Shimeng Yu,et al.  Synaptic electronics: materials, devices and applications , 2013, Nanotechnology.

[19]  X. A. Tran,et al.  Oxide-based RRAM: Unified microscopic principle for both unipolar and bipolar switching , 2011, 2011 International Electron Devices Meeting.

[20]  Giacomo Indiveri,et al.  A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity , 2006, IEEE Transactions on Neural Networks.

[21]  N. Singh,et al.  $\hbox{HfO}_{x}/\hbox{TiO}_{x}/\hbox{HfO}_{x}/ \hbox{TiO}_{x}$ Multilayer-Based Forming-Free RRAM Devices With Excellent Uniformity , 2011, IEEE Electron Device Letters.

[22]  Jinfeng Kang,et al.  Investigation of the synaptic device based on the resistive switching behavior in hafnium oxide , 2015 .

[23]  Dharmendra S. Modha,et al.  The cat is out of the bag: cortical simulations with 109 neurons, 1013 synapses , 2009, Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis.

[24]  Simone Balatti,et al.  A 2-transistor/1-resistor artificial synapse capable of communication and stochastic learning in neuromorphic systems , 2015, Front. Neurosci..

[25]  Byung-Gook Park,et al.  Implementation of Short-Term Plasticity and Long-Term Potentiation in a Synapse Using Si-Based Type of Charge-Trap Memory , 2015, IEEE Transactions on Electron Devices.

[26]  Shimeng Yu,et al.  Design and optimization methodology for 3D RRAM arrays , 2013, 2013 IEEE International Electron Devices Meeting.

[27]  Jinfeng Kang,et al.  Multi-bit nonvolatile logic implemented with metal-oxide based resistive switching device , 2015 .

[28]  Chi-Sang Poon,et al.  Neuromorphic Silicon Neurons and Large-Scale Neural Networks: Challenges and Opportunities , 2011, Front. Neurosci..

[29]  H. Kim,et al.  RRAM-based synapse for neuromorphic system with pattern recognition function , 2012, 2012 International Electron Devices Meeting.

[30]  Shimeng Yu,et al.  An Electronic Synapse Device Based on Metal Oxide Resistive Switching Memory for Neuromorphic Computation , 2011, IEEE Transactions on Electron Devices.

[31]  Lifeng Liu,et al.  A Novel Defect-Engineering-Based Implementation for High-Performance Multilevel Data Storage in Resistive Switching Memory , 2013, IEEE Transactions on Electron Devices.

[32]  Shimeng Yu,et al.  Towards high-speed, write-disturb tolerant 3D vertical RRAM arrays , 2014, 2014 Symposium on VLSI Technology (VLSI-Technology): Digest of Technical Papers.

[33]  O. Richard,et al.  10×10nm2 Hf/HfOx crossbar resistive RAM with excellent performance, reliability and low-energy operation , 2011, 2011 International Electron Devices Meeting.

[34]  Bing Chen,et al.  Origin and suppressing methodology of intrinsic variations in metal-oxide RRAM based synaptic devices , 2014, 2014 12th IEEE International Conference on Solid-State and Integrated Circuit Technology (ICSICT).

[35]  X. Miao,et al.  Ultrafast Synaptic Events in a Chalcogenide Memristor , 2013, Scientific Reports.

[36]  Shimeng Yu,et al.  Stochastic learning in oxide binary synaptic device for neuromorphic computing , 2013, Front. Neurosci..

[37]  Jinfeng Kang,et al.  High-performance HfOx/AlOy-based resistive switching memory cross-point array fabricated by atomic layer deposition , 2015, Nanoscale Research Letters.

[38]  Shimeng Yu,et al.  3-D Cross-Point Array Operation on ${\rm AlO}_{y}/{\rm HfO}_{x}$ -Based Vertical Resistive Switching Memory , 2014, IEEE Transactions on Electron Devices.

[39]  Kinam Kim,et al.  A fast, high-endurance and scalable non-volatile memory device made from asymmetric Ta2O(5-x)/TaO(2-x) bilayer structures. , 2011, Nature materials.

[40]  Qing Wan,et al.  Artificial synapse network on inorganic proton conductor for neuromorphic systems. , 2014, Nature communications.

[41]  Frederick T. Chen,et al.  Highly scalable hafnium oxide memory with improvements of resistive distribution and read disturb immunity , 2009, 2009 IEEE International Electron Devices Meeting (IEDM).

[42]  Shimeng Yu,et al.  A Low Energy Oxide‐Based Electronic Synaptic Device for Neuromorphic Visual Systems with Tolerance to Device Variation , 2013, Advanced materials.

[43]  Shimeng Yu,et al.  Ultra-low-energy three-dimensional oxide-based electronic synapses for implementation of robust high-accuracy neuromorphic computation systems. , 2014, ACS nano.

[44]  Pritish Narayanan,et al.  Experimental Demonstration and Tolerancing of a Large-Scale Neural Network (165 000 Synapses) Using Phase-Change Memory as the Synaptic Weight Element , 2014, IEEE Transactions on Electron Devices.

[45]  Zhen Liu,et al.  Synaptic long-term potentiation realized in Pavlov's dog model based on a NiOx-based memristor , 2014 .