Conductive-bridging random-access memories for emerging neuromorphic computing.

With the increasing utilisation of artificial intelligence, there is a renewed demand for the development of novel neuromorphic computing owing to the drawbacks of the existing computing paradigm based on the von Neumann architecture. Extensive studies have been performed on memristors as their electrical nature is similar to those of biological synapses and neurons. However, most hardware-based artificial neural networks (ANNs) have been developed with oxide-based memristors owing to their high compatibility with mature complementary metal-oxide-semiconductor (CMOS) processes. Considering the advantages of conductive-bridging random-access memories (CBRAMs), such as their high scalability, high on-off current with a wide dynamic range, and low off-current, over oxide-based memristors, extensive studies on CBRAMs are required. In this review, the basics of operation of CBRAMs are examined in detail, from the formation of metal nanoclusters to filament bridging. Additionally, state-of-the-art experimental demonstrations of CBRAM-based artificial synapses and neurons are presented. Finally, CBRAM-based ANNs are discussed, including deep neural networks and spiking neural networks, along with other emerging computing applications. This review is expected to pave the way toward further development of large-scale CBRAM array systems.

[1]  B. Cho,et al.  Organic Resistive Memory Devices: Performance Enhancement, Integration, and Advanced Architectures , 2011 .

[2]  T. Hasegawa,et al.  Atomic Switch: Atom/Ion Movement Controlled Devices for Beyond Von‐Neumann Computers , 2012, Advanced materials.

[3]  Jun Sun,et al.  Liquid-like pseudoelasticity of sub-10-nm crystalline silver particles. , 2014, Nature materials.

[4]  Yurong Liu,et al.  A survey of deep neural network architectures and their applications , 2017, Neurocomputing.

[5]  Kate J. Norris,et al.  Anatomy of Ag/Hafnia‐Based Selectors with 1010 Nonlinearity , 2017, Advanced materials.

[6]  Luping Shi,et al.  Memristor devices for neural networks , 2018, Journal of Physics D: Applied Physics.

[7]  J. Yang,et al.  Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing. , 2017, Nature materials.

[8]  Jianhui Zhao,et al.  Robust Ag/ZrO2/WS2/Pt Memristor for Neuromorphic Computing. , 2019, ACS applied materials & interfaces.

[9]  Peng Lin,et al.  Reinforcement learning with analogue memristor arrays , 2019, Nature Electronics.

[10]  Qi Liu,et al.  Atomic View of Filament Growth in Electrochemical Memristive Elements , 2015, Scientific Reports.

[11]  P. Narayanan,et al.  Recent progress in analog memory-based accelerators for deep learning , 2018, Journal of Physics D: Applied Physics.

[12]  Bernard Brezzo,et al.  TrueNorth: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip , 2015, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[13]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[14]  Frederick T. Chen,et al.  Bipolar Resistive Switching Memory Using Cu Metallic Filament in Ge0.4Se0.6 Solid Electrolyte , 2010 .

[15]  Byung Chul Jang,et al.  Memristive Logic‐in‐Memory Integrated Circuits for Energy‐Efficient Flexible Electronics , 2018 .

[16]  S. Menzel,et al.  Simulation of multilevel switching in electrochemical metallization memory cells , 2012 .

[17]  C. N. Lau,et al.  The mechanism of electroforming of metal oxide memristive switches , 2009, Nanotechnology.

[18]  Dominique Vuillaume,et al.  Filamentary switching: synaptic plasticity through device volatility. , 2015, ACS nano.

[19]  Masakazu Aono,et al.  Kinetic factors determining conducting filament formation in solid polymer electrolyte based planar devices. , 2016, Nanoscale.

[20]  Michael Kund,et al.  Selection of Optimized Materials for CBRAM Based on HT-XRD and Electrical Test Results , 2009 .

[21]  Armantas Melianas,et al.  Organic electronics for neuromorphic computing , 2018, Nature Electronics.

[22]  Yiran Chen,et al.  A compact model for selectors based on metal doped electrolyte , 2018 .

[23]  Catherine E. Graves,et al.  Memristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine , 2018, Advanced materials.

[24]  M. Kozicki,et al.  Electrochemical metallization memories—fundamentals, applications, prospects , 2011, Nanotechnology.

[25]  Zhiping Yu,et al.  An Analytical Model for the Forming Process of Conductive-Bridge Resistive-Switching Random-Access Memory , 2014, IEEE Transactions on Electron Devices.

[26]  Gerard F. Jones,et al.  A review of data center cooling technology, operating conditions and the corresponding low-grade waste heat recovery opportunities , 2014 .

[27]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[28]  Daniele Ielmini,et al.  Surface diffusion-limited lifetime of silver and copper nanofilaments in resistive switching devices , 2019, Nature Communications.

[29]  Yong Liu,et al.  Specifications of Nanoscale Devices and Circuits for Neuromorphic Computational Systems , 2013, IEEE Transactions on Electron Devices.

[30]  Fei Zeng,et al.  Conductance quantization in a Ag filament-based polymer resistive memory , 2013, Nanotechnology.

[31]  Jan van den Hurk,et al.  Nanobatteries in redox-based resistive switches require extension of memristor theory , 2013, Nature Communications.

[32]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[33]  Hyunsang Hwang,et al.  Improved Synaptic Behavior of CBRAM Using Internal Voltage Divider for Neuromorphic Systems , 2018, IEEE Transactions on Electron Devices.

[34]  Sang-jun Choi,et al.  In Situ Observation of Voltage‐Induced Multilevel Resistive Switching in Solid Electrolyte Memory , 2011, Advanced materials.

[35]  X. Bai,et al.  Bipolar Electrochemical Mechanism for Mass Transfer in Nanoionic Resistive Memories , 2014, Advanced materials.

[36]  H. Hwang,et al.  Improved Synaptic Behavior Under Identical Pulses Using AlOx/HfO2 Bilayer RRAM Array for Neuromorphic Systems , 2016, IEEE Electron Device Letters.

[37]  Timothée Masquelier,et al.  Deep Learning in Spiking Neural Networks , 2018, Neural Networks.

[38]  Huaqiang Wu,et al.  An artificial nociceptor based on a diffusive memristor , 2018, Nature Communications.

[39]  Zhang Hainan,et al.  Free cooling of data centers: A review , 2014 .

[40]  T. Serrano-Gotarredona,et al.  STDP and STDP variations with memristors for spiking neuromorphic learning systems , 2013, Front. Neurosci..

[41]  Byung Chul Jang,et al.  Polymer Analog Memristive Synapse with Atomic-Scale Conductive Filament for Flexible Neuromorphic Computing System. , 2019, Nano letters.

[42]  Jea-Gun Park,et al.  Electro-Forming and Electro-Breaking of Nanoscale Ag Filaments for Conductive-Bridging Random-Access Memory Cell using Ag-Doped Polymer-Electrolyte between Pt Electrodes , 2017, Scientific Reports.

[43]  J. Alvin Connelly,et al.  A noise-based IC random number generator for applications in cryptography , 2000 .

[44]  Hea-Lim Park,et al.  Versatile neuromorphic electronics by modulating synaptic decay of single organic synaptic transistor: From artificial neural networks to neuro-prosthetics , 2019, Nano Energy.

[45]  T. Bliss,et al.  A synaptic model of memory: long-term potentiation in the hippocampus , 1993, Nature.

[46]  Su Liu,et al.  Physical model of dynamic Joule heating effect for reset process in conductive-bridge random access memory , 2014 .

[47]  H. Barnaby,et al.  Volatile and Non-Volatile Switching in Cu-SiO2 Programmable Metallization Cells , 2016, IEEE Electron Device Letters.

[48]  Cheol Seong Hwang,et al.  Prospective of Semiconductor Memory Devices: from Memory System to Materials , 2015 .

[49]  Junhwan Choi,et al.  Zero-static-power nonvolatile logic-in-memory circuits for flexible electronics , 2017, Nano Research.

[50]  Byung Chul Jang,et al.  A Recoverable Synapse Device Using a Three‐Dimensional Silicon Transistor , 2018, Advanced Functional Materials.

[51]  Hangbing Lv,et al.  An Artificial Neuron Based on a Threshold Switching Memristor , 2018, IEEE Electron Device Letters.

[52]  Hong Wang,et al.  Loihi: A Neuromorphic Manycore Processor with On-Chip Learning , 2018, IEEE Micro.

[53]  Yoav Goldberg,et al.  A Primer on Neural Network Models for Natural Language Processing , 2015, J. Artif. Intell. Res..

[54]  Wei D. Lu,et al.  Electrochemical dynamics of nanoscale metallic inclusions in dielectrics , 2014, Nature Communications.

[55]  Jacobsen,et al.  Quantized conductance in an atom-sized point contact. , 1994, Physical review letters.

[56]  Yuchao Yang,et al.  Observation of conducting filament growth in nanoscale resistive memories , 2012, Nature Communications.

[57]  Paul L. Bergstrom,et al.  Simulation of charge transport in multi-island tunneling devices: Application to disordered one-dimensional systems at low and high biases , 2013 .

[58]  Hongtao Zhang,et al.  Highly Compact Artificial Memristive Neuron with Low Energy Consumption. , 2018, Small.

[59]  Jiaming Zhang,et al.  Analogue signal and image processing with large memristor crossbars , 2017, Nature Electronics.

[60]  Qiangfei Xia,et al.  A Low‐Current and Analog Memristor with Ru as Mobile Species , 2020, Advanced materials.

[61]  A. J. Kenyon,et al.  Quantum Conductance in Silicon Oxide Resistive Memory Devices , 2013, Scientific Reports.

[62]  Hyunsang Hwang,et al.  Field-induced nucleation in threshold switching characteristics of electrochemical metallization devices , 2017 .

[63]  Qingjiang Li,et al.  Short-Term and Long-Term Plasticity Mimicked in Low-Voltage Ag/GeSe/TiN Electronic Synapse , 2018, IEEE Electron Device Letters.

[64]  Rainer Waser,et al.  Physical origins and suppression of Ag dissolution in GeS(x)-based ECM cells. , 2014, Physical chemistry chemical physics : PCCP.

[65]  Hyunsang Hwang,et al.  Control of Cu Conductive Filament in Complementary Atom Switch for Cross-Point Selector Device Application , 2014, IEEE Electron Device Letters.

[66]  Ho Won Jang,et al.  Organic–Inorganic Hybrid Halide Perovskites for Memories, Transistors, and Artificial Synapses , 2018, Advanced materials.

[67]  Rainer Waser,et al.  Redox processes in silicon dioxide thin films using copper microelectrodes , 2011 .

[68]  Hyunsang Hwang,et al.  Improved Synapse Device With MLC and Conductance Linearity Using Quantized Conduction for Neuromorphic Systems , 2018, IEEE Electron Device Letters.

[69]  Rainer Waser,et al.  Direct Observation of Charge Transfer in Solid Electrolyte for Electrochemical Metallization Memory , 2012, Advanced materials.

[70]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[71]  Yuchao Yang,et al.  Probing memristive switching in nanoionic devices , 2018 .

[72]  Sangheon Oh,et al.  Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays , 2018, Nature Communications.

[73]  Haralampos Pozidis,et al.  Recent Progress in Phase-Change Memory Technology , 2016, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[74]  K. Terabe,et al.  Quantized conductance atomic switch , 2005, Nature.

[75]  Wei D. Lu,et al.  Nanoscale electrochemistry using dielectric thin films as solid electrolytes. , 2016, Nanoscale.

[76]  W. Mullins Theory of Thermal Grooving , 1957 .

[77]  R. Waser,et al.  Nanoscale cation motion in TaO(x), HfO(x) and TiO(x) memristive systems. , 2016, Nature nanotechnology.

[78]  Shimeng Yu,et al.  Neuro-Inspired Computing With Emerging Nonvolatile Memorys , 2018, Proceedings of the IEEE.

[79]  Wuhong Xue,et al.  Recent Advances of Quantum Conductance in Memristors , 2019, Advanced Electronic Materials.

[80]  Shimeng Yu,et al.  Resistive Memory-Based Analog Synapse: The Pursuit for Linear and Symmetric Weight Update , 2018, IEEE Nanotechnology Magazine.

[81]  Sen Song,et al.  Bridging Biological and Artificial Neural Networks with Emerging Neuromorphic Devices: Fundamentals, Progress, and Challenges , 2019, Advanced materials.

[82]  Ilia Valov,et al.  Redox‐Based Resistive Switching Memories (ReRAMs): Electrochemical Systems at the Atomic Scale , 2014 .

[83]  Dong-Ho Kang,et al.  Poly-4-vinylphenol (PVP) and Poly(melamine-co-formaldehyde) (PMF)-Based Atomic Switching Device and Its Application to Logic Gate Circuits with Low Operating Voltage. , 2017, ACS applied materials & interfaces.

[84]  Alessandro Trifiletti,et al.  A High-Speed Oscillator-Based Truly Random Number Source for Cryptographic Applications on a Smart Card IC , 2003, IEEE Trans. Computers.

[85]  Bradley,et al.  Effects of ion dynamics and opacity on Stark-broadened argon line profiles. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[86]  T. Hasegawa,et al.  Conductance quantization and synaptic behavior in a Ta2O5-based atomic switch , 2012, Nanotechnology.

[87]  Wei Lu,et al.  The future of electronics based on memristive systems , 2018, Nature Electronics.

[88]  Alessandro Calderoni,et al.  Learning of spatiotemporal patterns in a spiking neural network with resistive switching synapses , 2018, Science Advances.

[89]  Shinhyun Choi,et al.  SiGe epitaxial memory for neuromorphic computing with reproducible high performance based on engineered dislocations , 2018, Nature Materials.

[90]  Damien Querlioz,et al.  Spintronic Nanodevices for Bioinspired Computing , 2016, Proceedings of the IEEE.

[91]  Yi Li,et al.  Reconfigurable logic in nanosecond Cu/GeTe/TiN filamentary memristors for energy-efficient in-memory computing , 2018, Nanotechnology.

[92]  Peng Lin,et al.  Fully memristive neural networks for pattern classification with unsupervised learning , 2018 .

[93]  J. Yang,et al.  Memristive crossbar arrays for brain-inspired computing , 2019, Nature Materials.

[94]  D. Ielmini,et al.  Study of Multilevel Programming in Programmable Metallization Cell (PMC) Memory , 2009, IEEE Transactions on Electron Devices.

[95]  Ming Zhang,et al.  Understanding data center traffic characteristics , 2010, CCRV.

[96]  H.-S. Philip Wong,et al.  Face classification using electronic synapses , 2017, Nature Communications.

[97]  M. Kozicki,et al.  Influence of Cu diffusion conditions on the switching of Cu-SiO2-based resistive memory devices , 2010 .

[98]  Qi Liu,et al.  Real‐Time Observation on Dynamic Growth/Dissolution of Conductive Filaments in Oxide‐Electrolyte‐Based ReRAM , 2012, Advanced materials.

[99]  Wei Lu,et al.  Real-Time Observation of the Electrode-Size-Dependent Evolution Dynamics of the Conducting Filaments in a SiO2 Layer. , 2017, ACS nano.

[100]  Qing Wu,et al.  Long short-term memory networks in memristor crossbar arrays , 2018, Nature Machine Intelligence.

[101]  Masakazu Aono,et al.  Highly Reproducible and Regulated Conductance Quantization in a Polymer‐Based Atomic Switch , 2017 .

[102]  Rainer Waser,et al.  Faradaic currents during electroforming of resistively switching Ag-Ge-Se type electrochemical metallization memory cells. , 2009, Physical chemistry chemical physics : PCCP.

[103]  Qing Wu,et al.  A novel true random number generator based on a stochastic diffusive memristor , 2017, Nature Communications.

[104]  J. Eom,et al.  Thickness-dependent resistive switching in black phosphorus CBRAM , 2019, Journal of Materials Chemistry C.

[105]  Heike Riel,et al.  Ballistic One-Dimensional InAs Nanowire Cross-Junction Interconnects. , 2017, Nano letters.

[106]  R. Waser,et al.  Nanoionic transport and electrochemical reactions in resistively switching silicon dioxide. , 2012, Nanoscale.

[107]  M Jurczak,et al.  Nanoscopic structural rearrangements of the Cu-filament in conductive-bridge memories. , 2016, Nanoscale.

[108]  Shimeng Yu,et al.  Improving Analog Switching in HfOx-Based Resistive Memory With a Thermal Enhanced Layer , 2017, IEEE Electron Device Letters.

[109]  Yoon-Ha Jeong,et al.  Optimization of Conductance Change in Pr1–xCaxMnO3-Based Synaptic Devices for Neuromorphic Systems , 2015, IEEE Electron Device Letters.

[110]  J. Yang,et al.  Threshold Switching of Ag or Cu in Dielectrics: Materials, Mechanism, and Applications , 2018 .

[111]  Junhwan Choi,et al.  Flexible Nonvolatile Polymer Memory Array on Plastic Substrate via Initiated Chemical Vapor Deposition. , 2016, ACS applied materials & interfaces.

[112]  M. Kozicki,et al.  Nanoscale memory elements based on solid-state electrolytes , 2005, IEEE Transactions on Nanotechnology.

[113]  Masakazu Aono,et al.  Rate-limiting processes in the fast SET operation of a gapless-type Cu-Ta2O5 atomic switch , 2013 .

[114]  Kang L. Wang,et al.  Resistive switching materials for information processing , 2020, Nature Reviews Materials.

[115]  Wei D. Lu,et al.  Experimental Demonstration of Feature Extraction and Dimensionality Reduction Using Memristor Networks. , 2017, Nano letters.

[116]  M. Mecklenburg,et al.  Nanofilament Formation and Regeneration During Cu/Al₂O₃ Resistive Memory Switching. , 2015, Nano letters.

[117]  Conyers Herring,et al.  Effect of Change of Scale on Sintering Phenomena , 1950 .

[118]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[119]  Hyunsang Hwang,et al.  Controllable quantized conductance for multilevel data storage applications using conductive bridge random access memory , 2017, Nanotechnology.

[120]  K. Ghose,et al.  A Brief Overview of Recent Developments in Thermal Management in Data Centers , 2015 .

[121]  M. Kozicki,et al.  Cation-based resistance change memory , 2013 .

[122]  Eric Pop,et al.  Electronic synapses made of layered two-dimensional materials , 2018, Nature Electronics.

[123]  M. Kozicki,et al.  Quantized Conductance in $\hbox{Ag/GeS}_{2}/\hbox{W}$ Conductive-Bridge Memory Cells , 2012, IEEE Electron Device Letters.

[124]  Peng Wang,et al.  Author Correction: Robust memristors based on layered two-dimensional materials , 2018 .

[125]  Klaus Rademann,et al.  Formation mechanism of silver nanoparticles stabilized in glassy matrices. , 2012, Journal of the American Chemical Society.

[126]  M. Haemori,et al.  Impact of Cu Electrode on Switching Behavior in a Cu/HfO2/Pt Structure and Resultant Cu Ion Diffusion , 2009 .

[127]  R. Dittmann,et al.  Redox‐Based Resistive Switching Memories – Nanoionic Mechanisms, Prospects, and Challenges , 2009, Advanced materials.

[128]  Abdul Sattar,et al.  Quantized conductance and switching in percolating nanoparticle films. , 2013, Physical review letters.

[129]  M. Kozicki,et al.  Bipolar and Unipolar Resistive Switching in Cu-Doped $ \hbox{SiO}_{2}$ , 2007, IEEE Transactions on Electron Devices.

[130]  Catherine Dubourdieu,et al.  A 250 mV Cu/SiO2/W Memristor with Half-Integer Quantum Conductance States. , 2016, Nano letters.

[131]  N. Jones How to stop data centres from gobbling up the world’s electricity , 2018, Nature.

[132]  Ib Chorkendorff,et al.  Direct observations of oxygen-induced platinum nanoparticle ripening studied by in situ TEM. , 2010, Journal of the American Chemical Society.

[133]  Steve B. Furber,et al.  The SpiNNaker Project , 2014, Proceedings of the IEEE.

[134]  Gregory S. Snider,et al.  ‘Memristive’ switches enable ‘stateful’ logic operations via material implication , 2010, Nature.

[135]  Qi Liu,et al.  Direct Observation of Conversion Between Threshold Switching and Memory Switching Induced by Conductive Filament Morphology , 2014 .

[136]  Zhengya Zhang,et al.  A fully integrated reprogrammable memristor–CMOS system for efficient multiply–accumulate operations , 2019, Nature Electronics.

[137]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[138]  Joel Emer,et al.  Eyeriss: an Energy-efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks Accessed Terms of Use , 2022 .

[139]  F. Attneave,et al.  The Organization of Behavior: A Neuropsychological Theory , 1949 .

[140]  Qing Wu,et al.  In situ training of feed-forward and recurrent convolutional memristor networks , 2019, Nature Machine Intelligence.

[141]  Manuel Le Gallo,et al.  Stochastic phase-change neurons. , 2016, Nature nanotechnology.

[142]  Rainer Waser,et al.  Modeling of Quantized Conductance Effects in Electrochemical Metallization Cells , 2015, IEEE Transactions on Nanotechnology.

[143]  Naoki Yokoyama,et al.  Additivity of the Quantized Conductance of Multiple Parallel Quantum Point Contacts , 1991 .

[144]  R. Ohba,et al.  Physical random number generator based on MOS structure after soft breakdown , 2004, IEEE Journal of Solid-State Circuits.

[145]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[146]  Nishil Talati,et al.  Logic Design Within Memristive Memories Using Memristor-Aided loGIC (MAGIC) , 2016, IEEE Transactions on Nanotechnology.

[147]  Masakazu Aono,et al.  Mechanism for Conducting Filament Growth in Self‐Assembled Polymer Thin Films for Redox‐Based Atomic Switches , 2016, Advanced materials.

[148]  He Qian,et al.  Understanding memristive switching via in situ characterization and device modeling , 2019, Nature Communications.

[149]  G. W. Burr,et al.  Experimental demonstration and tolerancing of a large-scale neural network (165,000 synapses), using phase-change memory as the synaptic weight element , 2015, 2014 IEEE International Electron Devices Meeting.

[150]  S. Menzel,et al.  Understanding the switching-off mechanism in Ag+ migration based resistively switching model systems , 2007 .

[151]  Yonggang Wen,et al.  Data Center Energy Consumption Modeling: A Survey , 2016, IEEE Communications Surveys & Tutorials.

[152]  D. Jeong,et al.  Memristors for Energy‐Efficient New Computing Paradigms , 2016 .

[153]  Masakazu Aono,et al.  Temperature effects on the switching kinetics of a Cu–Ta2O5-based atomic switch , 2011, Nanotechnology.

[154]  Hyunsang Hwang,et al.  Excellent data retention characteristic of Te-based conductive-bridge RAM using semiconducting Te filament for storage class memory , 2019, Solid-State Electronics.

[155]  D. Jeong,et al.  Nonvolatile Memory Materials for Neuromorphic Intelligent Machines , 2018, Advanced materials.

[156]  Donhee Ham,et al.  Vertical MoS2 Double-Layer Memristor with Electrochemical Metallization as an Atomic-Scale Synapse with Switching Thresholds Approaching 100 mV. , 2019, Nano letters.

[157]  Wilfried Vandervorst,et al.  Understanding the Dual Nature of the Filament Dissolution in Conductive Bridging Devices. , 2015, The journal of physical chemistry letters.