Memristor Synapses for Neuromorphic Computing

Neuromorphic computing, which imitates the principle behind biological synapses with a high degree of parallelism, has recently emerged as a promising candidate for novel and sustainable computing technologies. The first step toward realizing a massively parallel neuromorphic system is to develop an artificial synapse capable of emulating synapse functionality, such as analog modulation, with ultralow power consumption and robust controllability. We begin this chapter with a simple description of neuromorphic systems and memristor synapses. Further, we introduce and evaluate the state-of-the-art neuromorphic hardware technology in terms of novel functional materials and device architectures toward the implementation of fully neuromorphic computers, which have been extensively explored in recent years. Finally, we briefly describe artificial neural networks based on memristor synapse in forms of crossbar arrays.

[1]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[2]  Qi Liu,et al.  Direct Observation of Conversion Between Threshold Switching and Memory Switching Induced by Conductive Filament Morphology , 2014 .

[3]  Wei D. Lu,et al.  Experimental Demonstration of Feature Extraction and Dimensionality Reduction Using Memristor Networks. , 2017, Nano letters.

[4]  Shinhyun Choi,et al.  SiGe epitaxial memory for neuromorphic computing with reproducible high performance based on engineered dislocations , 2018, Nature Materials.

[5]  R. Palmer,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[6]  Jordi Suñé,et al.  Voltage and Power-Controlled Regimes in the Progressive Unipolar RESET Transition of HfO2-Based RRAM , 2013, Scientific Reports.

[7]  Jonathan R. Whitlock,et al.  Learning Induces Long-Term Potentiation in the Hippocampus , 2006, Science.

[8]  Amit Prakash,et al.  TaOx-based resistive switching memories: prospective and challenges , 2013, Nanoscale Research Letters.

[9]  Young Sun,et al.  A Synaptic Transistor based on Quasi‐2D Molybdenum Oxide , 2017, Advanced materials.

[10]  Chih-Yuan Lu,et al.  Unipolar Switching Behaviors of RTO $\hbox{WO}_{X}$ RRAM , 2010, IEEE Electron Device Letters.

[11]  Sungho Kim,et al.  Pattern Recognition Using Carbon Nanotube Synaptic Transistors with an Adjustable Weight Update Protocol. , 2017, ACS nano.

[12]  Pinaki Mazumder,et al.  CMOS and Memristor-Based Neural Network Design for Position Detection , 2012, Proceedings of the IEEE.

[13]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[14]  Wei Huang,et al.  Controllable Multiple Depression in a Graphene Oxide Artificial Synapse , 2017 .

[15]  Yiran Chen,et al.  Reduction and IR-drop compensations techniques for reliable neuromorphic computing systems , 2014, 2014 IEEE/ACM International Conference on Computer-Aided Design (ICCAD).

[16]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[17]  Qiangfei Xia,et al.  Review of memristor devices in neuromorphic computing: materials sciences and device challenges , 2018, Journal of Physics D: Applied Physics.

[18]  John von Neumann.  The Principles of Large-Scale Computing Machines , 1981, IEEE Ann. Hist. Comput..

[19]  Ligang Gao,et al.  High precision tuning of state for memristive devices by adaptable variation-tolerant algorithm , 2011, Nanotechnology.

[20]  Wei Lu,et al.  The future of electronics based on memristive systems , 2018, Nature Electronics.

[21]  Masakazu Aono,et al.  A Polymer‐Electrolyte‐Based Atomic Switch , 2011 .

[22]  Shimeng Yu,et al.  HfOx-based vertical resistive switching random access memory suitable for bit-cost-effective three-dimensional cross-point architecture. , 2013, ACS nano.

[23]  Bing Chen,et al.  Very Low-Programming-Current RRAM With Self-Rectifying Characteristics , 2016, IEEE Electron Device Letters.

[24]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[25]  Muhammad Khalid,et al.  Memristor Crossbar-Based Pattern Recognition Circuit Using Perceptron Learning Rule , 2016, 2016 IEEE International Symposium on Nanoelectronic and Information Systems (iNIS).

[26]  J. W. Backus,et al.  Can programming be liberated from the von Neumann style , 1977 .

[27]  Jung Min Lee,et al.  Synaptic Barristor Based on Phase‐Engineered 2D Heterostructures , 2018, Advanced materials.

[28]  Wei D. Lu,et al.  K-means Data Clustering with Memristor Networks. , 2018, Nano letters.

[29]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[30]  Ali Khiat,et al.  Unsupervised learning in probabilistic neural networks with multi-state metal-oxide memristive synapses , 2016, Nature Communications.

[31]  Shimeng Yu,et al.  Synaptic electronics: materials, devices and applications , 2013, Nanotechnology.

[32]  Mark S. Lundstrom,et al.  APPLIED PHYSICS: Enhanced: Moore's Law Forever? , 2003 .

[33]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[34]  J Joshua Yang,et al.  Memristive devices for computing. , 2013, Nature nanotechnology.

[35]  Shimeng Yu.  Neuro-inspired Computing Using Resistive Synaptic Devices , 2017 .

[36]  Witali L. Dunin-Barkowski,et al.  An approximate backpropagation learning rule for memristor based neural networks using synaptic plasticity , 2015, Neurocomputing.

[37]  Bong-Kiun Kaang,et al.  Interregional synaptic maps among engram cells underlie memory formation , 2018, Science.

[38]  Wei D. Lu,et al.  Electrochemical dynamics of nanoscale metallic inclusions in dielectrics , 2014, Nature Communications.

[39]  J. Yang,et al.  Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing. , 2017, Nature materials.

[40]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.

[41]  Kinam Kim,et al.  A fast, high-endurance and scalable non-volatile memory device made from asymmetric Ta2O(5-x)/TaO(2-x) bilayer structures. , 2011, Nature materials.

[42]  Qing Wan,et al.  Artificial synapse network on inorganic proton conductor for neuromorphic systems. , 2014, Nature communications.

[43]  Qi Liu,et al.  Controllable growth of nanoscale conductive filaments in solid-electrolyte-based ReRAM by using a metal nanocrystal covered bottom electrode. , 2010, ACS nano.

[44]  Sparsh Mittal,et al.  A Survey of ReRAM-Based Architectures for Processing-In-Memory and Neural Networks , 2018, Mach. Learn. Knowl. Extr..

[45]  Melika Payvand,et al.  A CMOS-memristive self-learning neural network for pattern classification applications , 2014, 2014 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH).

[46]  Barney Lee Doyle,et al.  Reactive sputtering of substoichiometric Ta2Ox for resistive memory applications , 2014 .

[47]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[48]  Siddharth Gaba,et al.  Nanoscale resistive memory with intrinsic diode characteristics and long endurance , 2010 .

[49]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[50]  Gunuk Wang,et al.  Photonic Organolead Halide Perovskite Artificial Synapse Capable of Accelerated Learning at Low Power Inspired by Dopamine‐Facilitated Synaptic Activity , 2018, Advanced Functional Materials.

[51]  R. Williams,et al.  Sub-nanosecond switching of a tantalum oxide memristor , 2011, Nanotechnology.

[52]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[53]  T. Hasegawa,et al.  Short-term plasticity and long-term potentiation mimicked in single inorganic synapses. , 2011, Nature materials.

[54]  Yuan Taur,et al.  Device scaling limits of Si MOSFETs and their application dependencies , 2001, Proc. IEEE.

[55]  Tarek M. Taha,et al.  Enabling back propagation training of memristor crossbar neuromorphic processors , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[56]  Jung-Hwan Moon,et al.  A self-rectifying TaOy/nanoporous TaOx memristor synaptic array for learning and energy-efficient neuromorphic systems , 2018, NPG Asia Materials.

[57]  Hyunsang Hwang,et al.  Effect of Scaling $\hbox{WO}_{x}$-Based RRAMs on Their Resistive Switching Characteristics , 2011, IEEE Electron Device Letters.

[58]  Fabien Alibart,et al.  Pattern classification by memristive crossbar circuits using ex situ and in situ training , 2013, Nature Communications.

[59]  Sally A. McKee,et al.  Reflections on the memory wall , 2004, CF '04.