A self-rectifying TaOy/nanoporous TaOx memristor synaptic array for learning and energy-efficient neuromorphic systems

The human brain intrinsically operates with a large number of synapses, more than 1015. Therefore, one of the most critical requirements for constructing artificial neural networks (ANNs) is to achieve extremely dense synaptic array devices, for which the crossbar architecture containing an artificial synaptic node at each cross is indispensable. However, crossbar arrays suffer from the undesired leakage of signals through neighboring cells, which is a major challenge for implementing ANNs. In this work, we show that this challenge can be overcome by using Pt/TaOy/nanoporous (NP) TaOx/Ta memristor synapses because of their self-rectifying behavior, which is capable of suppressing unwanted leakage pathways. Moreover, our synaptic device exhibits high non-linearity (up to 104), low synapse coupling (S.C, up to 4.00 × 10−5), acceptable endurance (5000 cycles at 85 °C), sweeping (1000 sweeps), retention stability and acceptable cell uniformity. We also demonstrated essential synaptic functions, such as long-term potentiation (LTP), long-term depression (LTD), and spiking-timing-dependent plasticity (STDP), and simulated the recognition accuracy depending on the S.C for MNIST handwritten digit images. Based on the average S.C (1.60 × 10−4) in the fabricated crossbar array, we confirmed that our memristive synapse was able to achieve an 89.08% recognition accuracy after only 15 training epochs.Computing technology: artificial neural networksA high-density array of memristors that can behave in a similar way to the human brain has been developed by scientists in South Korea. The brain processes information very differently and much more efficiently than a computer, and researchers are keen to engineer a system that can emulate a brain network. One possible building block for these artificial brains is the memristor-based synapse. The challenge is to create dense networks of memristors that can work a neural network capable of suppressing an undesired neural signal.  Gunuk Wang from Korea University in Seoul and co-workers have shown that using memristor based on nanoporous tantalum oxide bilayer can suppress effectively the undesired neural signals between the artificial synapses, thus enabling the team to create the artificial neural network with high-accuracy and energy-efficient learning capability.A two-terminal self-rectfying TaOy/Nanoporous TaOx memristor synapse was fabricated based on anodization process. The device exhibits high non-linearity, low synapse-coupling (S.C), acceptable endurance, sweeping and retention stability, as well as essential synaptic functions such as long-term plasticity and spiking-timing-dependent-plasticity. Furthermore, crossbar array consisting of the only designed device without any selector shows relatively well-defined switching parameters with acceptable cell uniformity and capability of suppressing undesired pathways. The effect of S.C on recognition accuracy of MNIST patterns was also simulated for the first time. Based on experimental average S.C value, the device exhibited the high accuracy comparable to S.C = 0

[1]  Hermann Kohlstedt,et al.  Mimic synaptic behavior with a single floating gate transistor: A MemFlash synapse , 2013 .

[2]  Jonathan R. Whitlock,et al.  Learning Induces Long-Term Potentiation in the Hippocampus , 2006, Science.

[3]  Ru Huang,et al.  Engineering incremental resistive switching in TaOx based memristors for brain-inspired computing. , 2016, Nanoscale.

[4]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[5]  John von Neumann The Principles of Large-Scale Computing Machines , 1981, IEEE Ann. Hist. Comput..

[6]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[7]  Young Heon Kim,et al.  Synaptic Plasticity Selectively Activated by Polarization-Dependent Energy-Efficient Ion Migration in an Ultrathin Ferroelectric Tunnel Junction. , 2017, Nano letters.

[8]  Yongsung Ji,et al.  Three-Dimensional Networked Nanoporous Ta2O(5-x) Memory System for Ultrahigh Density Storage. , 2015, Nano letters.

[9]  Kinam Kim,et al.  A fast, high-endurance and scalable non-volatile memory device made from asymmetric Ta2O(5-x)/TaO(2-x) bilayer structures. , 2011, Nature materials.

[10]  V. Birss,et al.  Controlled growth and monitoring of tantalum oxide nanostructures. , 2010, Nanoscale.

[11]  Shimeng Yu,et al.  Introduction to Neuro-Inspired Computing Using Resistive Synaptic Devices , 2017 .

[12]  Shimeng Yu Neuro-inspired Computing Using Resistive Synaptic Devices , 2017 .

[13]  Bong-Kiun Kaang,et al.  Interregional synaptic maps among engram cells underlie memory formation , 2018, Science.

[14]  Majid Ahmadi,et al.  Analog Implementation of a Novel Resistive-Type Sigmoidal Neuron , 2012, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[15]  Injune Yeo,et al.  Fundamental issues of implementing hardware neural networks using memristor , 2015, 2015 International SoC Design Conference (ISOCC).

[16]  O. Cueto,et al.  Physical aspects of low power synapses based on phase change memory devices , 2012 .

[17]  Tae-Wook Kim,et al.  Structurally Engineered Nanoporous Ta2O5-x Selector-Less Memristor for High Uniformity and Low Power Consumption. , 2017, ACS applied materials & interfaces.

[18]  T. Hasegawa,et al.  Short-term plasticity and long-term potentiation mimicked in single inorganic synapses. , 2011, Nature materials.

[19]  John von Neumann The Principles of Large-Scale Computing Machines , 1988, IEEE Ann. Hist. Comput..

[20]  C. Mead,et al.  Fundamental limitations in microelectronics—I. MOS technology , 1972 .

[21]  Tuo-Hung Hou,et al.  One selector-one resistor (1S1R) crossbar array for high-density flexible memory applications , 2011, 2011 International Electron Devices Meeting.

[22]  Byoungil Lee,et al.  Nanoelectronic programmable synapses based on phase change materials for brain-inspired computing. , 2012, Nano letters.

[23]  Dmitri Strukov,et al.  Manhattan rule training for memristive crossbar circuit pattern classifiers , 2015, 2015 IEEE 9th International Symposium on Intelligent Signal Processing (WISP) Proceedings.

[24]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[25]  Jacqueline P. Leighton,et al.  Corsini Encyclopedia of Psychology , 2010 .

[26]  Jiale Liang,et al.  Cross-Point Memory Array Without Cell Selectors—Device Characteristics and Data Storage Pattern Dependencies , 2010, IEEE Transactions on Electron Devices.

[27]  Anil K. Jain,et al.  Artificial Neural Networks: A Tutorial , 1996, Computer.

[28]  James M Tour,et al.  High‐Performance and Low‐Power Rewritable SiOx 1 kbit One Diode–One Resistor Crossbar Memory Array , 2013, Advanced materials.

[29]  Catherine D. Schuman,et al.  A Survey of Neuromorphic Computing and Neural Networks in Hardware , 2017, ArXiv.

[30]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[31]  Ligang Gao,et al.  High precision tuning of state for memristive devices by adaptable variation-tolerant algorithm , 2011, Nanotechnology.

[32]  A. Krogh What are artificial neural networks? , 2008, Nature Biotechnology.

[33]  J. Yang,et al.  Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing. , 2017, Nature materials.

[34]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.

[35]  Jun Yeong Seok,et al.  Highly Uniform, Electroforming‐Free, and Self‐Rectifying Resistive Memory in the Pt/Ta2O5/HfO2‐x/TiN Structure , 2014 .

[36]  Sungho Kim,et al.  Pattern Recognition Using Carbon Nanotube Synaptic Transistors with an Adjustable Weight Update Protocol. , 2017, ACS nano.

[37]  Wei Lu,et al.  The future of electronics based on memristive systems , 2018, Nature Electronics.

[38]  Ming Liu,et al.  A low-cost memristor based on titanium oxide , 2010, 2010 10th IEEE International Conference on Solid-State and Integrated Circuit Technology.

[39]  Patrik Schmuki,et al.  TiO2 nanotubes: synthesis and applications. , 2011, Angewandte Chemie.

[40]  Rainer Waser,et al.  Complementary resistive switches for passive nanocrossbar memories. , 2010, Nature materials.

[41]  Yuan Taur,et al.  Device scaling limits of Si MOSFETs and their application dependencies , 2001, Proc. IEEE.

[42]  Bing Chen,et al.  Very Low-Programming-Current RRAM With Self-Rectifying Characteristics , 2016, IEEE Electron Device Letters.

[43]  Shimeng Yu,et al.  Synaptic electronics: materials, devices and applications , 2013, Nanotechnology.

[44]  Tae-Wook Kim,et al.  Rewritable Switching of One Diode–One Resistor Nonvolatile Organic Memory Devices , 2010, Advanced materials.

[45]  Lingzhou Zhao,et al.  Fabrication, modification, and biomedical applications of anodized TiO2 nanotube arrays , 2014 .

[46]  Sushil H. Bhavnani,et al.  Thermal Challenges in Next-Generation Electronic Systems , 2008 .

[47]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[48]  P. Kruse,et al.  Formation of Dimpled Tantalum Surfaces from Electropolishing , 2007 .