Memristors for Energy‐Efficient New Computing Paradigms

In this Review, memristors are examined from the frameworks of both von Neumann and neuromorphic computing architectures. For the former, a new logic computational process based on the material implication is discussed. It consists of several memristors which play roles of combined logic processor and memory, called stateful logic circuit. In this circuit configuration, the logic process flows primarily along a time dimension, whereas in current von Neumann computers it occurs along a spatial dimension. In the stateful logic computation scheme, the energy required for the data transfer between the logic and memory chips can be saved. The non‐volatile memory in this circuit also saves the energy required for the data refresh. Neuromorphic (cognitive) computing refers to a computing paradigm that mimics the human brain. Currently, the neuromorphic or cognitive computing mainly relies on the software emulation of several brain functionalities, such as image and voice recognition utilizing the recently highlighted deep learning algorithm. However, the human brain typically consumes ≈10–20 Watts for selected “human‐like” tasks, which can be currently mimicked by a supercomputer with power consumption of several tens of kilo‐ to megawatts. Therefore, hardware implementation of such brain functionality must be eventually sought for power‐efficient computation. Several fundamental ideas for utilizing the memristors and their recent progresses in these regards are reviewed. Finally, material and processing issues are dealt with, which is followed by the conclusion and outlook of the field. These technical improvements will substantially decrease the energy consumption for futuristic information technology.

[1]  Claude E. Shannon,et al.  A symbolic analysis of relay and switching circuits , 1938, Transactions of the American Institute of Electrical Engineers.

[2]  T. W. Hickmott LOW-FREQUENCY NEGATIVE RESISTANCE IN THIN ANODIC OXIDE FILMS , 1962 .

[3]  T. W. Hickmott Potential Distribution and Negative Resistance in Thin Oxide Films , 1964 .

[4]  T. W. Hickmott Electroluminescence, Bistable Switching, and Dielectric Breakdown of Nb2O5 Diodes , 1969 .

[5]  L. Chua Memristor-The missing circuit element , 1971 .

[6]  L.O. Chua,et al.  Memristive devices and systems , 1976, Proceedings of the IEEE.

[7]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[9]  Eric B. Baum,et al.  On the capabilities of multilayer perceptrons , 1988, J. Complex..

[10]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.

[11]  E. Kandel,et al.  Learning-related synaptic plasticity: LTP and LTD , 1991, Current Opinion in Neurobiology.

[12]  T. Bliss,et al.  A synaptic model of memory: long-term potentiation in the hippocampus , 1993, Nature.

[13]  T. Delbruck Silicon retina with correlation-based, velocity-tuned pixels , 1993 .

[14]  Gregory S. Snider,et al.  A Defect-Tolerant Computer Architecture: Opportunities for Nanotechnology , 1998 .

[15]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[16]  J. Hopfield,et al.  All-or-none potentiation at CA3-CA1 synapses. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[17]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[18]  Mark C. W. van Rossum,et al.  Stable Hebbian Learning from Spike Timing-Dependent Plasticity , 2000, The Journal of Neuroscience.

[19]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[20]  Anthony N. Burkitt,et al.  Calculation of Interspike Intervals for Integrate-and-Fire Neurons with Poisson Distribution of Synaptic Inputs , 2000, Neural Computation.

[21]  Kwabena Boahen,et al.  Point-to-point connectivity between neuromorphic chips using address events , 2000 .

[22]  C. Gerber,et al.  Reproducible switching effect in thin oxide films for memory applications , 2000 .

[23]  André van Schaik Building blocks for electronic spiking neural networks , 2001, Neural Networks.

[24]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[25]  Andreas Mayr,et al.  CrossNets: High‐Performance Neuromorphic Architectures for CMOL Circuits , 2003, Annals of the New York Academy of Sciences.

[26]  Maria Mitkova,et al.  Information storage using nanoscale electrodeposition of metal in solid electrolytes , 2003 .

[27]  P. Lennie The Cost of Cortical Computation , 2003, Current Biology.

[28]  Mircea R. Stan,et al.  CMOS/nano co-design for crossbar-based molecular electronic systems , 2003 .

[29]  Tobi Delbrück,et al.  A silicon early visual system as a model animal , 2004, Vision Research.

[30]  W. Gerstner,et al.  Generalized Bienenstock-Cooper-Munro rule for spiking neurons that maximizes information transmission. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[31]  G. Roth,et al.  Evolution of the brain and intelligence , 2005, Trends in Cognitive Sciences.

[32]  D. Strukov,et al.  CMOL FPGA: a reconfigurable architecture for hybrid digital circuits with two-terminal nanodevices , 2005 .

[33]  Riccardo Zecchina,et al.  Learning by message-passing in networks of discrete synapses , 2005, Physical review letters.

[34]  W. Gerstner,et al.  Triplets of Spikes in a Model of Spike Timing-Dependent Plasticity , 2006, The Journal of Neuroscience.

[35]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[36]  Y. Dan,et al.  Spike timing-dependent plasticity: from synapse to perception. , 2006, Physiological reviews.

[37]  Giacomo Indiveri,et al.  A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity , 2006, IEEE Transactions on Neural Networks.

[38]  Geoffrey E. Hinton Learning multiple layers of representation , 2007, Trends in Cognitive Sciences.

[39]  G. Snider,et al.  Self-organized computation with unreliable, memristive nanodevices , 2007 .

[40]  Nicolas Brunel,et al.  Efficient supervised learning in networks with binary synapses , 2007, BMC Neuroscience.

[41]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[42]  A. Sawa Resistive switching in transition metal oxides , 2008 .

[43]  Y. Dan,et al.  Spike timing-dependent plasticity: a Hebbian learning rule. , 2008, Annual review of neuroscience.

[44]  David C. Gadsby,et al.  Ion channels versus ion pumps: the principal difference, in principle , 2009, Nature Reviews Molecular Cell Biology.

[45]  Warren Robinett,et al.  Memristor-CMOS hybrid integrated circuits for reconfigurable logic. , 2009, Nano letters.

[46]  Jun Yeong Seok,et al.  Influence of the Interconnection Line Resistance and Performance of a Resistive Cross Bar Array Memory , 2010 .

[47]  C. Gamrat,et al.  An Organic Nanoparticle Transistor Behaving as a Biological Spiking Synapse , 2009, 0907.2540.

[48]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[49]  Zhiyong Li,et al.  Ionic/Electronic Hybrid Materials Integrated in a Synaptic Transistor with Signal Processing and Learning Functions , 2010, Advanced materials.

[50]  Rainer Waser,et al.  Complementary resistive switches for passive nanocrossbar memories. , 2010, Nature materials.

[51]  J. Yang,et al.  Direct Identification of the Conducting Channels in a Functioning Memristive Device , 2010, Advanced materials.

[52]  Jae Hyuck Jang,et al.  Atomic structure of conducting nanofilaments in TiO2 resistive switching memory. , 2010, Nature nanotechnology.

[53]  Cheol Seong Hwang,et al.  A Pt/TiO2/Ti Schottky-type selection diode for alleviating the sneak current in resistance switching memory arrays , 2010, Nanotechnology.

[54]  Cheol Seong Hwang,et al.  A theoretical model for Schottky diodes for excluding the sneak current in cross bar array resistive memory , 2010, Nanotechnology.

[55]  Richard Hans Robert Hahnloser,et al.  Spike-Time-Dependent Plasticity and Heterosynaptic Competition Organize Networks to Produce Long Scale-Free Sequences of Neural Activity , 2010, Neuron.

[56]  Gregory S. Snider,et al.  ‘Memristive’ switches enable ‘stateful’ logic operations via material implication , 2010, Nature.

[57]  B. Cho,et al.  Organic Resistive Memory Devices: Performance Enhancement, Integration, and Advanced Architectures , 2011 .

[58]  Byung Joon Choi,et al.  A detailed understanding of the electronic bipolar resistance switching behavior in Pt/TiO2/Pt structure , 2011, Nanotechnology.

[59]  Fabien Alibart,et al.  A Memristive Nanoparticle/Organic Hybrid Synapstor for Neuroinspired Computing , 2011, ArXiv.

[60]  Byung Joon Choi,et al.  Purely Electronic Switching with High Uniformity, Resistance Tunability, and Good Retention in Pt‐Dispersed SiO2 Thin Films for ReRAM , 2011, Advanced materials.

[61]  T. Hasegawa,et al.  Short-term plasticity and long-term potentiation mimicked in single inorganic synapses. , 2011, Nature materials.

[62]  Martin Hilbert,et al.  The World’s Technological Capacity to Store, Communicate, and Compute Information , 2011, Science.

[63]  Leon O. Chua Resistance switching memories are memristors , 2011 .

[64]  D. Jeong,et al.  Nanofilamentary resistive switching in binary oxide system; a review on the present status and outlook , 2011, Nanotechnology.

[65]  Shimeng Yu,et al.  An Electronic Synapse Device Based on Metal Oxide Resistive Switching Memory for Neuromorphic Computation , 2011, IEEE Transactions on Electron Devices.

[66]  Kinam Kim,et al.  A fast, high-endurance and scalable non-volatile memory device made from asymmetric Ta2O(5-x)/TaO(2-x) bilayer structures. , 2011, Nature materials.

[67]  J. Pfister,et al.  A triplet spike-timing–dependent plasticity model generalizes the Bienenstock–Cooper–Munro rule to higher-order spatiotemporal correlations , 2011, Proceedings of the National Academy of Sciences.

[68]  Seung Chul Chae,et al.  Oxide Double‐Layer Nanocrossbar for Ultrahigh‐Density Bipolar Resistive Memory , 2011, Advanced materials.

[69]  J. Yang,et al.  Anatomy of a Nanoscale Conduction Channel Reveals the Mechanism of a High‐Performance Memristor , 2011, Advanced materials.

[70]  U. Böttger,et al.  Beyond von Neumann—logic operations in passive crossbar arrays alongside memory operations , 2012, Nanotechnology.

[71]  N. Brunel,et al.  Calcium-based plasticity model explains sensitivity of synaptic changes to spike pattern, rate, and dendritic location , 2012, Proceedings of the National Academy of Sciences.

[72]  Yuchao Yang,et al.  Observation of conducting filament growth in nanoscale resistive memories , 2012, Nature Communications.

[73]  M. Ziegler,et al.  An Electronic Version of Pavlov's Dog , 2012 .

[74]  J. Grollier,et al.  A ferroelectric memristor. , 2012, Nature materials.

[75]  Jing Li,et al.  An FPGA-Based Silicon Neuronal Network with Selectable Excitability Silicon Neurons , 2012, Front. Neurosci..

[76]  Qi Liu,et al.  Real‐Time Observation on Dynamic Growth/Dissolution of Conductive Filaments in Oxide‐Electrolyte‐Based ReRAM , 2012, Advanced materials.

[77]  D. Jeong,et al.  Emerging memories: resistive switching mechanisms and current status , 2012, Reports on progress in physics. Physical Society.

[78]  Doo Seok Jeong,et al.  Threshold resistive and capacitive switching behavior in binary amorphous GeSe , 2012 .

[79]  Byung Joon Choi,et al.  Engineering nonlinearity into memristors for passive crossbar applications , 2012 .

[80]  T. Hasegawa,et al.  Atomic Switch: Atom/Ion Movement Controlled Devices for Beyond Von‐Neumann Computers , 2012, Advanced materials.

[81]  Cheol Seong Hwang,et al.  Memristive tri-stable resistive switching at ruptured conducting filaments of a Pt/TiO2/Pt cell , 2012, Nanotechnology.

[82]  O. Cueto,et al.  Physical aspects of low power synapses based on phase change memory devices , 2012 .

[83]  A. Thomas,et al.  The Memristive Magnetic Tunnel Junction as a Nanoscopic Synapse‐Neuron System , 2012, Advanced materials.

[84]  Y. Liu,et al.  Synaptic Learning and Memory Functions Achieved Using Oxygen Ion Migration/Diffusion in an Amorphous InGaZnO Memristor , 2012 .

[85]  Henry Markram,et al.  The human brain project. , 2012, Scientific American.

[86]  T. Morie,et al.  Three-terminal ferroelectric synapse device with concurrent learning function for artificial neural networks , 2012 .

[87]  Byoungil Lee,et al.  Nanoelectronic programmable synapses based on phase change materials for brain-inspired computing. , 2012, Nano letters.

[88]  Alan F. Murray,et al.  Spike-Timing-Dependent Plasticity With Weight Dependence Evoked From Physical Constraints , 2012, IEEE Transactions on Biomedical Circuits and Systems.

[89]  Matthew D. Pickett,et al.  Local Temperature Redistribution and Structural Transition During Joule‐Heating‐Driven Conductance Switching in VO2 , 2013, Advanced materials.

[90]  J Joshua Yang,et al.  Memristive devices for computing. , 2013, Nature nanotechnology.

[91]  Kinam Kim,et al.  In situ observation of filamentary conducting channels in an asymmetric Ta2O5−x/TaO2−x bilayer structure , 2013, Nature Communications.

[92]  Yuchao Yang,et al.  Nanoscale resistive switching devices: mechanisms and modeling. , 2013, Nanoscale.

[93]  A New High Speed Low Power Dissipation Three-Element Si-Based SRAM Cell , 2013 .

[94]  M. R. Uddin,et al.  A plasma-treated chalcogenide switch device for stackable scalable 3D nanoscale memory , 2013, Nature Communications.

[95]  Shimeng Yu,et al.  Synaptic electronics: materials, devices and applications , 2013, Nanotechnology.

[96]  Doo Seok Jeong,et al.  Towards artificial neurons and synapses: a materials point of view , 2013 .

[97]  Fabien Alibart,et al.  Pattern classification by memristive crossbar circuits using ex situ and in situ training , 2013, Nature Communications.

[98]  Yasuo Takahashi,et al.  In-situ transmission electron microscopy of conductive filaments in NiO resistance random access memory and its analysis , 2013 .

[99]  M. Pickett,et al.  A scalable neuristor built with Mott memristors. , 2013, Nature materials.

[100]  A Study on the Scalability of a Selector Device Using Threshold Switching in Pt/GeSe/Pt , 2013 .

[101]  E. Vianello,et al.  Bio-Inspired Stochastic Computing Using Binary CBRAM Synapses , 2013, IEEE Transactions on Electron Devices.

[102]  Jennifer Hasler,et al.  Finding a roadmap to achieve large neuromorphic hardware systems , 2013, Front. Neurosci..

[103]  Ho Won Jang,et al.  Elastic resistance change and action potential generation of non-faradaic Pt/TiO2/Pt capacitors. , 2013, Nanoscale.

[104]  Cheol Seong Hwang,et al.  Real-time identification of the evolution of conducting nano-filaments in TiO2 thin film ReRAM , 2013, Scientific Reports.

[105]  Lih-Juann Chen,et al.  Dynamic evolution of conducting nanofilament in resistive switching memories. , 2013, Nano letters.

[106]  Kate J. Norris,et al.  Electrical performance and scalability of Pt dispersed SiO2 nanometallic resistance switch. , 2013, Nano letters.

[107]  Jun Yeong Seok,et al.  Highly Uniform, Electroforming‐Free, and Self‐Rectifying Resistive Memory in the Pt/Ta2O5/HfO2‐x/TiN Structure , 2014 .

[108]  Tae Hyung Park,et al.  Evolution of the shape of the conducting channel in complementary resistive switching transition metal oxides. , 2014, Nanoscale.

[109]  Qiang Zhao,et al.  Polymer‐Based Resistive Memory Materials and Devices , 2014, Advanced materials.

[110]  X. Miao,et al.  Activity-Dependent Synaptic Plasticity of a Chalcogenide Electronic Synapse for Neuromorphic Systems , 2014, Scientific Reports.

[111]  Leon O. Chua,et al.  If it’s pinched it’s a memristor , 2014 .

[112]  Xuedong Bai,et al.  Filament growth dynamics in solid electrolyte-based resistive memories revealed by in situ TEM , 2014, Nano Research.

[113]  Yuchao Yang,et al.  Oxide Resistive Memory with Functionalized Graphene as Built‐in Selector Element , 2014, Advanced materials.

[114]  Lu Zhang,et al.  Electrode-material dependent switching in TaO x memristors , 2014 .

[115]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[116]  Luping Shi,et al.  Enabling an Integrated Rate-temporal Learning Scheme on Memristor , 2014, Scientific Reports.

[117]  Shimeng Yu,et al.  Ultra-low-energy three-dimensional oxide-based electronic synapses for implementation of robust high-accuracy neuromorphic computation systems. , 2014, ACS nano.

[118]  Y. S. Chen,et al.  Evolution of conduction channel and its effect on resistance switching for Au-WO3-x–Au devices , 2014, Scientific Reports.

[119]  Mostafa Rahimi Azghadi,et al.  Spike-Based Synaptic Plasticity in Silicon: Design, Implementation, Application, and Challenges , 2014, Proceedings of the IEEE.

[120]  Rainer Waser,et al.  Impact of the Counter‐Electrode Material on Redox Processes in Resistive Switching Memories , 2014 .

[121]  Omid Kavehei,et al.  Multiprotocol-induced plasticity in artificial synapses. , 2014, Nanoscale.

[122]  Siddharth Gaba,et al.  Ultralow Sub-1-nA Operating Current Resistive Memory With Intrinsic Non-Linear Characteristics , 2014, IEEE Electron Device Letters.

[123]  André van Schaik,et al.  Stochastic Electronics: A Neuro-Inspired Design Paradigm for Integrated Circuits , 2014, Proceedings of the IEEE.

[124]  Jacques-Olivier Klein,et al.  Spin-transfer torque magnetic memory as a stochastic memristive synapse , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[125]  Bipin Rajendran,et al.  Novel synaptic memory device for neuromorphic computing , 2014, Scientific Reports.

[126]  Shinhyun Choi,et al.  Tuning resistive switching characteristics of tantalum oxide memristors through Si doping. , 2014, ACS nano.

[127]  Doo Seok Jeong,et al.  A Review of Three‐Dimensional Resistive Switching Cross‐Bar Array Memories from the Integration and Materials Property Points of View , 2014 .

[128]  Wei Lu,et al.  Biorealistic Implementation of Synaptic Functions with Oxide Memristors through Internal Ionic Dynamics , 2015 .

[129]  Tae Hyung Park,et al.  Thickness effect of ultra-thin Ta2O5 resistance switching layer in 28 nm-diameter memory cell , 2015, Scientific Reports.

[130]  R. Waser,et al.  Understanding the conductive channel evolution in Na:WO(3-x)-based planar devices. , 2015, Nanoscale.

[131]  Rajeev J. Ram,et al.  Single-chip microprocessor that communicates directly using light , 2015, Nature.

[132]  Wei Zhang,et al.  An Electronic Synapse Device Based on Solid Electrolyte Resistive Random Access Memory , 2015, IEEE Electron Device Letters.

[133]  Yuchao Yang,et al.  Memristive Physically Evolving Networks Enabling the Emulation of Heterosynaptic Plasticity , 2015, Advanced materials.

[134]  O. Richard,et al.  Imaging the Three-Dimensional Conductive Channel in Filamentary-Based Oxide Resistive Switching Memory. , 2015, Nano letters.

[135]  Eric Pop,et al.  Energy-Efficient Phase-Change Memory with Graphene as a Thermal Barrier. , 2015, Nano letters.

[136]  Fabien Alibart,et al.  Plasticity in memristive devices for spiking neural networks , 2015, Front. Neurosci..

[137]  He Tian,et al.  In Situ Tuning of Switching Window in a Gate‐Controlled Bilayer Graphene‐Electrode Resistive Memory Device , 2015, Advanced materials.

[138]  Seung Ryul Lee,et al.  Self‐Limited Switching in Ta2O5/TaOx Memristors Exhibiting Uniform Multilevel Changes in Resistance , 2015 .

[139]  Sungho Kim,et al.  Experimental demonstration of a second-order memristor and its ability to biorealistically implement synaptic plasticity. , 2015, Nano letters.

[140]  Wei D. Lu,et al.  Data Clustering using Memristor Networks , 2015, Scientific Reports.

[141]  Byung Joon Choi,et al.  Thickness‐dependent electroforming behavior of ultra‐thin Ta2O5 resistance switching layer , 2015 .

[142]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[143]  Fabien Clermidy,et al.  Emerging resistive memories for low power embedded applications and neuromorphic systems , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[144]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[145]  Doo Seok Jeong,et al.  Reliability of neuronal information conveyed by unreliable neuristor-based leaky integrate-and-fire neurons: a model study , 2015, Scientific Reports.

[146]  Yoon-Ha Jeong,et al.  Optimization of Conductance Change in Pr1–xCaxMnO3-Based Synaptic Devices for Neuromorphic Systems , 2015, IEEE Electron Device Letters.

[147]  Eric Pop,et al.  Nanoscale Phase Change Memory with Graphene Ribbon Electrodes , 2015 .

[148]  Yu-Fen Wang,et al.  Characterization and Modeling of Nonfilamentary Ta/TaOx/TiO2/Ti Analog Synaptic Device , 2015, Scientific Reports.

[149]  Simone Balatti,et al.  A 2-transistor/1-resistor artificial synapse capable of communication and stochastic learning in neuromorphic systems , 2015, Front. Neurosci..

[150]  Mirko Hansen,et al.  A memristive spiking neuron with firing rate coding , 2015, Front. Neurosci..

[151]  Pt/Ta2 O5 /HfO2- x /Ti resistive switching memory competing with multilevel NAND flash. , 2015, Advanced materials.

[152]  Earl E. Swartzlander,et al.  Bidirectional voltage biased implication operations using SiOx based unipolar memristors , 2015 .

[153]  Hong-Yu Chen,et al.  Metal oxide-resistive memory using graphene-edge electrodes , 2015, Nature Communications.

[154]  Doo Seok Jeong,et al.  Relaxation oscillator-realized artificial electronic neurons, their responses, and noise. , 2016, Nanoscale.

[155]  Kate J. Norris,et al.  Trilayer Tunnel Selectors for Memristor Memory Cells , 2015, Advanced materials.

[156]  Georgios Ch. Sirakoulis,et al.  Memristor-Based Nanoelectronic Computing Circuits and Architectures , 2016 .

[157]  Doo Seok Jeong,et al.  Leaky Integrate-and-Fire Neuron Circuit Based on Floating-Gate Integrator , 2016, Front. Neurosci..