Low-Energy Robust Neuromorphic Computation Using Synaptic Devices

Brain-inspired computing is an emerging field, which aims to reach brainlike performance in real-time processing of sensory data. The challenges that need to be addressed toward reaching such a computational system include building a compact massively parallel architecture with scalable interconnection devices, ultralow-power consumption, and robust neuromorphic computational schemes for implementation of learning in hardware. In this paper, we discuss programming strategies, material characteristics, and spike schemes, which enable implementation of symmetric and asymmetric synaptic plasticity with devices using phase-change materials. We demonstrate that energy consumption can be optimized by tuning the device operation regime and the spike scheme. Our simulations illustrate that a crossbar array consisting of synaptic devices and neurons can achieve hippocampus-like associative learning with symmetric synapses and sequence learning with asymmetric synapses. Pattern completion for patterns with 50% missing elements is achieved via associative learning with symmetric plasticity. Robustness of learning against input noise, variation in sensory data, and device resistance variation are investigated through simulations.

[1]  Gregory S. Snider,et al.  Spike-timing-dependent learning in memristive nanodevices , 2008, 2008 IEEE International Symposium on Nanoscale Architectures.

[2]  S. Ovshinsky The Ovonic Cognitive Computer-A New Paradigm , 2004 .

[3]  Byoungil Lee,et al.  Nanoelectronic programmable synapses based on phase change materials for brain-inspired computing. , 2012, Nano letters.

[4]  Bernabé Linares-Barranco,et al.  On Spike-Timing-Dependent-Plasticity, Memristive Devices, and Building a Self-Learning Visual Cortex , 2011, Front. Neurosci..

[5]  S. Wang,et al.  Malleability of Spike-Timing-Dependent Plasticity at the CA3–CA1 Synapse , 2006, The Journal of Neuroscience.

[6]  H. Hwang,et al.  Analog memory and spike-timing-dependent plasticity characteristics of a nanoscale titanium oxide bilayer resistive switching device , 2011, Nanotechnology.

[7]  Junichi Akita,et al.  Pulse number control of electrical resistance for multi-level storage based on phase change , 2007 .

[8]  Neil Burgess,et al.  Attractor Dynamics in the Hippocampal Representation of the Local Environment , 2005, Science.

[9]  Y.N. Hwang,et al.  MLC PRAM with SLC write-speed and robust read scheme , 2010, 2010 Symposium on VLSI Technology.

[10]  T. Hasegawa,et al.  Short-term plasticity and long-term potentiation mimicked in single inorganic synapses. , 2011, Nature materials.

[11]  A. Pirovano,et al.  Analysis of phase distribution in phase-change nonvolatile memories , 2004, IEEE Electron Device Letters.

[12]  E. Maguire,et al.  The Human Hippocampus and Spatial and Episodic Memory , 2002, Neuron.

[13]  Yong Liu,et al.  A 45nm CMOS neuromorphic chip with a scalable architecture for learning in networks of spiking neurons , 2011, 2011 IEEE Custom Integrated Circuits Conference (CICC).

[14]  Geoffrey W. Burr,et al.  Nanoscale electronic synapses using phase change devices , 2013, JETC.

[15]  J. Kim,et al.  Full Integration of Highly Manufacturable 512Mb PRAM based on 90nm Technology , 2006, 2006 International Electron Devices Meeting.

[16]  Jiale Liang,et al.  An Ultra-Low Reset Current Cross-Point Phase Change Memory With Carbon Nanotube Electrodes , 2012, IEEE Transactions on Electron Devices.

[17]  Eric Pop,et al.  Low-Power Switching of Phase-Change Materials with Carbon Nanotube Electrodes , 2011, Science.

[18]  C. Gamrat,et al.  An Organic Nanoparticle Transistor Behaving as a Biological Spiking Synapse , 2009, 0907.2540.

[19]  K. Martin,et al.  The Cell Biology of Synaptic Plasticity , 2011, Science.

[20]  R G M Morris,et al.  Elements of a neurobiological theory of the hippocampus: the role of activity-dependent synaptic plasticity in memory. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[21]  Dharmendra S. Modha,et al.  A digital neurosynaptic core using embedded crossbar memory with 45pJ per spike in 45nm , 2011, 2011 IEEE Custom Integrated Circuits Conference (CICC).

[22]  Olivier Bichler,et al.  Phase change memory as synapse for ultra-dense neuromorphic systems: Application to complex visual pattern extraction , 2011, 2011 International Electron Devices Meeting.

[23]  S. Lai,et al.  Current status of the phase change memory and its future , 2003, IEEE International Electron Devices Meeting 2003.

[24]  Stanford R. Ovshinsky,et al.  Analog models for information storage and transmission in physiological systems , 1970 .

[25]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[26]  M. Poo,et al.  Coincident Pre- and Postsynaptic Activity Modifies GABAergic Synapses by Postsynaptic Changes in Cl− Transporter Activity , 2003, Neuron.

[27]  M. Lankhorst,et al.  Low-cost and nanoscale non-volatile memory concept for future silicon chips , 2005, Nature materials.

[28]  Roberto Bez,et al.  Chalcogenide PCM: a memory technology for next decade , 2009, 2009 IEEE International Electron Devices Meeting (IEDM).

[29]  H.-S. Philip Wong,et al.  Energy efficient programming of nanoelectronic synaptic devices for large-scale implementation of associative and temporal sequence learning , 2011, 2011 International Electron Devices Meeting.

[30]  Y.C. Chen,et al.  Write Strategies for 2 and 4-bit Multi-Level Phase-Change Memory , 2007, 2007 IEEE International Electron Devices Meeting.

[31]  G. Servalli,et al.  A 45nm generation Phase Change Memory technology , 2009, 2009 IEEE International Electron Devices Meeting (IEDM).

[32]  Edvard I Moser,et al.  The multi-laned hippocampus , 2011, Nature Neuroscience.