Memristors Empower Spiking Neurons With Stochasticity

Recent theoretical studies have shown that probabilistic spiking can be interpreted as learning and inference in cortical microcircuits. This interpretation creates new opportunities for building neuromorphic systems driven by probabilistic learning algorithms. However, such systems must have two crucial features: 1) the neurons should follow a specific behavioral model, and 2) stochastic spiking should be implemented efficiently for it to be scalable. This paper proposes a memristor-based stochastically spiking neuron that fulfills these requirements. First, the analytical model of the memristor is enhanced so it can capture the behavioral stochasticity consistent with experimentally observed phenomena. The switching behavior of the memristor model is demonstrated to be akin to the firing of the stochastic spike response neuron model, the primary building block for probabilistic algorithms in spiking neural networks. Furthermore, the paper proposes a neural soma circuit that utilizes the intrinsic nondeterminism of memristive switching for efficient spike generation. The simulations and analysis of the behavior of a single stochastic neuron and a winner-take-all network built of such neurons and trained on handwritten digits confirm that the circuit can be used for building probabilistic sampling and pattern adaptation machinery in spiking networks. The findings constitute an important step towards scalable and efficient probabilistic neuromorphic platforms.

[1]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[2]  Mohammed Ismail,et al.  Analog VLSI Implementation of Neural Systems , 2011, The Kluwer International Series in Engineering and Computer Science.

[3]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[4]  Stuart Haber,et al.  A VLSI-efficient technique for generating multiple uncorrelated noise sources and its application to stochastic neural networks , 1991 .

[5]  Gert Cauwenberghs,et al.  An analog VLSI recurrent neural network learning a continuous-time trajectory , 1996, IEEE Trans. Neural Networks.

[6]  Thomas G. Dietterich.  Ensemble Methods in Machine Learning , 2000, Multiple Classifier Systems.

[7]  Wulfram Gerstner,et al.  Noise in Integrate-and-Fire Neurons: From Stochastic Input to Escape Rates , 2000, Neural Computation.

[8]  Gert Cauwenberghs,et al.  Probabilistic synaptic weighting in a reconfigurable network of VLSI integrate-and-fire neurons , 2001, Neural Networks.

[9]  Stefano Fusi,et al.  Stochastic synaptic plasticity in deterministic aVLSI networks of spiking neurons , 2001 .

[10]  Wulfram Gerstner,et al.  SPIKING NEURON MODELS Single Neurons , Populations , Plasticity , 2002 .

[11]  Gert Cauwenberghs,et al.  Spike Timing-Dependent Plasticity in the Address Domain , 2002, NIPS.

[12]  Xiao-Jing Wang,et al.  Mean-Field Theory of Irregularly Spiking Neuronal Populations and Working Memory in Recurrent Cortical Networks , 2003 .

[13]  Shi Zhong,et al.  Efficient online spherical k-means clustering , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[14]  Pedro M. Domingos,et al.  Naive Bayes models for probability estimation , 2005, ICML.

[15]  Eugene M. Izhikevich,et al.  Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting , 2006 .

[16]  Wulfram Gerstner,et al.  Predicting spike timing of neocortical pyramidal neurons by simple threshold models , 2006, Journal of Computational Neuroscience.

[17]  Gert Cauwenberghs,et al.  Dynamically Reconfigurable Silicon Array of Spiking Neurons With Conductance-Based Synapses , 2007, IEEE Transactions on Neural Networks.

[18]  A. Faisal,et al.  Noise in the nervous system , 2008, Nature Reviews Neuroscience.

[19]  Wulfram Gerstner,et al.  Spike-response model , 2008, Scholarpedia.

[20]  J. Yang,et al.  Switching dynamics in titanium dioxide memristive devices , 2009 .

[21]  W. Lu,et al.  Programmable Resistance Switching in Nanoscale Two-terminal Devices , 2008 .

[22]  Dalibor Biolek,et al.  SPICE Model of Memristor with Nonlinear Dopant Drift , 2009 .

[23]  Bernabé Linares-Barranco,et al.  Memristance can explain Spike-Time-Dependent-Plasticity in Neural Synapses , 2009 .

[24]  Mohammed Affan Zidan,et al.  HP Memristor mathematical model for periodic signals and DC , 2010, 2010 53rd IEEE International Midwest Symposium on Circuits and Systems.

[25]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[26]  J. Yang,et al.  Direct Identification of the Conducting Channels in a Functioning Memristive Device , 2010, Advanced materials.

[27]  Mohammed Affan Zidan,et al.  On the mathematical modeling of memristors , 2010, 2010 International Conference on Microelectronics.

[28]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[29]  Damien Querlioz,et al.  Simulation of a memristor-based spiking neural network immune to device variations , 2011, The 2011 International Joint Conference on Neural Networks.

[30]  Bernabé Linares-Barranco,et al.  On Spike-Timing-Dependent-Plasticity, Memristive Devices, and Building a Self-Learning Visual Cortex , 2011, Front. Neurosci..

[31]  Wolfgang Maass,et al.  Probabilistic Inference in General Graphical Models through Sampling in Stochastic Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[32]  Q. Lv,et al.  Conducting nanofilaments formed by oxygen vacancy migration in Ti/TiO 2 /TiN/MgO memristive device , 2011 .

[33]  Shimeng Yu,et al.  On the stochastic nature of resistive switching in metal oxide RRAM: Physical modeling, monte carlo simulation, and experimental characterization , 2011, 2011 International Electron Devices Meeting.

[34]  D. Ielmini,et al.  Modeling the Universal Set/Reset Characteristics of Bipolar RRAM by Field- and Temperature-Driven Filament Growth , 2011, IEEE Transactions on Electron Devices.

[35]  O. Kavehei,et al.  Fabrication and modeling of Ag/TiO2/ITO memristor , 2011, 2011 IEEE 54th International Midwest Symposium on Circuits and Systems (MWSCAS).

[36]  Wolfgang Maass,et al.  Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[37]  Mark D. McDonnell,et al.  The benefits of noise in neural systems: bridging theory and experiment , 2011, Nature Reviews Neuroscience.

[38]  C. Toumazou,et al.  A Versatile Memristor Model With Nonlinear Dopant Kinetics , 2011, IEEE Transactions on Electron Devices.

[39]  Yuchao Yang,et al.  Observation of conducting filament growth in nanoscale resistive memories , 2012, Nature Communications.

[40]  Fernando Corinto,et al.  A Boundary Condition-Based Approach to the Modeling of Memristor Nanostructures , 2012, IEEE Transactions on Circuits and Systems I: Regular Papers.

[41]  T. Serrano-Gotarredona,et al.  A Proposal for Hybrid Memristor-CMOS Spiking Neuromorphic Learning Systems , 2013, IEEE Circuits and Systems Magazine.

[42]  Kyungmin Kim,et al.  Memristor macromodel and its application to neuronal spike generation , 2013, 2013 European Conference on Circuit Theory and Design (ECCTD).

[43]  Wolfgang Maass,et al.  Bayesian Computation Emerges in Generic Cortical Microcircuits through Spike-Timing-Dependent Plasticity , 2013, PLoS Comput. Biol..

[44]  Andrew S. Cassidy,et al.  Cognitive computing building block: A versatile and efficient digital neuron model for neurosynaptic cores , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[45]  Shimeng Yu,et al.  Stochastic learning in oxide binary synaptic device for neuromorphic computing , 2013, Front. Neurosci..

[46]  Gert Cauwenberghs,et al.  Neuromorphic adaptations of restricted Boltzmann machines and deep belief networks , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[47]  Jiantao Zhou,et al.  Stochastic Memristive Devices for Computing and Neuromorphic Applications , 2013, Nanoscale.

[48]  T. Serrano-Gotarredona,et al.  STDP and STDP variations with memristors for spiking neuromorphic learning systems , 2013, Front. Neurosci..

[49]  J Joshua Yang,et al.  Memristive devices for computing. , 2013, Nature nanotechnology.

[50]  F. Corinto,et al.  Memristor Model Comparison , 2013, IEEE Circuits and Systems Magazine.

[51]  Yuchao Yang,et al.  Nanoscale resistive switching devices: mechanisms and modeling. , 2013, Nanoscale.

[52]  D. Biolek,et al.  Reliable SPICE Simulations of Memristors, Memcapacitors and Meminductors , 2013, 1307.2717.

[53]  Fabien Alibart,et al.  Pattern classification by memristive crossbar circuits using ex situ and in situ training , 2013, Nature Communications.

[54]  Tobi Delbruck,et al.  Real-time classification and sensor fusion with a spiking deep belief network , 2013, Front. Neurosci..

[55]  M. Pickett,et al.  A scalable neuristor built with Mott memristors. , 2013, Nature materials.

[56]  E. Vianello,et al.  Bio-Inspired Stochastic Computing Using Binary CBRAM Synapses , 2013, IEEE Transactions on Electron Devices.

[57]  Damien Querlioz,et al.  Stochastic neuron design using conductive bridge RAM , 2013, 2013 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH).

[58]  Johannes Schemmel,et al.  Stochastic inference with deterministic spiking neurons , 2013, ArXiv.

[59]  Giacomo Indiveri,et al.  Integration of nanoscale memristor synapses in neuromorphic computing architectures , 2013, Nanotechnology.

[60]  Robert Legenstein,et al.  A compound memristive synapse model for statistical learning through STDP in spiking neural networks , 2014, Front. Neurosci..

[61]  Juan A. Montiel-Nelson,et al.  Analysis and optimization of dynamically reconfigurable regenerative comparators for ultra-low power 6-bit TC-ADCs in 90 nm CMOS technologies , 2014, Microelectron. J..

[62]  Rubén Moreno-Bote,et al.  Poisson-Like Spiking in Circuits with Probabilistic Synapses , 2014, PLoS Comput. Biol..

[63]  Pablo Ituero,et al.  Building Memristor Applications: From Device Model to Circuit Design , 2014, IEEE Transactions on Nanotechnology.

[64]  David Kappel,et al.  STDP Installs in Winner-Take-All Circuits an Online Approximation to Hidden Markov Model Learning , 2014, PLoS Comput. Biol..

[65]  Wolfgang Maass,et al.  Noise as a Resource for Computation and Learning in Networks of Spiking Neurons , 2014, Proceedings of the IEEE.

[66]  Gert Cauwenberghs,et al.  Event-driven contrastive divergence for spiking neuromorphic systems , 2013, Front. Neurosci..

[67]  T. Prodromakis,et al.  Stochastic switching of TiO2-based memristive devices with identical initial memory states , 2014, Nanoscale Research Letters.

[68]  Mostafa Rahimi Azghadi,et al.  Spike-Based Synaptic Plasticity in Silicon: Design, Implementation, Application, and Challenges , 2014, Proceedings of the IEEE.

[69]  Shinhyun Choi,et al.  Comprehensive physical model of dynamic resistive switching in an oxide memristor. , 2014, ACS nano.

[70]  Yu Wang,et al.  The stochastic modeling of TiO2 memristor and its usage in neuromorphic system design , 2014, 2014 19th Asia and South Pacific Design Automation Conference (ASP-DAC).

[71]  André van Schaik,et al.  Stochastic Electronics: A Neuro-Inspired Design Paradigm for Integrated Circuits , 2014, Proceedings of the IEEE.

[72]  Romain Brette,et al.  Equation-oriented specification of neural models for simulations , 2013, Front. Neuroinform..

[73]  Khaled N. Salama,et al.  A family of memristor‐based reactance‐less oscillators , 2014, Int. J. Circuit Theory Appl..

[74]  Gert Cauwenberghs,et al.  Inherently stochastic spiking neurons for probabilistic neural computation , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).