Memristor-based neural networks: Synaptic versus neuronal stochasticity

In neuromorphic circuits, stochasticity in the cortex can be mapped into the synaptic or neuronal components. The hardware emulation of these stochastic neural networks are currently being extensively studied using resistive memories or memristors. The ionic process involved in the underlying switching behavior of the memristive elements is considered as the main source of stochasticity of its operation. Building on its inherent variability, the memristor is incorporated into abstract models of stochastic neurons and synapses. Two approaches of stochastic neural networks are investigated. Aside from the size and area perspective, the impact on the system performance, in terms of accuracy, recognition rates, and learning, among these two approaches and where the memristor would fall into place are the main comparison points to be considered.

[1]  Manuel Le Gallo,et al.  Stochastic phase-change neurons. , 2016, Nature nanotechnology.

[2]  Rawan Naous,et al.  Stochasticity Modeling in Memristors , 2016, IEEE Transactions on Nanotechnology.

[3]  Siddharth Joshi,et al.  Stochastic Synapses Enable Efficient Brain-Inspired Learning Machines , 2015, Front. Neurosci..

[4]  Matthew Cook,et al.  Unsupervised learning of digit recognition using spike-timing-dependent plasticity , 2015, Front. Comput. Neurosci..

[5]  Gert Cauwenberghs,et al.  Memristors Empower Spiking Neurons With Stochasticity , 2015, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[6]  Gert Cauwenberghs,et al.  Inherently stochastic spiking neurons for probabilistic neural computation , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[7]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[8]  Khaled N. Salama,et al.  Towards neuromorphic electronics: Memristors on foldable silicon fabric , 2014, Microelectron. J..

[9]  Shimeng Yu,et al.  Stochastic learning in oxide binary synaptic device for neuromorphic computing , 2013, Front. Neurosci..

[10]  Yuchao Yang,et al.  Nanoscale resistive switching devices: mechanisms and modeling. , 2013, Nanoscale.

[11]  Jiantao Zhou,et al.  Stochastic Memristive Devices for Computing and Neuromorphic Applications , 2013, Nanoscale.

[12]  Giacomo Indiveri,et al.  Integration of nanoscale memristor synapses in neuromorphic computing architectures , 2013, Nanotechnology.

[13]  M. Pickett,et al.  A scalable neuristor built with Mott memristors. , 2013, Nature materials.

[14]  Paolo Lugli,et al.  Science and Engineering Beyond Moore's Law , 2012, Proceedings of the IEEE.

[15]  Shimeng Yu,et al.  Metal–Oxide RRAM , 2012, Proceedings of the IEEE.

[16]  Damien Querlioz,et al.  Simulation of a memristor-based spiking neural network immune to device variations , 2011, The 2011 International Joint Conference on Neural Networks.

[17]  M. Pickett,et al.  Lognormal switching times for titanium dioxide bipolar memristors: origin and resolution , 2011, Nanotechnology.

[18]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[19]  W. Lu,et al.  Programmable Resistance Switching in Nanoscale Two-terminal Devices , 2008 .

[20]  J. Tenenbaum,et al.  Special issue on “Probabilistic models of cognition , 2022 .

[21]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[22]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.