Artificial Neural Network (ANN) to Spiking Neural Network (SNN) Converters Based on Diffusive Memristors

Biorealistic spiking neural networks (SNN) are believed to hold promise for further energy improvement over artificial neural networks (ANNs). However, it is difficult to implement SNNs in hardware, in particular the complicated algorithms that ANNs can handle with ease. Thus, it is natural to look for a middle path by combining the advantages of these two types of networks and consolidating them using an ANN–SNN converter. A proof‐of‐concept study of this idea is performed by experimentally demonstrating such a converter using diffusive memristor neurons coupled with a 32×1 1‐transistor 1‐memristor (1T1R) synapse array of drift memristors. It is experimentally verified that the weighted sum output of the memristor synapse array can be readily converted into the frequency of oscillation of an oscillatory neuron based on a SiOxNy:Ag diffusive memristor. Two converters are then connected capacitively to demonstrate the synchronization capability of this network. The compact oscillatory neuron comprises multiple transistors and has much better scalability than a complimentary metal oxide semiconductor (CMOS) integrate and fire neuron. It paves the way for emulating half center oscillators in central pattern generators of the central nervous system.

[1]  Zheng Ma,et al.  Self-limited single nanowire systems combining all-in-one memristive and neuromorphic functionalities , 2018, Nature Communications.

[2]  Rasit O. Topaloglu,et al.  Beyond-CMOS Technologies for Next Generation Computer Design , 2018 .

[3]  D. Ielmini,et al.  Enhancing the Matrix Addressing of Flexible Sensory Arrays by a Highly Nonlinear Threshold Switch , 2018, Advanced materials.

[4]  Qing Wu,et al.  Efficient and self-adaptive in-situ learning in multilayer memristor neural networks , 2018, Nature Communications.

[5]  Catherine E. Graves,et al.  Memristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine , 2018, Advanced materials.

[6]  Shinhyun Choi,et al.  SiGe epitaxial memory for neuromorphic computing with reproducible high performance based on engineered dislocations , 2018, Nature Materials.

[7]  Peng Lin,et al.  Fully memristive neural networks for pattern classification with unsupervised learning , 2018 .

[8]  Jiaming Zhang,et al.  Analogue signal and image processing with large memristor crossbars , 2017, Nature Electronics.

[9]  John Paul Strachan,et al.  Chaotic dynamics in nanoscale NbO2 Mott memristors for analogue computing , 2017, Nature.

[10]  Bernabé Linares-Barranco,et al.  An Event-Driven Classifier for Spiking Neural Networks Fed with Synthetic or Dynamic Vision Sensor Data , 2017, Front. Neurosci..

[11]  H.-S. Philip Wong,et al.  Face classification using electronic synapses , 2017, Nature Communications.

[12]  Kate J. Norris,et al.  Anatomy of Ag/Hafnia‐Based Selectors with 1010 Nonlinearity , 2017, Advanced materials.

[13]  Kaushik Roy,et al.  Proposal for a Leaky-Integrate-Fire Spiking Neuron Based on Magnetoelectric Switching of Ferromagnets , 2016, IEEE Transactions on Electron Devices.

[14]  J. Yang,et al.  Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing. , 2017, Nature materials.

[15]  Themis Prodromakis,et al.  Analog Memristive Synapse in Spiking Networks Implementing Unsupervised Learning , 2016, Front. Neurosci..

[16]  Ali Khiat,et al.  Unsupervised learning in probabilistic neural networks with multi-state metal-oxide memristive synapses , 2016, Nature Communications.

[17]  Tobi Delbrück,et al.  Training Deep Spiking Neural Networks Using Backpropagation , 2016, Front. Neurosci..

[18]  Manuel Le Gallo,et al.  Stochastic phase-change neurons. , 2016, Nature nanotechnology.

[19]  J. Yang,et al.  Sub-10 nm Ta Channel Responsible for Superior Performance of a HfO2 Memristor , 2016, Scientific Reports.

[20]  Andrew S. Cassidy,et al.  Convolutional networks for fast, energy-efficient neuromorphic computing , 2016, Proceedings of the National Academy of Sciences.

[21]  Yuchao Yang,et al.  Memristive Physically Evolving Networks Enabling the Emulation of Heterosynaptic Plasticity , 2015, Advanced materials.

[22]  Ronald Tetzlaff,et al.  Nonlinear Dynamics of a Locally-Active Memristor , 2015, IEEE Transactions on Circuits and Systems I: Regular Papers.

[23]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[24]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[25]  Tobi Delbrück,et al.  Retinomorphic Event-Based Vision Sensors: Bioinspired Cameras With Spiking Output , 2014, Proceedings of the IEEE.

[26]  Shih-Chii Liu,et al.  Minitaur, an Event-Driven FPGA-Based Spiking Network Accelerator , 2014, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[27]  Bernabé Linares-Barranco,et al.  Mapping from Frame-Driven to Frame-Free Event-Driven Vision Systems by Low-Rate Rate Coding and Coincidence Processing--Application to Feedforward ConvNets , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Tobi Delbruck,et al.  Real-time classification and sensor fusion with a spiking deep belief network , 2013, Front. Neurosci..

[29]  Fabien Alibart,et al.  Pattern classification by memristive crossbar circuits using ex situ and in situ training , 2013, Nature Communications.

[30]  E. Vianello,et al.  Bio-Inspired Stochastic Computing Using Binary CBRAM Synapses , 2013, IEEE Transactions on Electron Devices.

[31]  M. Pickett,et al.  A scalable neuristor built with Mott memristors. , 2013, Nature materials.

[32]  Bernabe Linares-Barranco,et al.  Comparison between Frame-Constrained Fix-Pixel-Value and Frame-Free Spiking-Dynamic-Pixel ConvNets for Visual Processing , 2012, Front. Neurosci..

[33]  Fabien Alibart,et al.  A Memristive Nanoparticle/Organic Hybrid Synapstor for Neuroinspired Computing , 2011, ArXiv.

[34]  T. Hasegawa,et al.  Short-term plasticity and long-term potentiation mimicked in single inorganic synapses. , 2011, Nature materials.

[35]  Xiao-Jing Wang Neurophysiological and computational principles of cortical rhythms in cognition. , 2010, Physiological reviews.

[36]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[37]  A. Reyes,et al.  Layer and frequency dependencies of phase response properties of pyramidal neurons in rat motor cortex , 2007, The European journal of neuroscience.

[38]  Eve Marder,et al.  Mechanisms for oscillation and frequency control in reciprocally inhibitory model neural networks , 1994, Journal of Computational Neuroscience.

[39]  E. Marder,et al.  Central pattern generators and the control of rhythmic movements , 2001, Current Biology.

[40]  Ikuya Takahashi,et al.  Thermochromic Properties of Double-Doped VO2 Thin Films Prepared by a Wet Coating Method Using Polyvanadate-Based Sols Containing W and Mo or W and Ti , 2001 .

[41]  S. Strogatz Exploring complex networks , 2001, Nature.

[42]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[43]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[44]  E. Marder,et al.  Principles of rhythmic motor pattern generation. , 1996, Physiological reviews.

[45]  R. Douglas,et al.  A silicon neuron , 1991, Nature.