A Multilayer Neural Network Merging Image Preprocessing and Pattern Recognition by Integrating Diffusion and Drift Memristors.

With the development of research on novel memristor model and device, neural networks by integrating various memristor models have become a hot research topic recently. However, state-of-the-art works still build such neural networks using drift memristor only. Furthermore, some other related works are only applied to a few individual applications including pattern recognition and edge detection. In this paper, a novel kind of multilayer neural network is proposed, in which diffusion and drift memristor models are applied to construct a system merging image preprocessing and pattern recognition. Specifically, the entire network consists of two diffusion memristive cellular layers for image preprocessing and one drift memristive feedforward layer for pattern recognition. Experimental results show that good recognition accuracy of noisy MNIST is obtained due to the fusion of image preprocessing and pattern recognition. Moreover, owing to high-efficiency in-memory computing and brief spiking encoding methods, high processing speed, high throughput, and few hardware resources of the entire network are achieved.

[1]  A. Thomas,et al.  Memristor-based neural networks , 2013 .

[2]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[3]  Warren Robinett,et al.  Memristor-CMOS hybrid integrated circuits for reconfigurable logic. , 2009, Nano letters.

[4]  Alexantrou Serb,et al.  HfO2-based memristors for neuromorphic applications , 2016, 2016 IEEE International Symposium on Circuits and Systems (ISCAS).

[5]  Wei Lu,et al.  Short-term Memory to Long-term Memory Transition in a Nanoscale Memristor , 2022 .

[6]  Seung Hwan Lee,et al.  Temporal data classification and forecasting using a memristor-based reservoir computing system , 2019, Nature Electronics.

[7]  L. Chua Memristor-The missing circuit element , 1971 .

[8]  Mirko Hansen,et al.  Double-Barrier Memristive Devices for Unsupervised Learning and Pattern Recognition , 2017, Front. Neurosci..

[9]  Uri C. Weiser,et al.  MAGIC—Memristor-Aided Logic , 2014, IEEE Transactions on Circuits and Systems II: Express Briefs.

[10]  Wei D. Lu,et al.  Ionic modulation and ionic coupling effects in MoS2 devices for neuromorphic computing , 2018, Nature Materials.

[11]  Catherine D. Schuman,et al.  A Survey of Neuromorphic Computing and Neural Networks in Hardware , 2017, ArXiv.

[12]  T. A. Anusudha,et al.  A versatile window function for linear ion drift memristor model – A new approach , 2018, AEU - International Journal of Electronics and Communications.

[13]  Sangheon Oh,et al.  Neuroinspired unsupervised learning and pruning with subquantum CBRAM arrays , 2018, Nature Communications.

[14]  Qing Wu,et al.  Efficient and self-adaptive in-situ learning in multilayer memristor neural networks , 2018, Nature Communications.

[15]  Zhengya Zhang,et al.  A fully integrated reprogrammable memristor–CMOS system for efficient multiply–accumulate operations , 2019, Nature Electronics.

[16]  Peng Lin,et al.  Fully memristive neural networks for pattern classification with unsupervised learning , 2018 .

[17]  Shukai Duan,et al.  Memristor-Based Cellular Nonlinear/Neural Network: Design, Analysis, and Applications , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Kaushik Roy,et al.  Design and Synthesis of Ultralow Energy Spin-Memristor Threshold Logic , 2014, IEEE Transactions on Nanotechnology.

[19]  Qing Wu,et al.  Long short-term memory networks in memristor crossbar arrays , 2018, Nature Machine Intelligence.

[20]  Sumio Hosaka,et al.  Handwritten-Digit Recognition by Hybrid Convolutional Neural Network based on HfO2 Memristive Spiking-Neuron , 2018, Scientific Reports.

[21]  Jin He,et al.  A Hardware Friendly Unsupervised Memristive Neural Network with Weight Sharing Mechanism , 2019, Neurocomputing.

[22]  Liam McDaid,et al.  Hardware spiking neural network prototyping and application , 2011, Genetic Programming and Evolvable Machines.

[23]  Peng Lin,et al.  Reinforcement learning with analogue memristor arrays , 2019, Nature Electronics.

[24]  Siddharth Gaba,et al.  Synaptic behaviors and modeling of a metal oxide memristive device , 2011 .

[25]  Ruihan Hu,et al.  Margin-Based Pareto Ensemble Pruning: An Ensemble Pruning Algorithm That Learns to Search Optimized Ensembles , 2019, Comput. Intell. Neurosci..

[26]  Kaushik Roy,et al.  RESPARC: A reconfigurable and energy-efficient architecture with Memristive Crossbars for deep Spiking Neural Networks , 2017, 2017 54th ACM/EDAC/IEEE Design Automation Conference (DAC).

[27]  Huaqiang Wu,et al.  An artificial nociceptor based on a diffusive memristor , 2018, Nature Communications.

[28]  Bernabé Linares-Barranco,et al.  Memristance can explain Spike-Time-Dependent-Plasticity in Neural Synapses , 2009 .

[29]  J. Yang,et al.  Memristors with diffusive dynamics as synaptic emulators for neuromorphic computing. , 2017, Nature materials.

[30]  Kang L. Wang,et al.  Resistive switching materials for information processing , 2020, Nature Reviews Materials.

[31]  Massimiliano Di Ventra,et al.  Experimental demonstration of associative memory with memristive neural networks , 2009, Neural Networks.

[32]  Shahar Kvatinsky,et al.  Memristive memory processing unit (MPU) controller for in-memory processing , 2016, 2016 IEEE International Conference on the Science of Electrical Engineering (ICSEE).

[33]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[34]  Qing Wu,et al.  In situ training of feed-forward and recurrent convolutional memristor networks , 2019, Nature Machine Intelligence.

[35]  Mostafa Rahimi Azghadi,et al.  Stochastic Computing for Low-Power and High-Speed Deep Learning on FPGA , 2019, 2019 IEEE International Symposium on Circuits and Systems (ISCAS).

[36]  Hao Wang,et al.  Influence of Compact Memristors’ Stability on Machine Learning , 2019, IEEE Access.

[37]  Engin Ipek,et al.  Memristive Boltzmann machine: A hardware accelerator for combinatorial optimization and deep learning , 2017, 2017 Fifth Berkeley Symposium on Energy Efficient Electronic Systems & Steep Transistors Workshop (E3S).

[38]  Wayne Luk,et al.  NeuroFlow: A General Purpose Spiking Neural Network Simulation Platform using Customizable Processors , 2016, Front. Neurosci..

[39]  Sheng Chang,et al.  Fully Memristive Spiking-Neuron Learning Framework and its Applications on Pattern Recognition and Edge Detection , 2019, Neurocomputing.

[40]  Qiangfei Xia,et al.  An artificial spiking afferent nerve based on Mott memristors for neurorobotics , 2020, Nature Communications.

[41]  Michael Naehrig,et al.  CryptoNets: applying neural networks to encrypted data with high throughput and accuracy , 2016, ICML 2016.