Low power convolutional architectures: Three operator switching systems based on forgetting memristor bridge

Abstract With the development of technology and society, artificial intelligence has entered the era of deep learning neural networks. Convolution operation and image processing are fundamental technologies for deep neural networks and artificial intelligence, so reducing the energy consumption of convolution operation and increasing the speed of image processing will promote the development of a sustainable intelligent society. Traditional image processing technologies are based on the Von Neumann architecture, which is slow and not convenient for the hardware implementation of neural networks. Therefore, this paper breaks through the Von Neumann architecture, and uses the forgetting memristor bridge to realize the parallel image processing on the neumorphic chips. We use the forgetting characteristics of the memristor bridge to switch operators, and design single-operator switching, double-operator switching and K-operator switching three system architectures. The image operator switching systems designed in this paper not only have the similar processing effect of the traditional way, but also have the advantages of easy control, fast running speed (the processing speed is reduced from ms to μs), and low power consumption (the power consumption is reduced by nearly half), which will bring immeasurable benefits to the sustainable intelligent society.

[1]  Wei Lu,et al.  Short-term Memory to Long-term Memory Transition in a Nanoscale Memristor , 2022 .

[2]  H. B. Kekre,et al.  Image Segmentation using Extended Edge Operator for Mammographic Images , 2010 .

[3]  Yiran Chen,et al.  The bipolar and unipolar reversible behavior on the forgetting memristor model , 2016, Neurocomputing.

[4]  陈林,et al.  A novel circuit design for complementary resistive switch-based stateful logic operations , 2016 .

[5]  Shiping Wen,et al.  Periodic Event-Triggered Synchronization of Multiple Memristive Neural Networks With Switching Topologies and Parameter Mismatch , 2020, IEEE Transactions on Cybernetics.

[6]  Bocheng Bao,et al.  Hidden Bursting Firings and Bifurcation Mechanisms in Memristive Neuron Model With Threshold Electromagnetic Induction , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Bin Gao,et al.  Fully hardware-implemented memristor convolutional neural network , 2020, Nature.

[8]  Yiran Chen,et al.  Challenges of memristor based neuromorphic computing system , 2017, Science China Information Sciences.

[9]  Shiping Wen,et al.  Event-based sliding-mode synchronization of delayed memristive neural networks via continuous/periodic sampling algorithm , 2020, Appl. Math. Comput..

[10]  Shiqin Wang,et al.  Exponential Synchronization of Switched Neural Networks With Mixed Time-Varying Delays via Static/Dynamic Event-Triggering Rules , 2020, IEEE Access.

[11]  Xiaofeng Liao,et al.  Reinforcement Learning for Constrained Energy Trading Games With Incomplete Information , 2017, IEEE Transactions on Cybernetics.

[12]  L. Chua Memristor-The missing circuit element , 1971 .

[13]  Shiping Wen,et al.  Global exponential synchronization of delayed memristive neural networks with reaction-diffusion terms , 2019, Neural Networks.

[14]  Tingwen Huang,et al.  Reinforcement Learning in Energy Trading Game Among Smart Microgrids , 2016, IEEE Transactions on Industrial Electronics.

[15]  L. Scheick,et al.  Analysis of radiation effects on individual DRAM cells , 2000 .

[16]  Young Sun,et al.  Mimicking Synaptic Plasticity and Neural Network Using Memtranstors , 2018, Advanced materials.

[17]  Xiaofeng Liao,et al.  Synchronization and chaos in coupled memristor-based FitzHugh-Nagumo circuits with memristor synapse , 2017 .

[18]  Syed Adeel Ali Shah,et al.  Energy cost minimization for sustainable cloud computing using option pricing , 2020 .

[19]  Massimiliano Di Ventra,et al.  Experimental demonstration of associative memory with memristive neural networks , 2009, Neural Networks.

[20]  Yunus Babacan,et al.  Memristive retinomorphic grid architecture removing noise and preserving edge , 2018 .

[21]  Dalibor Biolek,et al.  SPICE Model of Memristor with Nonlinear Dopant Drift , 2009 .

[22]  Shiping Wen,et al.  CKFO: Convolution Kernel First Operated Algorithm With Applications in Memristor-Based Convolutional Neural Network , 2021, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[23]  Steve B. Furber,et al.  The SpiNNaker Project , 2014, Proceedings of the IEEE.

[24]  Saurabh Singh,et al.  Convergence of blockchain and artificial intelligence in IoT network for the sustainable smart city , 2020, Sustainable Cities and Society.

[25]  Bocheng Bao,et al.  Non-ideal memristor synapse-coupled bi-neuron Hopfield neural network: Numerical simulations and breadboard experiments , 2019, AEU - International Journal of Electronics and Communications.

[26]  Narayan Srinivasa,et al.  A functional hybrid memristor crossbar-array/CMOS system for data storage and neuromorphic applications. , 2012, Nano letters.

[27]  Luping Shi,et al.  Truly Concomitant and Independently Expressed Short‐ and Long‐Term Plasticity in a Bi2O2Se‐Based Three‐Terminal Memristor , 2018, Advanced materials.

[28]  Yifei Pei,et al.  An electronic synapse memristor device with conductance linearity using quantized conduction for neuroinspired computing , 2019, Journal of Materials Chemistry C.

[29]  Leon O. Chua,et al.  Neural Synaptic Weighting With a Pulse-Based Memristor Circuit , 2012, IEEE Transactions on Circuits and Systems I: Regular Papers.

[30]  Siddharth Gaba,et al.  Synaptic behaviors and modeling of a metal oxide memristive device , 2011 .

[31]  Jui-Ming Chang,et al.  A Gaussian synapse circuit for analog VLSI neural networks , 1994, IEEE Trans. Very Large Scale Integr. Syst..

[32]  Wenping Xue,et al.  An adaptive ensemble predictive strategy for multiple scale electrical energy usages forecasting , 2021 .

[33]  Leon O. Chua,et al.  Memristor Bridge Synapse-Based Neural Network and Its Learning , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[34]  Andreas Zell,et al.  Evolving Task Specific Image Operator , 1999, EvoWorkshops.

[35]  Uri C. Weiser,et al.  TEAM: ThrEshold Adaptive Memristor Model , 2013, IEEE Transactions on Circuits and Systems I: Regular Papers.

[36]  Liu Peng,et al.  Memristor-based neural network circuit of pavlov associative memory with dual mode switching , 2021 .

[37]  Yang Liu,et al.  Review of Nanostructured Resistive Switching Memristor and Its Applications , 2014 .

[38]  Benjamin C. M. Fung,et al.  Advances and challenges in building engineering and data mining applications for energy-efficient communities , 2016 .

[39]  Leon O. Chua,et al.  Memristor oscillators , 2008, Int. J. Bifurc. Chaos.

[40]  Liang Zhao,et al.  Novel circuit designs of memristor synapse and neuron , 2019, Neurocomputing.

[41]  Tadashi Shibata,et al.  A neuron-MOS neural network using self-learning-compatible synapse circuits , 1995, IEEE J. Solid State Circuits.

[42]  Bocheng Bao,et al.  Quasi-period, periodic bursting and bifurcations in memristor-based FitzHugh-Nagumo circuit , 2019, AEU - International Journal of Electronics and Communications.

[43]  Yiran Chen,et al.  Compact modeling and corner analysis of spintronic memristor , 2009, 2009 IEEE/ACM International Symposium on Nanoscale Architectures.

[44]  Bernard Brezzo,et al.  TrueNorth: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip , 2015, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[45]  R. Stanley Williams,et al.  How We Found The Missing Memristor , 2008, IEEE spectrum.

[46]  Shiping Wen,et al.  A synapse memristor model with forgetting effect , 2013 .

[47]  Shukai Duan,et al.  Composite Characteristics of Memristor Series and Parallel Circuits , 2015, Int. J. Bifurc. Chaos.

[48]  Peng Lin,et al.  Fully memristive neural networks for pattern classification with unsupervised learning , 2018 .

[49]  D. Strukov,et al.  Phenomenological modeling of memristive devices , 2014, 1406.4219.

[50]  J Joshua Yang,et al.  Memristive devices for computing. , 2013, Nature nanotechnology.