Reconfigurable Smart In-Memory Computing Platform Supporting Logic and Binarized Neural Networks for Low-Power Edge Devices

Edge computing has been shown to be a promising solution that could relax the burden imposed onto the network infrastructure by the increasing amount of data produced by smart devices. However, reconfigurable ultra-low power computing architectures are needed. RRAM devices together with the material implication logic (IMPLY) are a promising solution for the development of low-power reconfigurable logic-in-memory (LiM) hardware. Nevertheless, traditional approaches suffer from several issues introduced by the circuit topology and device non-idealities. Recently, SIMPLY, a smart LiM architecture based on the IMPLY, has been proposed and shown to solve the common issues of traditional architectures. Here, we use a physics-based RRAM compact model calibrated on three RRAM technologies to further analyze the performance of SIMPLY in typical operating conditions, when the repeated execution of logic operation on the same group of devices is considered. The results show that, compared to the conventional IMPLY architecture, SIMPLY spares more than 40% of the high voltage pulses on average even when complex operations are considered (e.g., the 1-bit half adder). We also show how SIMPLY can implement the set of operations required for the implementation of Binarized Neural Networks (BNN) and benchmark its performance against other memristor-based BNN in-memory accelerator from the literature. The results suggest that our approach is more than two orders of magnitude efficient compared to the state of the art reconfigurable in-memory computing approach and could potentially reach the performance of specialized BNN analog hardware accelerators with appropriate device-circuit co-design strategies.

[1]  N. Singh,et al.  $\hbox{HfO}_{x}/\hbox{TiO}_{x}/\hbox{HfO}_{x}/ \hbox{TiO}_{x}$ Multilayer-Based Forming-Free RRAM Devices With Excellent Uniformity , 2011, IEEE Electron Device Letters.

[2]  Gregory S. Snider,et al.  ‘Memristive’ switches enable ‘stateful’ logic operations via material implication , 2010, Nature.

[3]  L. Larcher,et al.  Multiscale modeling of defect-related phenomena in high-k based logic and memory devices , 2017, 2017 IEEE 24th International Symposium on the Physical and Failure Analysis of Integrated Circuits (IPFA).

[4]  Joonwon Lee,et al.  CFLRU: a replacement algorithm for flash memory , 2006, CASES '06.

[5]  Paolo Pavan,et al.  SIMPLY: Design of a RRAM-Based Smart Logic-in-Memory Architecture using RRAM Compact Model , 2019, ESSDERC 2019 - 49th European Solid-State Device Research Conference (ESSDERC).

[6]  Tuo-Hung Hou,et al.  SLIM: Simultaneous Logic-in-Memory Computing Exploiting Bilayer Analog OxRAM Devices , 2018, Scientific Reports.

[7]  Huaqiang Wu,et al.  Ultrafast RESET Analysis of HfOx‐Based RRAM by Sub‐Nanosecond Pulses , 2017 .

[8]  Mika Laiho,et al.  Stateful implication logic with memristors , 2009, 2009 IEEE/ACM International Symposium on Nanoscale Architectures.

[9]  F. Puglisi,et al.  Smart Logic-in-Memory Architecture for Low-Power Non-Von Neumann Computing , 2020, IEEE Journal of the Electron Devices Society.

[10]  Alex Lu,et al.  Anomaly detection on the edge , 2017, MILCOM 2017 - 2017 IEEE Military Communications Conference (MILCOM).

[11]  J. Poikonen,et al.  Erratum for Two memristors suffice to compute all Boolean functions , 2010 .

[12]  Alena Bartonova,et al.  In search of an optimal in-field calibration method of low-cost gas sensors for ambient air pollutants: Comparison of linear, multilinear and artificial neural network approaches , 2019, Atmospheric Environment.

[13]  F. Puglisi,et al.  Reliability-Aware Design Strategies for Stateful Logic-in-Memory Architectures , 2020, IEEE Transactions on Device and Materials Reliability.

[14]  TN-40-07 : Calculating Memory Power for DDR 4 SDRAM , 2018 .

[15]  Paolo Pavan,et al.  Circuit Reliability Analysis of RRAM-based Logic-in-Memory Crossbar Architectures Including Line Parasitic Effects, Variability, and Random Telegraph Noise , 2020, 2020 IEEE International Reliability Physics Symposium (IRPS).

[16]  H. Hwang,et al.  Improved Synaptic Behavior Under Identical Pulses Using AlOx/HfO2 Bilayer RRAM Array for Neuromorphic Systems , 2016, IEEE Electron Device Letters.

[17]  Paul D. Franzon,et al.  FreePDK: An Open-Source Variation-Aware Design Kit , 2007, 2007 IEEE International Conference on Microelectronic Systems Education (MSE'07).

[18]  Vraj Kishan Dugar,et al.  A Survey on Hamming Codes for Error Detection , 2019, 2019 2nd International Conference on Intelligent Computing, Instrumentation and Control Technologies (ICICICT).

[19]  Paolo Pavan,et al.  Unimore Resistive Random Access Memory (RRAM) Verilog-A Model , 2019 .

[20]  Uri C. Weiser,et al.  Memristor-Based Material Implication (IMPLY) Logic: Design Principles and Methodologies , 2014, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[21]  Paolo Pavan,et al.  Smart Logic-in-Memory Architecture For Ultra-Low Power Large Fan-In Operations , 2020, 2020 2nd IEEE International Conference on Artificial Intelligence Circuits and Systems (AICAS).

[22]  Multilevel conductance switching of a HfO2 RRAM array induced by controlled filament for neuromorphic applications , 2016, 2016 IEEE Silicon Nanoelectronics Workshop (SNW).

[23]  Shimeng Yu,et al.  A neuromorphic visual system using RRAM synaptic devices with Sub-pJ energy and tolerance to variability: Experimental characterization and large-scale modeling , 2012, 2012 International Electron Devices Meeting.

[24]  Shimeng Yu,et al.  Characterization of switching parameters and multilevel capability in HfOx/AlOx bi-layer RRAM devices , 2011, Proceedings of 2011 International Symposium on VLSI Technology, Systems and Applications.

[25]  Luca Larcher,et al.  Random Telegraph Noise in Resistive Random Access Memories: Compact Modeling and Advanced Circuit Design , 2018, IEEE Transactions on Electron Devices.

[26]  Tenkasi V. Ramabadran,et al.  A tutorial on CRC computations , 1988, IEEE Micro.

[27]  Ran El-Yaniv,et al.  Binarized Neural Networks , 2016, ArXiv.

[28]  Paolo Pavan,et al.  Circuit Reliability of Low-Power RRAM-Based Logic-in-Memory Architectures , 2019, 2019 IEEE International Integrated Reliability Workshop (IIRW).

[29]  E. Lehtonen,et al.  Implication logic synthesis methods for memristors , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[30]  John W. Backus,et al.  Can programming be liberated from the von Neumann style?: a functional style and its algebra of programs , 1978, CACM.

[31]  Jacques-Olivier Klein,et al.  In-Memory and Error-Immune Differential RRAM Implementation of Binarized Deep Neural Networks , 2018, 2018 IEEE International Electron Devices Meeting (IEDM).

[32]  Mika Laiho,et al.  Two memristors suffice to compute all Boolean functions (Organic and inorganic circuits and devices) , 2010 .

[33]  Nishil Talati,et al.  Logic Design Within Memristive Memories Using Memristor-Aided loGIC (MAGIC) , 2016, IEEE Transactions on Nanotechnology.

[34]  M. Chowdhury,et al.  Performance Stability Analysis of SRAM Cells Based on Different FinFET Devices in 7nm Technology , 2018, 2018 IEEE SOI-3D-Subthreshold Microelectronics Technology Unified Conference (S3S).

[35]  Paolo Pavan,et al.  Energy-Efficient Logic-in-Memory I-bit Full Adder Enabled by a Physics-Based RRAM Compact Model , 2018, 2018 48th European Solid-State Device Research Conference (ESSDERC).

[36]  Rong Luo,et al.  Spiking neural network with RRAM: Can we use it for real-world application? , 2015, 2015 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[37]  Won Ho Choi,et al.  A Binarized Neural Network Accelerator with Differential Crosspoint Memristor Array for Energy-Efficient MAC Operations , 2019, 2019 IEEE International Symposium on Circuits and Systems (ISCAS).

[38]  Joonwon Lee,et al.  A comprehensive study of energy efficiency and performance of flash-based SSD , 2011, J. Syst. Archit..

[39]  Alex Pappachen James,et al.  Binary Weighted Memristive Analog Deep Neural Network for Near-Sensor Edge Processing , 2018, 2018 IEEE 18th International Conference on Nanotechnology (IEEE-NANO).

[40]  P. Narayanan,et al.  Recent progress in analog memory-based accelerators for deep learning , 2018, Journal of Physics D: Applied Physics.

[41]  Joseph S. Friedman,et al.  Overhead Requirements for Stateful Memristor Logic , 2019, IEEE Transactions on Circuits and Systems I: Regular Papers.

[42]  Wenqiang Zhang,et al.  Novel In-Memory Matrix-Matrix Multiplication with Resistive Cross-Point Arrays , 2018, 2018 IEEE Symposium on VLSI Technology.

[43]  Yi Li,et al.  Reprogrammable logic in memristive crossbar for in-memory computing , 2017 .

[44]  Bing Chen,et al.  Very Low-Programming-Current RRAM With Self-Rectifying Characteristics , 2016, IEEE Electron Device Letters.

[45]  Kyoungrok Cho,et al.  A Memristor-CMOS Braun Multiplier Array for Arithmetic Pipelining , 2019, 2019 26th IEEE International Conference on Electronics, Circuits and Systems (ICECS).