Lifetime Enhancement for RRAM-based Computing-In-Memory Engine Considering Aging and Thermal Effects

RRAM-based computing-in-memory engines provide a promising platform to accelerate deep neural networks. The programming process imposes high voltages onto the RRAM cells and thus degrades their valid conductance ranges from the fresh state, an effect called aging. Consequently, the expected conductances of RRAM cells corresponding to the weights after training may fall outside of the valid ranges, potentially leading to a significant accuracy degradation. In addition, an uneven temperature distribution due to different conductances accelerates the aging effect further. Moreover, the uneven temperatures can cause accuracy discrepancy between the tuning process and inference, thus reducing the lifetime of such accelerators even further. In this paper, we propose to counter aging and thermal effects by distributing aging stress and high-temperature RRAM cells evenly, during both software training and hardware mapping, to extend the lifetime of computing-in-memory engines. Experimental results demonstrate lifetime enhancement up to 453 times while maintaining the classification accuracy.

[1]  N. Singh,et al.  Physical mechanisms of endurance degradation in TMO-RRAM , 2011, 2011 International Electron Devices Meeting.

[2]  Khaled N. Salama,et al.  Memristor-based memory: The sneak paths problem and solutions , 2013, Microelectron. J..

[3]  Y. Wu,et al.  Variation-aware, reliability-emphasized design and optimization of RRAM using SPICE model , 2015, 2015 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[4]  R. Degraeve,et al.  Quantitative endurance failure model for filamentary RRAM , 2015, 2015 Symposium on VLSI Technology (VLSI Technology).

[5]  Engin Ipek,et al.  Resistive computation: avoiding the power wall with low-leakage, STT-MRAM based computing , 2010, ISCA.

[6]  Yiran Chen,et al.  Low-power dual-element memristor based memory design , 2010, 2010 ACM/IEEE International Symposium on Low-Power Electronics and Design (ISLPED).

[7]  Yiran Chen,et al.  ReGAN: A pipelined ReRAM-based accelerator for generative adversarial networks , 2018, 2018 23rd Asia and South Pacific Design Automation Conference (ASP-DAC).

[8]  D. Wolansky,et al.  Impact of Temperature on the Resistive Switching Behavior of Embedded $\hbox{HfO}_{2}$-Based RRAM Devices , 2011, IEEE Transactions on Electron Devices.

[9]  Emmanuelle J. Merced-Grafals,et al.  Repeatable, accurate, and high speed multi-level programming of memristor 1T1R arrays for power efficient analog computing applications , 2016, Nanotechnology.

[10]  Ulf Schlichtmann,et al.  Aging-aware Lifetime Enhancement for Memristor-based Neuromorphic Computing , 2019, 2019 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[11]  Catherine Graves,et al.  Dot-product engine for neuromorphic computing: Programming 1T1M crossbar to accelerate matrix-vector multiplication , 2016, 2016 53nd ACM/EDAC/IEEE Design Automation Conference (DAC).

[12]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  L. Goux,et al.  Balancing SET/RESET Pulse for $>\hbox{10}^{10}$ Endurance in $\hbox{HfO}_{2}\hbox{/Hf}$ 1T1R Bipolar RRAM , 2012, IEEE Transactions on Electron Devices.

[15]  Huazhong Yang,et al.  Long Live TIME: Improving Lifetime for Training-In-Memory Engines by Structured Gradient Sparsification , 2018, 2018 55th ACM/ESDA/IEEE Design Automation Conference (DAC).

[16]  Alessandro Calderoni,et al.  Voltage-Controlled Cycling Endurance of HfOx-Based Resistive-Switching Memory , 2015, IEEE Transactions on Electron Devices.

[17]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[18]  Gokhan Memik,et al.  Thermal-aware Optimizations of ReRAM-based Neuromorphic Computing Systems , 2018, 2018 55th ACM/ESDA/IEEE Design Automation Conference (DAC).

[19]  Marek Skowronski,et al.  Formation of the Conducting Filament in TaO x-Resistive Switching Devices by Thermal-Gradient-Induced Cation Accumulation. , 2018, ACS applied materials & interfaces.

[20]  Harris Drucker,et al.  Comparison of learning algorithms for handwritten digit recognition , 1995 .