Effect of Device Variation on Mapping Binary Neural Network to Memristor Crossbar Array

In memristor crossbar array (MCA)-based neural network hardware, it is generally assumed that entire word-lines (WLs) are simultaneously enabled for parallel matrix-vector multiplication (MxV) operation. However, the error probability of MxV in a memristor crossbar array (MCA) increases as the resistance ratio (R-ratio) of a memristor decreases and the resistance variation and the number of simultaneously activated WLs increase. In this paper, we analyze the effect of R-ratio and variation of memristor devices on read sense margin and inference accuracy of MCA-based Binary Neural Network (BNN) hardware. We first show that only a limited number of WLs should be enabled to ensure correct MxV output when the R-ratio is small. On the other hand, we also show that, if the resistance variation becomes higher than a certain level, simultaneous activation of large number of WLs produces the higher accuracy even when R-ratio is small. Based on the analysis, we propose the Accuracy Estimation (AE) factor to find the optimal number of word lines that are simultaneously activated.

[1]  Igor Carron,et al.  XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks , 2016 .

[2]  Shimeng Yu,et al.  Emerging Memory Technologies: Recent Trends and Prospects , 2016, IEEE Solid-State Circuits Magazine.

[3]  An Chen,et al.  A review of emerging non-volatile memory (NVM) technologies and applications , 2016 .

[4]  Weisheng Zhao,et al.  Compact Modeling of Perpendicular-Anisotropy CoFeB/MgO Magnetic Tunnel Junctions , 2012, IEEE Transactions on Electron Devices.

[5]  Cheng-Xin Xue,et al.  Nonvolatile Circuits-Devices Interaction for Memory, Logic and Artificial Intelligence , 2018, 2018 IEEE Symposium on VLSI Technology.

[6]  Shaahin Angizi,et al.  Exploring a SOT-MRAM Based In-Memory Computing for Data Processing , 2018, IEEE Transactions on Multi-Scale Computing Systems.

[7]  Ronald F. DeMara,et al.  Survey of STT-MRAM Cell Design Strategies , 2017, ACM J. Emerg. Technol. Comput. Syst..

[8]  Yiran Chen,et al.  Voltage Driven Nondestructive Self-Reference Sensing Scheme of Spin-Transfer Torque Memory , 2012, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[9]  Ran El-Yaniv,et al.  Binarized Neural Networks , 2016, NIPS.