Alleviating Conductance Nonlinearity via Pulse Shape Designs in TaOx Memristive Synapses

Analog resistive switching behavior in emerging nonvolatile memories has facilitated a wide range of potential applications in neuromorphic computing and cognitive tasks. However, the intrinsic nonlinearity (NL) of conductance update has been proven to be highly unfavorable for the implementation of analog synapse-based hardware neural network (HNN). In this brief, we show that the conductance update characteristics of our Pt/TaOx/Ta memristor will be significantly improved by carefully designing the potentiation and depression pulse shapes. Furthermore, measured conductance update characteristics with different degrees ofNL are applied in the simulation of a face classification task. The results show that both the recognition accuracy and the learning speed of this supervised learning scenario are substantially improved by the proposed optimization approach.

[1]  N. Xu,et al.  Oxide-based RRAM switching mechanism: A new ion-transport-recombination model , 2008, 2008 IEEE International Electron Devices Meeting.

[2]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[3]  Warren Robinett,et al.  Memristor-CMOS hybrid integrated circuits for reconfigurable logic. , 2009, Nano letters.

[4]  Y. Liu,et al.  Highly uniform resistive switching characteristics of TiN/ZrO2/Pt memory devices , 2009 .

[5]  Shimeng Yu,et al.  An Electronic Synapse Device Based on Metal Oxide Resistive Switching Memory for Neuromorphic Computation , 2011, IEEE Transactions on Electron Devices.

[6]  D. Querlioz,et al.  Visual Pattern Extraction Using Energy-Efficient “2-PCM Synapse” Neuromorphic Architecture , 2012, IEEE Transactions on Electron Devices.

[7]  T. Morie,et al.  Three-terminal ferroelectric synapse device with concurrent learning function for artificial neural networks , 2012 .

[8]  Shimeng Yu,et al.  A Low Energy Oxide‐Based Electronic Synaptic Device for Neuromorphic Visual Systems with Tolerance to Device Variation , 2013, Advanced materials.

[9]  J Joshua Yang,et al.  Memristive devices for computing. , 2013, Nature nanotechnology.

[10]  Fabien Alibart,et al.  Pattern classification by memristive crossbar circuits using ex situ and in situ training , 2013, Nature Communications.

[11]  E. Vianello,et al.  Bio-Inspired Stochastic Computing Using Binary CBRAM Synapses , 2013, IEEE Transactions on Electron Devices.

[12]  Xiaogang Wang,et al.  Deep Learning Face Representation from Predicting 10,000 Classes , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  G. W. Burr,et al.  Experimental demonstration and tolerancing of a large-scale neural network (165,000 synapses), using phase-change memory as the synaptic weight element , 2015, 2014 IEEE International Electron Devices Meeting.

[14]  Shimeng Yu,et al.  Mitigating effects of non-ideal synaptic device characteristics for on-chip learning , 2015, 2015 IEEE/ACM International Conference on Computer-Aided Design (ICCAD).

[15]  Shimeng Yu,et al.  Scaling-up resistive synaptic arrays for neuro-inspired architecture: Challenges and prospect , 2015, 2015 IEEE International Electron Devices Meeting (IEDM).

[16]  Ligang Gao,et al.  Programming Protocol Optimization for Analog Weight Tuning in Resistive Memories , 2015, IEEE Electron Device Letters.

[17]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[18]  Jongin Kim,et al.  Electronic system with memristive synapses for pattern recognition , 2015, Scientific Reports.

[19]  H. Hwang,et al.  Improved Synaptic Behavior Under Identical Pulses Using AlOx/HfO2 Bilayer RRAM Array for Neuromorphic Systems , 2016, IEEE Electron Device Letters.

[20]  Bin Gao,et al.  Oxide-based analog synapse: Physical modeling, experimental characterization, and optimization , 2016, 2016 IEEE International Electron Devices Meeting (IEDM).

[21]  H.-S. Philip Wong,et al.  Face classification using electronic synapses , 2017, Nature Communications.

[22]  Sungho Kim,et al.  Impact of Synaptic Device Variations on Pattern Recognition Accuracy in a Hardware Neural Network , 2018, Scientific Reports.

[23]  Peng Lin,et al.  Fully memristive neural networks for pattern classification with unsupervised learning , 2018 .

[24]  J. Bokor,et al.  3D multilevel spin transfer torque devices , 2018 .

[25]  Jiaming Zhang,et al.  Analogue signal and image processing with large memristor crossbars , 2017, Nature Electronics.

[26]  Chih-Cheng Chang,et al.  Mitigating Asymmetric Nonlinear Weight Update Effects in Hardware Neural Network Based on Analog Resistive Synapse , 2018, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.