Ex-situ training of dense memristor crossbar for neuromorphic applications

This study proposes a technique for programming a dense memristor crossbar array without isolation transistors (0T1M) in order to achieve ex-situ training of a neural network. Programming memristors to a specific resistance level requires an iterative process needing the reading of individual memristor resistances due to memristor device stochasticity. This paper presents a circuit to read individual resistances from a 0T1M crossbar and a method to map neuron synaptic weights into a novel neural circuit to enable ex-situ training. The results show that we are able to train the resistances in a 0T1M crossbar and that the 0T1M system is about 93% smaller in area than 1T1M systems.

[1]  Shimeng Yu,et al.  Investigating the switching dynamics and multilevel capability of bipolar metal oxide resistive switching memory , 2011 .

[2]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[3]  M. R. McLean.  Concurrent Learning Algorithm and the Importance Map , 2014, Network Science and Cybersecurity.

[4]  L. Chua.  Memristor-The missing circuit element , 1971 .

[5]  Leon O. Chua,et al.  Memristor circuit for artificial synaptic weighting of pulse inputs , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[6]  Ligang Gao,et al.  High precision tuning of state for memristive devices by adaptable variation-tolerant algorithm , 2011, Nanotechnology.

[7]  Jacques-Olivier Klein,et al.  Robust neural logic block (NLB) based on memristor crossbar array , 2011, 2011 IEEE/ACM International Symposium on Nanoscale Architectures.

[8]  Fabien Alibart,et al.  Pattern classification by memristive crossbar circuits using ex situ and in situ training , 2013, Nature Communications.

[9]  Luca Maria Gambardella,et al.  Deep, Big, Simple Neural Nets for Handwritten Digit Recognition , 2010, Neural Computation.

[10]  Bernabé Linares-Barranco,et al.  On Spike-Timing-Dependent-Plasticity, Memristive Devices, and Building a Self-Learning Visual Cortex , 2011, Front. Neurosci..

[11]  Cong Xu,et al.  NVSim: A Circuit-Level Performance, Energy, and Area Model for Emerging Nonvolatile Memory , 2012, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[12]  W. Lu,et al.  High-density Crossbar Arrays Based on a Si Memristive System , 2008 .

[13]  Xiaogang Wang,et al.  Deep Convolutional Network Cascade for Facial Point Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Luca Maria Gambardella,et al.  Deep Big Simple Neural Nets Excel on Handwritten Digit Recognition , 2010, ArXiv.

[15]  Wei Lu,et al.  Two-terminal resistive switches (memristors) for memory and logic applications , 2011, 16th Asia and South Pacific Design Automation Conference (ASP-DAC 2011).

[16]  Yu Wang,et al.  Training itself: Mixed-signal training acceleration for memristor-based neural network , 2014, 2014 19th Asia and South Pacific Design Automation Conference (ASP-DAC).

[17]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[18]  Leon O. Chua,et al.  Memristor Bridge Synapse-Based Neural Network and Its Learning , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Chris Yakopcic,et al.  Memristor-based neuron circuit and method for applying learning algorithm in SPICE? , 2014 .

[20]  Avinoam Kolodny,et al.  Memristor-Based Multilayer Neural Networks With Online Gradient Descent Training , 2015, IEEE Transactions on Neural Networks and Learning Systems.