On-chip supervised learning rule for ultra high density neural crossbar using memristor for synapse and neuron

The memristor-based neural learning network is considered as one of the candidates for future computing systems thanks to its low power, high density and defect-tolerance. However, its application is still hindered by the limitations of huge neuron structure and complicated learning cell. In this paper, we present a memristor-based neural crossbar circuit to implement on-chip supervised learning rule. In our work, activation function of neuron is implemented with simple CMOS inverter to save area overhead. Importantly, we propose a compact learning cell with a crossbar latch consisting of two antiparallel oriented binary memristors. This scheme allows high density integration and could improve the reliability of learning circuit. We describe firstly the circuit architecture, memristor model and operation process of supervised learning rule. Afterwards we perform transient simulation with CMOS 40nm design kit to validate the function of proposed learning circuit. Analysis and evaluation demonstrate that our circuit show great potential in on-chip learning.

[1]  Gert Cauwenberghs,et al.  An analog VLSI recurrent neural network learning a continuous-time trajectory , 1996, IEEE Trans. Neural Networks.

[2]  Jacques-Olivier Klein,et al.  Robust neural logic block (NLB) based on memristor crossbar array , 2011, 2011 IEEE/ACM International Symposium on Nanoscale Architectures.

[3]  Gregory S. Snider,et al.  ‘Memristive’ switches enable ‘stateful’ logic operations via material implication , 2010, Nature.

[4]  A. Hall,et al.  Adaptive Switching Circuits , 2016 .

[5]  Gert Cauwenberghs,et al.  Probabilistic synaptic weighting in a reconfigurable network of VLSI integrate-and-fire neurons , 2001, Neural Networks.

[6]  Jacques-Olivier Klein,et al.  Design and Modeling of a Neuro-Inspired Learning Circuit Using Nanotube-Based Memory Devices , 2011, IEEE Transactions on Circuits and Systems I: Regular Papers.

[7]  K. P. Lakshmi,et al.  A Survey on FPGA based MLP Realization for On-chip Learning , 2013 .

[8]  L.O. Chua,et al.  Memristive devices and systems , 1976, Proceedings of the IEEE.

[9]  Byoungil Lee,et al.  Nanoelectronic programmable synapses based on phase change materials for brain-inspired computing. , 2012, Nano letters.

[10]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[11]  Zhaohao Wang,et al.  Compact modelling of ferroelectric tunnel memristor and its use for neuromorphic simulation , 2014 .

[12]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[13]  J. Grollier,et al.  A ferroelectric memristor. , 2012, Nature materials.

[14]  Weisheng Zhao,et al.  Neuromorphic function learning with carbon nanotube based synapses , 2013, Nanotechnology.

[15]  M. Pickett,et al.  A scalable neuristor built with Mott memristors. , 2013, Nature materials.

[16]  C. Gamrat,et al.  Nanotube devices based crossbar architecture: toward neuromorphic computing , 2010, Nanotechnology.

[17]  Giacomo Indiveri,et al.  A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity , 2006, IEEE Transactions on Neural Networks.

[18]  S. Ambrogio,et al.  Spike-timing dependent plasticity in a transistor-selected resistive switching memory , 2013, Nanotechnology.

[19]  H. Hwang,et al.  Analog memory and spike-timing-dependent plasticity characteristics of a nanoscale titanium oxide bilayer resistive switching device , 2011, Nanotechnology.

[20]  D. Strukov,et al.  CMOL FPGA: a reconfigurable architecture for hybrid digital circuits with two-terminal nanodevices , 2005 .

[21]  Fabien Alibart,et al.  Pavlov's Dog Associative Learning Demonstrated on Synaptic-Like Organic Transistors , 2013, Neural Computation.

[22]  D. Stewart,et al.  The crossbar latch: Logic value storage, restoration, and inversion in crossbar circuits , 2005 .

[23]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[24]  L. Chua Memristor-The missing circuit element , 1971 .

[25]  Jacques-Olivier Klein,et al.  Robust learning approach for neuro-inspired nanoscale crossbar architecture , 2014, ACM J. Emerg. Technol. Comput. Syst..