A CMOS spiking neuron for dense memristor-synapse connectivity for brain-inspired computing

Neuromorphic systems that densely integrate CMOS spiking neurons and nano-scale memristor synapses open a new avenue of brain-inspired computing. Existing silicon neurons have molded neural biophysical dynamics but are incompatible with memristor synapses, or used extra training circuitry thus eliminating much of the density advantages gained by using memristors, or were energy-inefficient. Here we describe a novel CMOS spiking leaky integrate-and-fire neuron circuit. Building on a reconfigurable architecture with a single opamp, the described neuron accommodates a large number of memristor synapses, and enables online spike timing dependent plasticity (STDP) learning with optimized power consumption. Simulation results of an 180nm CMOS design showed 97% power efficiency metric when realizing STDP learning in 10,000 memristor synapses with a nominal 1MΩ memristance, and only 13μA current consumption when integrating input spikes. Therefore, the described CMOS neuron contributes a generalized building block for large-scale brain-inspired neuromorphic systems.

[1]  W. Lu,et al.  CMOS compatible nanoscale nonvolatile resistance switching memory. , 2008, Nano letters.

[2]  André van Schaik,et al.  A generalised conductance-based silicon neuron for large-scale spiking neural networks , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[3]  Fabien Alibart,et al.  Pattern classification by memristive crossbar circuits using ex situ and in situ training , 2013, Nature Communications.

[4]  Chris Yakopcic,et al.  Generalized Memristive Device SPICE Model and its Application in Circuit Design , 2013, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[5]  Bernabé Linares-Barranco,et al.  On Spike-Timing-Dependent-Plasticity, Memristive Devices, and Building a Self-Learning Visual Cortex , 2011, Front. Neurosci..

[6]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[7]  Wei D. Lu,et al.  Pattern recognition with memristor networks , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[8]  Narayan Srinivasa,et al.  A scalable neural chip with synaptic electronics using CMOS integrated memristors , 2013, Nanotechnology.

[9]  T. Serrano-Gotarredona,et al.  Design of adaptive nano/CMOS neural architectures , 2012, 2012 19th IEEE International Conference on Electronics, Circuits, and Systems (ICECS 2012).

[10]  T. Serrano-Gotarredona,et al.  A Proposal for Hybrid Memristor-CMOS Spiking Neuromorphic Learning Systems , 2013, IEEE Circuits and Systems Magazine.

[11]  Shimeng Yu,et al.  Orientation classification by a winner-take-all network with oxide RRAM based synaptic devices , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[12]  Yong Zhang,et al.  A digital neuromorphic VLSI architecture with memristor crossbar synaptic array for machine learning , 2012, 2012 IEEE International SOC Conference.

[13]  D. Querlioz,et al.  Visual Pattern Extraction Using Energy-Efficient “2-PCM Synapse” Neuromorphic Architecture , 2012, IEEE Transactions on Electron Devices.

[14]  Melika Payvand,et al.  A CMOS-memristive self-learning neural network for pattern classification applications , 2014, 2014 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH).

[15]  Chung Lam,et al.  Brain-like associative learning using a nanoscale non-volatile phase change synaptic device array , 2014, Front. Neurosci..

[16]  J. Yang,et al.  Memristive switching mechanism for metal/oxide/metal nanodevices. , 2008, Nature nanotechnology.

[17]  Antoine Joubert,et al.  A robust and compact 65 nm LIF analog neuron for computational purposes , 2011, 2011 IEEE 9th International New Circuits and systems conference.

[18]  David Moore,et al.  Silver chalcogenide based memristor devices , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[19]  Giacomo Indiveri,et al.  Integration of nanoscale memristor synapses in neuromorphic computing architectures , 2013, Nanotechnology.

[20]  Jacques-Olivier Klein,et al.  Bioinspired networks with nanoscale memristive devices that combine the unsupervised and supervised learning approaches , 2012, 2012 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH).

[21]  Johannes Schemmel,et al.  A VLSI Implementation of the Adaptive Exponential Integrate-and-Fire Neuron Model , 2010, NIPS.

[22]  J. Yang,et al.  Anatomy of a Nanoscale Conduction Channel Reveals the Mechanism of a High‐Performance Memristor , 2011, Advanced materials.

[23]  Zhaohao Wang,et al.  On-chip supervised learning rule for ultra high density neural crossbar using memristor for synapse and neuron , 2014, 2014 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH).

[24]  Janusz A. Starzyk,et al.  Memristor Crossbar Architecture for Synchronous Neural Networks , 2014, IEEE Transactions on Circuits and Systems I: Regular Papers.

[25]  Yuchao Yang,et al.  Building Neuromorphic Circuits with Memristive Devices , 2013, IEEE Circuits and Systems Magazine.

[26]  Sylvain Saïghi,et al.  Excitatory and Inhibitory Memristive Synapses for Spiking Neural Networks , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[27]  H. Hwang,et al.  Hardware implementation of associative memory characteristics with analogue-type resistive-switching device , 2014, Nanotechnology.

[28]  Yiran Chen,et al.  Memristor Crossbar-Based Neuromorphic Computing System: A Case Study , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[30]  Julie Grollier,et al.  Silicon neuron dedicated to memristive spiking neural networks , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[31]  Yiran Chen,et al.  Reconfigurable Neuromorphic Computing System with Memristor-Based Synapse Design , 2013, Neural Processing Letters.

[32]  Hyunsang Hwang,et al.  Neuromorphic Character Recognition System With Two PCMO Memristors as a Synapse , 2014, IEEE Transactions on Industrial Electronics.

[33]  Byoung Hun Lee,et al.  Neuromorphic Hardware System for Visual Pattern Recognition With Memristor Array and CMOS Neuron , 2015, IEEE Transactions on Industrial Electronics.