A Hybrid CMOS-Memristor Neuromorphic Synapse

Although data processing technology continues to advance at an astonishing rate, computers with brain-like processing capabilities still elude us. It is envisioned that such computers may be achieved by the fusion of neuroscience and nano-electronics to realize a brain-inspired platform. This paper proposes a high-performance nano-scale Complementary Metal Oxide Semiconductor (CMOS)-memristive circuit, which mimics a number of essential learning properties of biological synapses. The proposed synaptic circuit that is composed of memristors and CMOS transistors, alters its memristance in response to timing differences among its pre- and post-synaptic action potentials, giving rise to a family of Spike Timing Dependent Plasticity (STDP). The presented design advances preceding memristive synapse designs with regards to the ability to replicate essential behaviours characterised in a number of electrophysiological experiments performed in the animal brain, which involve higher order spike interactions. Furthermore, the proposed hybrid device CMOS area is estimated as $600\ \mu {\text{m}}^2$ in a $0.35\ \mu {\text{m}}$ process—this represents a factor of ten reduction in area with respect to prior CMOS art. The new design is integrated with silicon neurons in a crossbar array structure amenable to large-scale neuromorphic architectures and may pave the way for future neuromorphic systems with spike timing-dependent learning features. These systems are emerging for deployment in various applications ranging from basic neuroscience research, to pattern recognition, to Brain-Machine-Interfaces.

[1]  W. Gerstner,et al.  Triplets of Spikes in a Model of Spike Timing-Dependent Plasticity , 2006, The Journal of Neuroscience.

[2]  Frank Klefenz,et al.  Synaptic behavior and STDP of asymmetric nanoscale memristors in biohybrid systems. , 2013, Nanoscale.

[3]  Mostafa Rahimi Azghadi,et al.  Programmable neuromorphic circuits for spike-based neural dynamics , 2013, 2013 IEEE 11th International New Circuits and Systems Conference (NEWCAS).

[4]  Mirko Hansen,et al.  Memristive Hebbian Plasticity Model: Device Requirements for the Emulation of Hebbian Plasticity Based on Memristive Devices , 2015, IEEE Transactions on Biomedical Circuits and Systems.

[5]  L. Luo,et al.  Spike-timing-dependent synaptic modification induced by natural spike trains , 2022 .

[6]  Ali Khiat,et al.  Emulating long-term synaptic dynamics with memristive devices , 2015, ArXiv.

[7]  J. Pfister,et al.  A triplet spike-timing–dependent plasticity model generalizes the Bienenstock–Cooper–Munro rule to higher-order spatiotemporal correlations , 2011, Proceedings of the National Academy of Sciences.

[8]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[9]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[10]  Giacomo Indiveri,et al.  A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity , 2006, IEEE Transactions on Neural Networks.

[11]  Giacomo Indiveri,et al.  Integration of nanoscale memristor synapses in neuromorphic computing architectures , 2013, Nanotechnology.

[12]  Fabien Alibart,et al.  Plasticity in memristive devices for spiking neural networks , 2015, Front. Neurosci..

[13]  J Joshua Yang,et al.  Memristive devices for computing. , 2013, Nature nanotechnology.

[14]  Vishal Saxena,et al.  Homogeneous Spiking Neuromorphic System for Real-World Pattern Recognition , 2015, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[15]  Alan F. Murray,et al.  Synchrony detection and amplification by silicon neurons with STDP synapses , 2004, IEEE Transactions on Neural Networks.

[16]  Nan Du,et al.  Waveform Driven Plasticity in BiFeO3 Memristive Devices: Model and Implementation , 2012, NIPS.

[17]  E. Vianello,et al.  HfO2-Based OxRAM Devices as Synapses for Convolutional Neural Networks , 2015, IEEE Transactions on Electron Devices.

[18]  T. Serrano-Gotarredona,et al.  STDP and STDP variations with memristors for spiking neuromorphic learning systems , 2013, Front. Neurosci..

[19]  Gregory S. Snider,et al.  Spike-timing-dependent learning in memristive nanodevices , 2008, 2008 IEEE International Symposium on Nanoscale Architectures.

[20]  David W. Nauen,et al.  Coactivation and timing-dependent integration of synaptic potentiation and depression , 2005, Nature Neuroscience.

[21]  Bernabé Linares-Barranco,et al.  On Spike-Timing-Dependent-Plasticity, Memristive Devices, and Building a Self-Learning Visual Cortex , 2011, Front. Neurosci..

[22]  Mahdi Kiani,et al.  Single pairing spike-timing dependent plasticity in BiFeO3 memristors with a time window of 25 ms to 125 μs , 2015, Front. Neurosci..

[23]  D. Abbott,et al.  Tunable Low Energy, Compact and High Performance Neuromorphic Circuit for Spike-Based Synaptic Plasticity , 2014, PloS one.

[24]  Y. Dan,et al.  Spike-timing-dependent synaptic modification induced by natural spike trains , 2002, Nature.

[25]  Mostafa Rahimi Azghadi,et al.  Spike-Based Synaptic Plasticity in Silicon: Design, Implementation, Application, and Challenges , 2014, Proceedings of the IEEE.

[26]  Omid Kavehei,et al.  Multiprotocol-induced plasticity in artificial synapses. , 2014, Nanoscale.

[27]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[28]  Xiang Yang,et al.  Dynamic-Load-Enabled Ultra-low Power Multiple-State RRAM Devices , 2012, Scientific Reports.

[29]  Farnood Merrikh-Bayat,et al.  Self-Adaptive Spike-Time-Dependent Plasticity of Metal-Oxide Memristors , 2015, Scientific Reports.

[30]  Mostafa Rahimi Azghadi,et al.  A neuromorphic VLSI design for spike timing and rate based synaptic plasticity , 2013, Neural Networks.

[31]  Ali Khiat,et al.  Emulating short-term synaptic dynamics with memristive devices , 2015, Scientific Reports.

[32]  Mostafa Rahimi Azghadi,et al.  Programmable Spike-Timing-Dependent Plasticity Learning Circuits in Neuromorphic VLSI Architectures , 2015, ACM J. Emerg. Technol. Comput. Syst..

[33]  Y. Dan,et al.  Contribution of individual spikes in burst-induced long-term synaptic modification. , 2006, Journal of neurophysiology.

[34]  Rahimi Azghadi,et al.  Neuromorphic VLSI designs for spike timing and rate-based synaptic plasticity with application in pattern classification. , 2014 .

[35]  Rui Ponte Costa,et al.  Unified pre- and postsynaptic long-term plasticity enables reliable and flexible learning , 2015, eLife.

[36]  René Schüffny,et al.  Replicating experimental spike and rate based neural learning in CMOS , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[37]  Jacques-Olivier Klein,et al.  Spin-Transfer Torque Magnetic Memory as a Stochastic Memristive Synapse for Neuromorphic Systems , 2015, IEEE Transactions on Biomedical Circuits and Systems.

[38]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[39]  Ronald Tetzlaff,et al.  Neuronal Synapse as a Memristor: Modeling Pair- and Triplet-Based STDP Rule , 2015, IEEE Transactions on Biomedical Circuits and Systems.