A biophysically-based neuromorphic model of spike rate- and timing-dependent plasticity

Current advances in neuromorphic engineering have made it possible to emulate complex neuronal ion channel and intracellular ionic dynamics in real time using highly compact and power-efficient complementary metal-oxide-semiconductor (CMOS) analog very-large-scale-integrated circuit technology. Recently, there has been growing interest in the neuromorphic emulation of the spike-timing-dependent plasticity (STDP) Hebbian learning rule by phenomenological modeling using CMOS, memristor or other analog devices. Here, we propose a CMOS circuit implementation of a biophysically grounded neuromorphic (iono-neuromorphic) model of synaptic plasticity that is capable of capturing both the spike rate-dependent plasticity (SRDP, of the Bienenstock-Cooper-Munro or BCM type) and STDP rules. The iono-neuromorphic model reproduces bidirectional synaptic changes with NMDA receptor-dependent and intracellular calcium-mediated long-term potentiation or long-term depression assuming retrograde endocannabinoid signaling as a second coincidence detector. Changes in excitatory or inhibitory synaptic weights are registered and stored in a nonvolatile and compact digital format analogous to the discrete insertion and removal of AMPA or GABA receptor channels. The versatile Hebbian synapse device is applicable to a variety of neuroprosthesis, brain-machine interface, neurorobotics, neuromimetic computation, machine learning, and neural-inspired adaptive control problems.

[1]  L. Cooper.  STDP: Spiking, Timing, Rates and Beyond , 2010, Frontiers in synaptic neuroscience.

[2]  Bernardo L. Sabatini,et al.  Analysis of calcium channels in single spines using optical fluctuation analysis , 2000, Nature.

[3]  Zhijun Yang,et al.  An artificial early visual model adopting spike-timing-dependent plasticity , 2006, Neurocomputing.

[4]  Vivien Chevaleyre,et al.  Endocannabinoid-mediated synaptic plasticity in the CNS. , 2006, Annual review of neuroscience.

[5]  Alan F. Murray,et al.  Synchrony detection and amplification by silicon neurons with STDP synapses , 2004, IEEE Transactions on Neural Networks.

[6]  Peter Somogyi,et al.  Increased number of synaptic GABAA receptors underlies potentiation at hippocampal inhibitory synapses , 1998, Nature.

[7]  Alan F. Murray,et al.  Minimizing the Effect of Process Mismatch in a Neuromorphic System Using Spike-Timing-Dependent Adaptation , 2008, IEEE Transactions on Neural Networks.

[8]  Yue Wang,et al.  Endocannabinoids facilitate the induction of LTP in the hippocampus , 2002, Nature Neuroscience.

[9]  Davide Badoni,et al.  Spike-Driven Synaptic Plasticity: Theory, Simulation, VLSI Implementation , 2000, Neural Computation.

[10]  Kwabena Boahen,et al.  Learning in Silicon: Timing is Everything , 2005, NIPS.

[11]  Masahiko Watanabe,et al.  Roles of phospholipase Cβ and NMDA receptor in activity‐dependent endocannabinoid release , 2007, The Journal of physiology.

[12]  Razvan V. Florian,et al.  Reinforcement Learning Through Modulation of Spike-Timing-Dependent Synaptic Plasticity , 2007, Neural Computation.

[13]  Gayle M. Wittenberg,et al.  Spike Timing Dependent Plasticity: A Consequence of More Fundamental Learning Rules , 2010, Front. Comput. Neurosci..

[14]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[15]  Alister Hamilton,et al.  A programmable spike-timing based circuit block for reconfigurable neuromorphic computing , 2009, Neurocomputing.

[16]  M. Roberto,et al.  Endocannabinoids restrict hippocampal long-term potentiation via CB1 , 2005, Neuropharmacology.

[17]  Johannes Schemmel,et al.  Implementing Synaptic Plasticity in a VLSI Spiking Neural Network Model , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[18]  V. Han,et al.  Reversible Associative Depression and Nonassociative Potentiation at a Parallel Fiber Synapse , 2000, Neuron.

[19]  Andrew Philippides,et al.  Reconciling the STDP and BCM Models of Synaptic Plasticity in a Spiking Recurrent Neural Network , 2010, Neural Computation.

[20]  R. Malinow,et al.  Driving AMPA receptors into synapses by LTP and CaMKII: requirement for GluR1 and PDZ domain interaction. , 2000, Science.

[21]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[22]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[23]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[24]  J. Lisman,et al.  The molecular basis of CaMKII function in synaptic and behavioural memory , 2002, Nature Reviews Neuroscience.

[25]  P. J. Sjöström,et al.  Neocortical LTD via Coincident Activation of Presynaptic NMDA and Cannabinoid Receptors , 2003, Neuron.

[26]  Y. Dan,et al.  Spike-timing-dependent synaptic plasticity depends on dendritic location , 2005, Nature.

[27]  Lei Zhang,et al.  An organic/Si nanowire hybrid field configurable transistor. , 2008, Nano letters.

[28]  C. C. Law,et al.  Formation of receptive fields in realistic visual environments according to the Bienenstock, Cooper, and Munro (BCM) theory. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Guy Rachmuth,et al.  Transistor analogs of emergent iono‐neuronal dynamics , 2008, HFSP journal.

[30]  Kenji Doya,et al.  What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? , 1999, Neural Networks.

[31]  P. J. Sjöström,et al.  Spike timing, calcium signals and synaptic plasticity , 2002, Current Opinion in Neurobiology.

[32]  Yong Chen,et al.  Configurable Neural Phase Shifter With Spike-Timing-Dependent Plasticity , 2010, IEEE Electron Device Letters.

[33]  Jean-Pascal Pfister,et al.  Optimal Spike-Timing-Dependent Plasticity for Precise Action Potential Firing in Supervised Learning , 2005, Neural Computation.

[34]  Chiara Bartolozzi,et al.  Synaptic Dynamics in Analog VLSI , 2007, Neural Computation.

[35]  Jesper Tegnér,et al.  Spike-timing-dependent plasticity: common themes and divergent vistas , 2002, Biological Cybernetics.

[36]  Joshua J. C. Monzon,et al.  A picoampere A/D converter for biosensor applications. , 2010, Sensors and actuators. B, Chemical.

[37]  Dean V. Buonomano,et al.  Mechanisms and significance of spike-timing dependent plasticity , 2002, Biological Cybernetics.

[38]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[39]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[40]  John J. Hopfield,et al.  The effectiveness of analogue ‘neural network’ hardware , 1990 .

[41]  C. Diorio.  A p-channel MOS synapse transistor with self-convergent memory writes , 2000 .

[42]  M. Bear,et al.  Homosynaptic long-term depression in area CA1 of hippocampus and effects of N-methyl-D-aspartate receptor blockade. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[43]  Y. Ben-Ari,et al.  Long-term plasticity at GABAergic and glycinergic synapses: mechanisms and functional significance , 2002, Trends in Neurosciences.

[44]  Kathie L. Olsen,et al.  Neurotech for Neuroscience: Unifying Concepts, Organizing Principles, and Emerging Tools , 2007, The Journal of Neuroscience.

[45]  Florentin Wörgötter,et al.  A neuromorphic depth-from-motion vision model with STDP adaptation , 2006, IEEE Transactions on Neural Networks.

[46]  W. Gerstner,et al.  Triplets of Spikes in a Model of Spike Timing-Dependent Plasticity , 2006, The Journal of Neuroscience.

[47]  Enrico Cherubini,et al.  ‘Deaf, mute and whispering’ silent synapses: their role in synaptic plasticity , 2004, The Journal of physiology.

[48]  Jian Zhang,et al.  Endocannabinoids Differentially Modulate Synaptic Plasticity in Rat Hippocampal CA1 Pyramidal Neurons , 2010, PloS one.

[49]  Nicolas Brunel,et al.  Frontiers in Computational Neuroscience Computational Neuroscience , 2022 .

[50]  E. Izhikevich.  Solving the distal reward problem through linkage of STDP and dopamine signaling , 2007, BMC Neuroscience.

[51]  Tor Sverre Lande,et al.  Neuromorphic Systems Engineering , 1998 .

[52]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[53]  J. Kedzierski,et al.  Work-Function-Tuned TiN Metal Gate FDSOI Transistors for Subthreshold Operation , 2011, IEEE Transactions on Electron Devices.

[54]  Y. Dan,et al.  Spike Timing-Dependent Plasticity of Neural Circuits , 2004, Neuron.

[55]  Y. Dan,et al.  Spike timing-dependent plasticity: a Hebbian learning rule. , 2008, Annual review of neuroscience.

[56]  M. Bear,et al.  Metaplasticity: the plasticity of synaptic plasticity , 1996, Trends in Neurosciences.

[57]  Philipp Häfliger,et al.  Floating gate analog memory for parameter and variable storage in a learning silicon neuron , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[58]  Siming Liu,et al.  Dynamic topology representing networks , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[59]  P.R. Kinget.  Device mismatch and tradeoffs in the design of analog circuits , 2005, IEEE Journal of Solid-State Circuits.

[60]  David W. Nauen,et al.  Coactivation and timing-dependent integration of synaptic potentiation and depression , 2005, Nature Neuroscience.

[61]  T. Fuchs,et al.  GABAA Receptor Trafficking-Mediated Plasticity of Inhibitory Synapses , 2011, Neuron.

[62]  P. Castillo,et al.  Endocannabinoid-Mediated Metaplasticity in the Hippocampus , 2004, Neuron.

[63]  L. Cooper,et al.  A unified model of NMDA receptor-dependent bidirectional synaptic plasticity , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[64]  R. Nicoll,et al.  AMPA Receptor Trafficking at Excitatory Synapses , 2003, Neuron.

[65]  Ramón Huerta,et al.  Biophysical model of synaptic plasticity dynamics , 2003, Biological Cybernetics.

[66]  M. Bear,et al.  Synaptic plasticity: LTP and LTD , 1994, Current Opinion in Neurobiology.

[67]  Eugene M. Izhikevich,et al.  Relating STDP to BCM , 2003, Neural Computation.

[68]  K. Svoboda,et al.  Experience Strengthening Transmission by Driving AMPA Receptors into Synapses , 2003, Science.

[69]  Paul E. Hasler,et al.  Correlation learning rule in floating-gate pFET synapses , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[70]  M. Bear,et al.  Common forms of synaptic plasticity in the hippocampus and neocortex in vitro. , 1993, Science.

[71]  Li I. Zhang,et al.  A critical window for cooperation and competition among developing retinotectal synapses , 1998, Nature.

[72]  L. Cooper,et al.  A physiological basis for a theory of synapse modification. , 1987, Science.

[73]  Guy Rachmuth,et al.  1.2 V sub-nanoampere A/D converter , 2005 .

[74]  Marcel J. M. Pelgrom,et al.  Matching properties of MOS transistors , 1989 .

[75]  Masahiko Watanabe,et al.  Endocannabinoid-mediated control of synaptic transmission. , 2009, Physiological reviews.

[76]  Yicong Meng,et al.  Dynamic Programming Networks for Large-Scale 3D Chip Integration , 2011, IEEE Circuits and Systems Magazine.

[77]  Yihui Cui,et al.  Distinct coincidence detectors govern the corticostriatal spike timing‐dependent plasticity , 2010, The Journal of physiology.

[78]  R. Malenka,et al.  Mechanisms underlying induction of homosynaptic long-term depression in area CA1 of the hippocampus , 1992, Neuron.

[79]  Riccardo Rizzo,et al.  An Application of Spike-Timing-Dependent Plasticity to Readout Circuit for Liquid State Machine , 2007, 2007 International Joint Conference on Neural Networks.

[80]  A. van Schaik.  Building blocks for electronic spiking neural networks. , 2001, Neural networks : the official journal of the International Neural Network Society.

[81]  Vanessa A. Bender,et al.  Two Coincidence Detectors for Spike Timing-Dependent Plasticity in Somatosensory Cortex , 2006, The Journal of Neuroscience.

[82]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[83]  Chi-Sang Poon,et al.  Neuromorphic Silicon Neurons and Large-Scale Neural Networks: Challenges and Opportunities , 2011, Front. Neurosci..

[84]  T. Bliss,et al.  Long‐lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path , 1973, The Journal of physiology.

[85]  Terry Elliott,et al.  Synaptic and Temporal Ensemble Interpretation of Spike-Timing-Dependent Plasticity , 2005, Neural Computation.

[86]  Alister Hamilton,et al.  Analog VLSI Circuit Implementation of an Adaptive Neuromorphic Olfaction Chip , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.

[87]  L. Trussell,et al.  Coactivation of Pre- and Postsynaptic Signaling Mechanisms Determines Cell-Specific Spike-Timing-Dependent Plasticity , 2007, Neuron.

[88]  D. Debanne,et al.  Long‐term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures , 1998, The Journal of physiology.

[89]  Kwabena Boahen,et al.  Thermodynamically Equivalent Silicon Models of Voltage-Dependent Ion Channels , 2007, Neural Computation.

[90]  P. Castillo,et al.  Heterosynaptic LTD of Hippocampal GABAergic Synapses A Novel Role of Endocannabinoids in Regulating Excitability , 2003, Neuron.

[91]  U. Karmarkar,et al.  A model of spike-timing dependent plasticity: one or two coincidence detectors? , 2002, Journal of neurophysiology.

[92]  R. Malenka,et al.  Involvement of a calcineurin/ inhibitor-1 phosphatase cascade in hippocampal long-term depression , 1994, Nature.

[93]  Mark F. Bear,et al.  Bidirectional modification of CA1 synapses in the adult hippocampus in vivo , 1996, Nature.

[94]  Vittorio Dante,et al.  A VLSI recurrent network of integrate-and-fire neurons connected by plastic synapses with long-term memory , 2003, IEEE Trans. Neural Networks.

[95]  B. Sakmann,et al.  Spine Ca2+ Signaling in Spike-Timing-Dependent Plasticity , 2006, The Journal of Neuroscience.

[96]  M. Farries,et al.  Reinforcement learning with modulated spike timing dependent synaptic plasticity. , 2007, Journal of neurophysiology.

[97]  H. Abarbanel,et al.  Dynamical model of long-term synaptic plasticity , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[98]  Wulfram Gerstner,et al.  Phenomenological models of synaptic plasticity based on spike timing , 2008, Biological Cybernetics.

[99]  Per Jesper Sjöström,et al.  Novel presynaptic mechanisms for coincidence detection in synaptic plasticity , 2006, Current Opinion in Neurobiology.