Spike timing-dependent conduction delay learning model classifying spatio-temporal spike patterns

Precise spike timing is considered to play a fundamental role in communication and signal processing in biological neural networks. Understanding such mechanism contributes to both deep understanding of biological system and development of engineering applications such as efficient computational architectures. However, the biological mechanism which adjusts and maintains the spike timing still remains unclear. Previous studies have proposed algorithms adjusting synaptic efficacy and axonal conduction delay so that the spike timings get close to the desired spike timings in supervised manner. Supervised learning always requires desired spike timings as teacher signal, and thus it should not be dominant in biological system, which is considered to adapt to environment without teacher. This study proposes a spike timing-dependent learning model adjusting synaptic efficacy and axonal conduction delay in both unsupervised and supervised manners. The proposed learning algorithm approximates Expectation-Maximization algorithm and can classify the input data coded into spatio-temporal spike patterns. Furthermore, the proposed learning algorithm agrees with various results of existing biological experiments such as spike timing-dependent plasticity, and therefore it could be a good candidate of a model of biological delay learning.

[1]  Jack D. Cowan,et al.  DYNAMICS OF SELF-ORGANIZED DELAY ADAPTATION , 1999 .

[2]  Matthew Cook,et al.  Unsupervised learning of digit recognition using spike-timing-dependent plasticity , 2015, Front. Comput. Neurosci..

[3]  Mark C. W. van Rossum,et al.  Stable Hebbian Learning from Spike Timing-Dependent Plasticity , 2000, The Journal of Neuroscience.

[4]  Samy Bengio,et al.  Delay learning and polychronization for reservoir computing , 2008, Neurocomputing.

[5]  Nikil D. Dutt,et al.  Categorization and decision-making in a neurobiologically plausible spiking network using a STDP-like learning rule , 2013, Neural Networks.

[6]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[7]  L. Cooper,et al.  A unified model of NMDA receptor-dependent bidirectional synaptic plasticity , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Masa-aki Sato Fast Learning of On-line EM Algorithm , 1999 .

[9]  Walter Senn,et al.  Learning Real-World Stimuli in a Neural Network with Spike-Driven Synaptic Dynamics , 2007, Neural Computation.

[10]  D. Querlioz,et al.  Immunity to Device Variations in a Spiking Neural Network With Memristive Nanodevices , 2013, IEEE Transactions on Nanotechnology.

[11]  M. Konishi,et al.  A circuit for detection of interaural time differences in the brain stem of the barn owl , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  Matthieu Gilson,et al.  Stability versus Neuronal Specialization for STDP: Long-Tail Weight Distributions Solve the Dilemma , 2011, PloS one.

[13]  Jean-Pascal Pfister,et al.  Optimal Spike-Timing-Dependent Plasticity for Precise Action Potential Firing in Supervised Learning , 2005, Neural Computation.

[14]  Gayle M. Wittenberg,et al.  Spike Timing Dependent Plasticity: A Consequence of More Fundamental Learning Rules , 2010, Front. Comput. Neurosci..

[15]  D. M. Green,et al.  A panoramic code for sound location by cortical neurons. , 1994, Science.

[16]  Günther Palm,et al.  Synaptic Delay Learning in Pulse-Coupled Neurons , 1998, Neural Computation.

[17]  Haizhou Li,et al.  Rapid Feedforward Computation by Temporal Encoding and Learning With Spiking Neurons , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[19]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[20]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.

[21]  D. Johnston,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997 .

[22]  S. Wang,et al.  Malleability of Spike-Timing-Dependent Plasticity at the CA3–CA1 Synapse , 2006, The Journal of Neuroscience.

[23]  G. Edelman,et al.  Spike-timing dynamics of neuronal groups. , 2004, Cerebral cortex.

[24]  Ammar Belatreche,et al.  DL-ReSuMe: A Delay Learning-Based Remote Supervised Method for Spiking Neurons , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Wolfgang Maass,et al.  STDP enables spiking neurons to detect hidden causes of their inputs , 2009, NIPS.

[26]  Steve M. Potter,et al.  Long-Term Activity-Dependent Plasticity of Action Potential Propagation Delay and Amplitude in Cortical Networks , 2008, PloS one.

[27]  Gert Cauwenberghs,et al.  Event-driven contrastive divergence for spiking neuromorphic systems , 2013, Front. Neurosci..

[28]  Tobi Delbruck,et al.  Real-time classification and sensor fusion with a spiking deep belief network , 2013, Front. Neurosci..

[29]  Edwin W Rubel,et al.  Mechanisms for Adjusting Interaural Time Differences to Achieve Binaural Coincidence Detection , 2010, The Journal of Neuroscience.

[30]  F. Ponulak ReSuMe-New Supervised Learning Method for Spiking Neural Networks , 2005 .

[31]  R. Fields,et al.  Myelination: An Overlooked Mechanism of Synaptic Plasticity? , 2005, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[32]  Andreas Thiel,et al.  Delay adaptation in the nervous system , 2000, Neurocomputing.

[33]  Deepak Khosla,et al.  Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition , 2014, International Journal of Computer Vision.

[34]  Takashi Matsubara,et al.  Asynchronous Cellular Automaton-Based Neuron: Theoretical Analysis and On-FPGA Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[35]  R. Douglas Fields,et al.  A new mechanism of nervous system plasticity: activity-dependent myelination , 2015, Nature Reviews Neuroscience.

[36]  Stephen G. Waxman,et al.  Ultrastructure of visual callosal axons in the rabbit , 1976, Experimental Neurology.

[37]  Takashi Matsubara,et al.  An Asynchronous Recurrent Network of Cellular Automaton-Based Neurons and Its Reproduction of Spiking Neural Network Activities , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[38]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[39]  Haim Sompolinsky,et al.  Learning Input Correlations through Nonlinear Temporally Asymmetric Hebbian Plasticity , 2003, The Journal of Neuroscience.