A Neuro-Inspired System for Online Learning and Recognition of Parallel Spike Trains, Based on Spike Latency, and Heterosynaptic STDP

Humans perform remarkably well in many cognitive tasks including pattern recognition. However, the neuronal mechanisms underlying this process are not well understood. Nevertheless, artificial neural networks, inspired in brain circuits, have been designed and used to tackle spatio-temporal pattern recognition tasks. In this paper we present a multi-neuronal spike pattern detection structure able to autonomously implement online learning and recognition of parallel spike sequences (i.e., sequences of pulses belonging to different neurons/neural ensembles). The operating principle of this structure is based on two spiking/synaptic neurocomputational characteristics: spike latency, which enables neurons to fire spikes with a certain delay and heterosynaptic plasticity, which allows the own regulation of synaptic weights. From the perspective of the information representation, the structure allows mapping a spatio-temporal stimulus into a multi-dimensional, temporal, feature space. In this space, the parameter coordinate and the time at which a neuron fires represent one specific feature. In this sense, each feature can be considered to span a single temporal axis. We applied our proposed scheme to experimental data obtained from a motor-inhibitory cognitive task. The results show that out method exhibits similar performance compared with other classification methods, indicating the effectiveness of our approach. In addition, its simplicity and low computational cost suggest a large scale implementation for real time recognition applications in several areas, such as brain computer interface, personal biometrics authentication, or early detection of diseases.

[1]  Kay Chen Tan,et al.  A brain-inspired spiking neural network model with temporal encoding and learning , 2014, Neurocomputing.

[2]  Martin Eimer,et al.  Effects of attention and stimulus probability on ERPs in a Go/Nogo task , 1993, Biological Psychology.

[3]  B. Porjesz,et al.  Neurocognitive deficits in male alcoholics: An ERP/sLORETA analysis of the N2 component in an equal probability Go/NoGo task , 2012, Biological Psychology.

[4]  Rodolphe Sepulchre,et al.  First spike latency sensitivity of spiking neuron models , 2013, BMC Neuroscience.

[5]  Bernice Porjesz,et al.  The role of brain oscillations as functional correlates of cognitive systems: a study of frontal inhibitory control in alcoholism. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[6]  G. Capizzi,et al.  A spiking neural network-based model for anaerobic digestion process , 2016, 2016 International Symposium on Power Electronics, Electrical Drives, Automation and Motion (SPEEDAM).

[7]  J. Hohnsbein,et al.  ERP components in Go/Nogo tasks and their relation to inhibition. , 1999, Acta psychologica.

[8]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[9]  Timothée Masquelier,et al.  STDP Allows Close-to-Optimal Spatiotemporal Spike Pattern Detection by Single Coincidence Detector Neurons , 2016, Neuroscience.

[10]  Mohammad Reza Meybodi,et al.  Unsupervised learning of synaptic delays based on learning automata in an RBF-like network of spiking neurons for data clustering , 2005, Neurocomputing.

[11]  Gian Carlo Cardarilli,et al.  Spiking neural networks based on LIF with latency: Simulation and synchronization effects , 2013, 2013 Asilomar Conference on Signals, Systems and Computers.

[12]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.

[13]  M. Volgushev,et al.  Heterosynaptic plasticity in the neocortex , 2009, Experimental Brain Research.

[14]  Norio Matsuki,et al.  Multineuronal spike sequences repeat with millisecond precision , 2013, Front. Neural Circuits.

[15]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[16]  Matthew Cook,et al.  Unsupervised learning of digit recognition using spike-timing-dependent plasticity , 2015, Front. Comput. Neurosci..

[17]  Herbert Peremans,et al.  Bat echolocation processing using first-spike latency coding , 2009, Neural Networks.

[18]  Eduardo Ros,et al.  Event-Driven Simulation Scheme for Spiking Neural Networks Using Lookup Tables to Characterize Neuronal Dynamics , 2006, Neural Computation.

[19]  Nicholas T. Carnevale,et al.  The NEURON Simulation Environment , 1997, Neural Computation.

[20]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[21]  Tim Gollisch,et al.  Rapid Neural Coding in the Retina with Relative Spike Latencies , 2008, Science.

[22]  W. Singer,et al.  Integrator or coincidence detector? The role of the cortical neuron revisited , 1996, Trends in Neurosciences.

[23]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[24]  Gian Carlo Cardarilli,et al.  Hardware design of LIF with Latency neuron model with memristive STDP synapses , 2017, Integr..

[25]  M. Falkenstein Inhibition, conflict and the Nogo-N2 , 2006, Clinical Neurophysiology.

[26]  Ammar Belatreche,et al.  DL-ReSuMe: A Delay Learning-Based Remote Supervised Method for Spiking Neurons , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Jianping Li,et al.  R-Tempotron: A robust tempotron learning rule for spike timing-based decisions , 2016, 2016 13th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP).

[28]  Berthold Hedwig,et al.  Song pattern recognition in crickets based on a delay-line and coincidence-detector mechanism , 2017, Proceedings of the Royal Society B: Biological Sciences.

[29]  D. Pizzagalli,et al.  When ‘go’ and ‘nogo’ are equally frequent: ERP components and cortical tomography , 2004, The European journal of neuroscience.

[30]  Y. Goda,et al.  Homeostatic synaptic plasticity: from single synapses to neural circuits , 2012, Current Opinion in Neurobiology.

[31]  Alessandro Cristini,et al.  Accurate Latency Characterization for Very Large Asynchronous Spiking Neural Networks , 2011, BIOINFORMATICS.

[32]  J. Byrne,et al.  Heterosynaptic Modulation of Synaptic Efficacy , 2006 .

[33]  Huajin Tang,et al.  Precise-Spike-Driven Synaptic Plasticity: Learning Hetero-Association of Spatiotemporal Spike Patterns , 2013, PloS one.

[34]  H Shibasaki,et al.  Role of primary sensorimotor cortices in generating inhibitory motor response in humans. , 2000, Brain : a journal of neurology.

[35]  Jeffrey L. Krichmar,et al.  Adaptive Robot Path Planning Using a Spiking Neuron Algorithm With Axonal Delays , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[36]  M. Bellgrove,et al.  Insights into the neural basis of response inhibition from cognitive and clinical neuroscience , 2009, Neuroscience & Biobehavioral Reviews.

[37]  R. Douglas Fields,et al.  A new mechanism of nervous system plasticity: activity-dependent myelination , 2015, Nature Reviews Neuroscience.

[38]  Eran Stark,et al.  Local generation of multineuronal spike sequences in the hippocampal CA1 region , 2015, Proceedings of the National Academy of Sciences.

[39]  Gianluca Susi,et al.  Bio-Inspired Temporal-Decoding Network Topologies for the Accurate Recognition of Spike Patterns , 2015 .

[40]  F. Cadaveira,et al.  Binge drinking affects brain oscillations linked to motor inhibition and execution , 2017, Journal of psychopharmacology.

[41]  Kamal Sen,et al.  A Robust and Biologically Plausible Spike Pattern Recognition Network , 2010, The Journal of Neuroscience.

[42]  F. Klefenz,et al.  A NEURAL NET FOR 2D-SLOPE AND SINUSOIDAL SHAPE DETECTION , 2014 .

[43]  Takashi Matsubara,et al.  Conduction Delay Learning Model for Unsupervised and Supervised Classification of Spatio-Temporal Spike Patterns , 2017, Front. Comput. Neurosci..

[44]  Wulfram Gerstner,et al.  Spike-timing dependent plasticity , 2010, Scholarpedia.

[45]  Paolo Del Giudice,et al.  Efficient Event-Driven Simulation of Large Networks of Spiking Neurons and Dynamical Synapses , 2000, Neural Computation.

[46]  Hengtong Wang,et al.  First-spike latency in Hodgkin's three classes of neurons. , 2013, Journal of theoretical biology.

[47]  G. Westbrook,et al.  Lateral Excitation within the Olfactory Bulb , 2006, The Journal of Neuroscience.

[48]  Giacomo Capizzi,et al.  A new design methodology to predict wind farm energy production by means of a spiking neural network–based system , 2019 .

[49]  S. Heinemann,et al.  Distal Dendritic Inputs Control Neuronal Activity by Heterosynaptic Potentiation of Proximal Inputs , 2013, The Journal of Neuroscience.

[50]  Eugene M. Izhikevich,et al.  Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting , 2006 .

[51]  Lüder Deecke,et al.  Voluntary finger movement in man: Cerebral potentials and theory , 1976, Biological Cybernetics.

[52]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[53]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[54]  D. McCandless Fundamental neuroscience , 1997, Metabolic Brain Disease.

[55]  R. FitzHugh Mathematical models of threshold phenomena in the nerve membrane , 1955 .

[56]  Alessandro Cristini,et al.  A Continuous-Time Spiking Neural Network Paradigm , 2015, Advances in Neural Networks.

[57]  J Gautrais,et al.  Rate coding versus temporal order coding: a theoretical approach. , 1998, Bio Systems.

[58]  R. Fields,et al.  White matter in learning, cognition and psychiatric disorders , 2008, Trends in Neurosciences.

[59]  Alessandro Cristini,et al.  Path multimodality in a feedforward SNN module, using LIF with latency model , 2016 .

[60]  Tomoki Fukai,et al.  Detailed Dendritic Excitatory/Inhibitory Balance through Heterosynaptic Spike-Timing-Dependent Plasticity , 2016, The Journal of Neuroscience.