Pattern Recognition Using Spiking Neurons and Firing Rates

Different varieties of artificial neural networks have proved their power in several pattern recognition problems, particularly feed-forward neural networks. Nevertheless, these kinds of neural networks require of several neurons and layers in order to success when they are applied to solve non-linear problems. In this paper is shown how a spiking neuron can be applied to solve different linear and non-linear pattern recognition problems. A spiking neuron is stimulated during T ms with an input signal and fires when its membrane potential reaches a specific value generating an action potential (spike) or a train of spikes. Given a set of input patterns belonging to K classes, each input pattern is transformed into an input signal, then the spiking neuron is stimulated during T ms and finally the firing rate is computed. After adjusting the synaptic weights of the neuron model, we expect that input patterns belonging to the same class generate almost the same firing rate and input patterns belonging to different classes generate firing rates different enough to discriminate among the different classes. At last, a comparison between a feed-forward neural network and a spiking neuron is presented when they are applied to solve non-linear and real object recognition problems.

[1]  Michael E. Hasselmo,et al.  A Proposed Function for Hippocampal Theta Rhythm: Separate Phases of Encoding and Retrieval Enhance Reversal of Prior Learning , 2002, Neural Computation.

[2]  Juan Humberto Sossa Azuela,et al.  Design of artificial neural networks using a modified Particle Swarm Optimization algorithm , 2009, 2009 International Joint Conference on Neural Networks.

[3]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[4]  Wulfram Gerstner,et al.  Spiking Neuron Models: An Introduction , 2002 .

[5]  R. Kozma,et al.  A chaos synchronization-based dynamic vision model for image segmentation , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[6]  Fernand Gobet,et al.  Automatic Generation of Cognitive Theories using Genetic Programming , 2007, Minds and Machines.

[7]  Eugene M. Izhikevich,et al.  Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting , 2006 .

[8]  Wulfram Gerstner,et al.  Spiking Neuron Models , 2002 .

[9]  Kevin N. Gurney,et al.  An introduction to neural networks , 2018 .

[10]  P J Webros.  BACKPROPAGATION THROUGH TIME: WHAT IT DOES AND HOW TO DO IT , 1990 .

[11]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[12]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[13]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[14]  Juan Humberto Sossa Azuela,et al.  A New Associative Model with Dynamical Synapses , 2008, Neural Processing Letters.

[15]  Dieter Jaeger,et al.  Converting a globus pallidus neuron model from 585 to 6 compartments using an evolutionary algorithm , 2007, BMC Neuroscience.

[16]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[17]  James A. Anderson,et al.  An Introduction To Neural Networks , 1998 .

[18]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[19]  Jeff Heaton,et al.  Introduction to neural networks for C , 2008 .

[20]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[21]  Dario Floreano,et al.  From Wheels to Wings with Evolutionary Spiking Circuits , 2003, Artificial Life.

[22]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[23]  E. D. Di Paolo.  Spike-Timing Dependent Plasticity for Evolved Robots , 2002 .

[24]  J J Hopfield,et al.  What is a moment? "Cortical" sensory integration over a brief interval. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[25]  J. Rouat,et al.  Exploration of rank order coding with spiking neural networks for speech recognition , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[26]  Rufin van Rullen,et al.  SpikeNet: real-time visual processing with one spike per neuron , 2004, Neurocomputing.

[27]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .