Training Spiking Neurons by Means of Particle Swarm Optimization

Meta-heuristic algorithms inspired by nature have been used in a wide range of optimization problems. These types of algorithms have gained popularity in the field of artificial neural networks (ANN). On the other hand, spiking neural networks are a new type of ANN that simulates the behaviour of a biological neural network in a more realistic manner. Furthermore, these neural models have been applied to solve some pattern recognition problems. In this paper, it is proposed the use of the particle swarm optimization (PSO) algorithm to adjust the synaptic weights of a spiking neuron when it is applied to solve a pattern classification task. Given a set of input patterns belonging to K classes, each input pattern is transformed into an input signal. Then, the spiking neuron is stimulated during T ms and the firing rate is computed. After adjusting the synaptic weights of the neural model using the PSO algorithm, input patterns belonging to the same class will generate similar firing rates. On the contrary, input patterns belonging to other classes will generate firing rates different enough to discriminate among the classes. At last, a comparison between the PSO algorithm and a differential evolution algorithm is presented when the spiking neural model is applied to solve non-linear and real object recognition problems.

[1]  Juan Humberto Sossa Azuela,et al.  Design of artificial neural networks using a modified Particle Swarm Optimization algorithm , 2009, 2009 International Joint Conference on Neural Networks.

[2]  J. Rouat,et al.  Exploration of rank order coding with spiking neural networks for speech recognition , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[3]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[4]  Nikola K. Kasabov,et al.  String Pattern Recognition Using Evolving Spiking Neural Networks and Quantum Inspired Particle Swarm Optimization , 2009, ICONIP.

[5]  Juan Humberto Sossa Azuela,et al.  A New Associative Model with Dynamical Synapses , 2008, Neural Processing Letters.

[6]  Ezequiel A. Di Paolo,et al.  Spike-Timing Dependent Plasticity for Evolved Robots , 2002, Adapt. Behav..

[7]  Liang Zhao,et al.  PSO-based single multiplicative neuron model for time series prediction , 2009, Expert Syst. Appl..

[8]  Roberto Antonio Vázquez Pattern Recognition Using Spiking Neurons and Firing Rates , 2010, IBERAMIA.

[9]  Guillermo Ricardo Simari,et al.  Advances in Artificial Intelligence – IBERAMIA 2010 , 2010, Lecture Notes in Computer Science.

[10]  Hiroshi Kinjo,et al.  Pulse pattern training of spiking neural networks using improved genetic algorithm , 2003, Proceedings 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation. Computational Intelligence in Robotics and Automation for the New Millennium (Cat. No.03EX694).

[11]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[12]  Roberto Vazquez Izhikevich Neuron Model and its Application in Pattern Recognition , 2010, Aust. J. Intell. Inf. Process. Syst..

[13]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[14]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[15]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[16]  Roberto Antonio Vázquez,et al.  Integrate and Fire neurons and their application in pattern recognition , 2010, 2010 7th International Conference on Electrical Engineering Computing Science and Automatic Control.

[17]  Lifeng Xi,et al.  An Improved Particle Swarm Optimization for Evolving Feedforward Artificial Neural Networks , 2007, Neural Processing Letters.

[18]  Wang Qian,et al.  A cooperative method for supervised learning in Spiking neural networks , 2010, The 2010 14th International Conference on Computer Supported Cooperative Work in Design.

[19]  Rufin van Rullen,et al.  SpikeNet: real-time visual processing with one spike per neuron , 2004, Neurocomputing.

[20]  Eugene M. Izhikevich,et al.  Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting , 2006 .