Radial Basis Function Neural Network Based on PSO with Mutation Operation to Solve Function Approximation Problem

This paper presents a novel learning algorithm for training and constructing a Radial Basis Function Neural Network (RBFNN), called MuPSO-RBFNN algorithm. This algorithm combines Particle Swarm Optimization algorithm (PSO) with mutation operation to train RBFNN. PSO with mutation operation and genetic algorithm are respectively used to train weights and spreads of oRBFNN, which is traditional RBFNN with gradient learning in this article. Sum Square Error (SSE) function is used to evaluate performance of three algorithms, oRBFNN, GA-RBFNN and MuPSO-RBFNN algorithms. Several experiments in function approximation show MuPSO-RBFNN is better than oRBFNN and GA-RBFNN.

[1]  Michael R. Lyu,et al.  A hybrid particle swarm optimization-back-propagation algorithm for feedforward neural network training , 2007, Appl. Math. Comput..

[2]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[3]  Yu Li,et al.  Particle swarm optimisation for evolving artificial neural network , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[4]  Ge Xiurun,et al.  An improved PSO-based ANN with simulated annealing technique , 2005, Neurocomputing.

[5]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[6]  V. Muthukkumarasamy,et al.  Off-line Signature Verification Using an Enhanced Modified Direction Feature with Single and Multi-classifier Approaches , 2007, IEEE Computational Intelligence Magazine.

[7]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[8]  M. Taylan Das,et al.  Signature verification (SV) toolbox: Application of PSO-NN , 2009, Eng. Appl. Artif. Intell..

[9]  Peng-Yeng Yin,et al.  A discrete particle swarm algorithm for optimal polygonal approximation of digital curves , 2004, J. Vis. Commun. Image Represent..

[10]  Chia-Nan Ko,et al.  Time series prediction using RBF neural networks with a nonlinear time-varying evolution PSO algorithm , 2009, Neurocomputing.

[11]  Qiuming Zhu,et al.  A global learning algorithm for a RBF network , 1999, Neural Networks.

[12]  Christian W. Dawson,et al.  A review of genetic algorithms applied to training radial basis function networks , 2004, Neural Computing & Applications.

[13]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[14]  Guido Bugmann,et al.  NEURAL NETWORK DESIGN FOR ENGINEERING APPLICATIONS , 2001 .