Designing Neural Networks Using PSO-Based Memetic Algorithm

This paper proposes an effective particle swarm optimization (PSO) based memetic algorithm (MA) for designing artificial neural network. In the proposed PSO-based MA (PSOMA), not only the evolutionary searching mechanism of PSO characterized by individual improvement plus population cooperation and competition is applied to perform the global search, but also several adaptive high-performance faster training algorithms are employed to enhance the local search, so that the exploration and exploitation abilities of PSOMA can be well balanced. Moreover, an effective adaptive Meta-Lamarckian learning strategy is employed to decide which local search method to be used so as to prevent the premature convergence and concentrate computing effort on promising neighbor solutions. Simulation results and comparisons demonstrate the effectiveness and efficiency of the proposed PSOMA.

[1]  Gerald W. Kimble,et al.  Information and Computer Science , 1975 .

[2]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[3]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[4]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[5]  Andy J. Keane,et al.  Meta-Lamarckian learning in memetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[6]  Zhang Yi,et al.  Advances in Neural Networks - ISNN 2005, Second International Symposium on Neural Networks, Chongqing, China, May 30 - June 1, 2005, Proceedings, Part II , 2005, ISNN.

[7]  Huang Dexian,et al.  Advances in Particle Swarm Optimization Algorithm , 2005 .

[8]  Dexian Huang,et al.  Designing Neural Networks Using Hybrid Particle Swarm Optimization , 2005, ISNN.

[9]  Bo Liu,et al.  Improved particle swarm optimization combined with chaos , 2005 .

[10]  Bo Liu,et al.  Directing orbits of chaotic systems by particle swarm optimization , 2006 .

[11]  Kevin Kok Wai Wong,et al.  Classification of adaptive memetic algorithms: a comparative study , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Bo Liu,et al.  An Effective PSO-Based Memetic Algorithm for Flow Shop Scheduling , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).