The performance verification of an evolutionary canonical particle swarm optimizer

We previously proposed to introduce evolutionary computation into particle swarm optimization (PSO), named evolutionary PSO (EPSO). It is well known that a constricted version of PSO, i.e., a canonical particle swarm optimizer (CPSO), has good convergence property compared with PSO. For further improving the search performance of an CPSO, we propose in this paper a new method called an evolutionary canonical particle swarm optimizer (ECPSO) using the meta-optimization proposed in EPSO. The ECPSO is expected to be an optimized CPSO in that optimized values of parameters are used in the CPSO. We also introduce a temporally cumulative fitness function into the ECPSO to reduce stochastic fluctuation in evaluating the fitness function. Our experimental results indicate that (1) the optimized values of parameters are quite different from those in the conventional CPSO; (2) the search performance by the ECPSO, i.e., the optimized CPSO, is superior to that by CPSO, OPSO, EPSO, and RGA/E except for the Rastrigin problem.

[1]  James Kennedy.  In Search of the Essential Particle Swarm , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[2]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[3]  Hong Zhang,et al.  Evolutionary Particle Swarm Optimization (EPSO) - Estimation of Optimal PSO Parameters by GA , 2007, IMECS.

[4]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[5]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[6]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[7]  M. Clerc,et al.  Particle Swarm Optimization , 2006 .

[8]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[9]  Martin Middendorf,et al.  A hierarchical particle swarm optimizer and its adaptive variant , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Roberto Battiti,et al.  The gregarious particle swarm optimizer (G-PSO) , 2006, GECCO '06.

[11]  Hong Zhang,et al.  Performance Improvement of Hybrid Real-Coded Genetic Algorithm with Local Search and Its Applications , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[12]  Wenjun Zhang,et al.  Dissipative particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[13]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[14]  Andries Petrus Engelbrecht,et al.  Particle swarm optimization with spatially meaningful neighbours , 2008, 2008 IEEE Swarm Intelligence Symposium.

[15]  Daniele Peri,et al.  Particle Swarm Optimization: efficient globally convergent modifications , 2006 .

[16]  João Folgado,et al.  III European Conference on Computational Mechanics , 2006 .

[17]  Gisbert Schneider,et al.  Optimized Particle Swarm Optimization (OPSO) and its application to artificial neural network training , 2006, BMC Bioinformatics.

[18]  Lifeng Xi,et al.  Evolving artificial neural networks using an improved PSO and DPSO , 2008, Neurocomputing.

[19]  Hong Zhang,et al.  Evolutionary Canonical Particle Swarm Optimizer - A Proposal of Meta-optimization in Model Selection , 2008, ICANN.

[20]  R Spina,et al.  OPTIMIZATION OF INJECTION MOLDED PARTS BY USING ANN-PSO APPROACH , 2006 .

[21]  Riccardo Poli,et al.  Particle Swarm Optimisation , 2011 .

[22]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[23]  Michael N. Vrahatis,et al.  Recent approaches to global optimization problems through Particle Swarm Optimization , 2002, Natural Computing.

[24]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[25]  Ajith Abraham,et al.  Swarm Intelligence: Foundations, Perspectives and Applications , 2006, Swarm Intelligent Systems.

[26]  Michael N. Vrahatis,et al.  Tuning PSO Parameters Through Sensitivity Analysis , 2002 .

[27]  Sung-Bae Cho,et al.  A comprehensive survey on functional link neural networks and an adaptive PSO–BP learning for CFLNN , 2010, Neural Computing and Applications.

[28]  M Reyes Sierra,et al.  Multi-Objective Particle Swarm Optimizers: A Survey of the State-of-the-Art , 2006 .

[29]  Hong Zhang,et al.  Designing Particle Swarm Optimization: performance comparison of two temporally cumulative fitness functions in EPSO , 2008 .

[30]  M Ishikawa,et al.  Evolutionary Particle Swarm Optimization: A Metaoptimization Method with GA for Estimating Optimal PSO Models , 2008 .