A hybrid particle swarm optimization algorithm for high-dimensional problems

In recent years, particle swarm optimization (PSO) emerges as a new optimization scheme that has attracted substantial research interest due to its simplicity and efficiency. However, when applied to high-dimensional problems, PSO suffers from premature convergence problem which results in a low optimization precision or even failure. To remedy this fault, this paper proposes a novel memetic PSO (CGPSO) algorithm which combines the canonical PSO with a Chaotic and Gaussian local search procedure. In the initial evolution phase, CGPSO explores a wide search space that helps avoid premature convergence through Chaotic local search. Then in the following run phase, CGPSO refines the solutions through Gaussian optimization. To evaluate the effectiveness and efficiency of the CGPSO algorithm, thirteen high dimensional non-linear scalable benchmark functions were examined. Results show that, compared to the standard PSO, CGPSO is more effective, faster to converge, and less sensitive to the function dimensions. The CGPSO was also compared with two PSO variants, CPSO-H, DMS-L-PSO, and two memetic optimizers, DEachSPX and MA-S2. CGPSO is able to generate a better, or at least comparable, performance in terms of optimization accuracy. So it can be safely concluded that the proposed CGPSO is an efficient optimization scheme for solving high-dimensional problems.

[1]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[2]  Kui Li,et al.  FIR digital filters design based on Chaotic Mutation Particle Swarm Optimization , 2008, 2008 International Conference on Audio, Language and Image Processing.

[3]  Jia Dong-li,et al.  Niche particle swarm optimization combined with chaotic mutation , 2007 .

[4]  Deming Lei,et al.  A Pareto archive particle swarm optimization for multi-objective job shop scheduling , 2008, Comput. Ind. Eng..

[5]  Mohammad Saleh Tavazoei,et al.  Comparison of different one-dimensional maps as chaotic search pattern in chaos optimization algorithms , 2007, Appl. Math. Comput..

[6]  Lihong Li,et al.  Particle Swarm Optimization Combined with Chaotic and Gaussian Mutation , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[7]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[8]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for solving multiobjective optimization problems , 2006, Int. J. Intell. Syst..

[9]  Chen Tian-Lun,et al.  Application of Chaos in Genetic Algorithms , 2002 .

[10]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[11]  W. Chang PID control for chaotic synchronization using particle swarm optimization , 2009 .

[12]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[13]  Wang Ling Survey on Chaotic Optimization Methods , 2001 .

[14]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[15]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[16]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[17]  Tomasz Kapitaniak,et al.  Continuous control and synchronization in chaotic systems , 1995 .

[18]  Ponnuthurai Nagaratnam Suganthan,et al.  Comprehensive learning particle swarm optimizer for solving multiobjective optimization problems: Research Articles , 2006 .

[19]  Gwo-Ching Liao,et al.  Application of a fuzzy neural network combined with a chaos genetic algorithm and simulated annealing to short-term load forecasting , 2006, IEEE Transactions on Evolutionary Computation.

[20]  Karl-Dirk Kammeyer,et al.  Optimization of Power Allocation for Interference Cancellation With Particle Swarm Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[21]  Andries Petrus Engelbrecht,et al.  A study of particle swarm optimization particle trajectories , 2006, Inf. Sci..

[22]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[23]  P. K. Chattopadhyay,et al.  Evolutionary programming techniques for economic load dispatch , 2003, IEEE Trans. Evol. Comput..

[24]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[25]  Yun Shang,et al.  A Note on the Extended Rosenbrock Function , 2006 .

[26]  Guo Guanqi,et al.  Evolutionary parallel local search for function optimization , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[27]  Jing J. Liang,et al.  Dynamic Multi-Swarm Particle Swarm Optimizer with a Novel Constraint-Handling Mechanism , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[28]  Peter Vamplew,et al.  Accelerating Real-Valued Genetic Algorithms Using Mutation-with-Momentum , 2005, Australian Conference on Artificial Intelligence.

[29]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[30]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[31]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[32]  Andy J. Keane,et al.  Meta-Lamarckian learning in memetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.