Handling boundary constraints for particle swarm optimization in high-dimensional search space

Despite the fact that the popular particle swarm optimizer (PSO) is currently being extensively applied to many real-world problems that often have high-dimensional and complex fitness landscapes, the effects of boundary constraints on PSO have not attracted adequate attention in the literature. However, in accordance with the theoretical analysis in [11], our numerical experiments show that particles tend to fly outside of the boundary in the first few iterations at a very high probability in high-dimensional search spaces. Consequently, the method used to handle boundary violations is critical to the performance of PSO. In this study, we reveal that the widely used random and absorbing bound-handling schemes may paralyze PSO for high-dimensional and complex problems. We also explore in detail the distinct mechanisms responsible for the failures of these two bound-handling schemes. Finally, we suggest that using high-dimensional and complex benchmark functions, such as the composition functions in [19], is a prerequisite to identifying the potential problems in applying PSO to many real-world applications because certain properties of standard benchmark functions make problems inexplicit.

[1]  Suganthan [IEEE 1999. Congress on Evolutionary Computation-CEC99 - Washington, DC, USA (6-9 July 1999)] Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406) - Particle swarm optimiser with neighbourhood operator , 1999 .

[2]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[3]  P. P. Chakrabarti,et al.  Adaptive parameter control of evolutionary algorithms to improve quality-time trade-off , 2009, Appl. Soft Comput..

[4]  Ching-Yi Chen,et al.  Particle swarm optimization algorithm and its application to clustering analysis , 2004, 2012 Proceedings of 17th Conference on Electrical Power Distribution.

[5]  Yujia Wang,et al.  Particle swarm optimization with preference order ranking for multi-objective optimization , 2009, Inf. Sci..

[6]  Jacques Riget,et al.  A Diversity-Guided Particle Swarm Optimizer - the ARPSO , 2002 .

[7]  Yuxin Zhao,et al.  A modified particle swarm optimization via particle visual modeling analysis , 2009, Comput. Math. Appl..

[8]  Y. Rahmat-Samii,et al.  Boundary Conditions in Particle Swarm Optimization Revisited , 2007, IEEE Transactions on Antennas and Propagation.

[9]  Rolf Wanka,et al.  Particle Swarm Optimization in High-Dimensional Bounded Search Spaces , 2007, 2007 IEEE Swarm Intelligence Symposium.

[10]  Magdalene Marinaki,et al.  Ant colony and particle swarm optimization for financial classification problems , 2009, Expert Syst. Appl..

[11]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[12]  Francisco Herrera,et al.  Replacement strategies to preserve useful diversity in steady-state genetic algorithms , 2008, Inf. Sci..

[13]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[14]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[15]  Qidi Wu,et al.  A novel ecological particle swarm optimization algorithm and its population dynamics analysis , 2008, Appl. Math. Comput..

[16]  Bo Liu,et al.  Improved particle swarm optimization combined with chaos , 2005 .

[17]  Soroosh Sorooshian,et al.  Improving the shuffled complex evolution scheme for optimization of complex nonlinear hydrological systems: Application to the calibration of the Sacramento soil‐moisture accounting model , 2010 .

[18]  Bin Li,et al.  Multi-strategy ensemble particle swarm optimization for dynamic optimization , 2008, Inf. Sci..

[19]  Xiao-Feng Xie,et al.  Handling boundary constraints for numerical optimization by particle swarm flying in periodic search space , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[20]  Chia-Feng Juang,et al.  A hybrid of genetic algorithm and particle swarm optimization for recurrent network design , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Wei Chu,et al.  A Solution to the Crucial Problem of Population Degeneration in High-Dimensional Evolutionary Optimization , 2011, IEEE Systems Journal.

[22]  Jianjun Wang,et al.  A steganographic method based upon JPEG and particle swarm optimization algorithm , 2007, Inf. Sci..

[23]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[24]  Jing J. Liang,et al.  Novel composition test functions for numerical global optimization , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[25]  Russell C. Eberhart,et al.  Multiobjective optimization using dynamic neighborhood particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[26]  Sanghamitra Bandyopadhyay,et al.  Multi-Objective Particle Swarm Optimization with time variant inertia and acceleration coefficients , 2007, Inf. Sci..

[27]  Y. Rahmat-Samii,et al.  Particle swarm optimization in electromagnetics , 2004, IEEE Transactions on Antennas and Propagation.

[28]  Junyan Wang,et al.  Nonlinear Inertia Weight Variation for Dynamic Adaptation in Particle Swarm Optimization , 2011, ICSI.

[29]  Andries Petrus Engelbrecht,et al.  A study of particle swarm optimization particle trajectories , 2006, Inf. Sci..

[30]  T. Huang,et al.  A hybrid boundary condition for robust particle swarm optimization , 2005, IEEE Antennas and Wireless Propagation Letters.

[31]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[32]  Imtiaz Ahmad,et al.  Particle swarm optimization for task assignment problem , 2002, Microprocess. Microsystems.

[33]  Joong-Rin Shin,et al.  A particle swarm optimization for economic dispatch with nonsmooth cost functions , 2005, IEEE Transactions on Power Systems.

[34]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[35]  Russell C. Eberhart,et al.  Tracking and optimizing dynamic systems with particle swarms , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[36]  Jacek M. Zurada,et al.  An approach to multimodal biomedical image registration utilizing particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.