A novel particle swarm optimizer hybridized with extremal optimization

Particle swarm optimization (PSO) has received increasing interest from the optimization community due to its simplicity in implementation and its inexpensive computational overhead. However, PSO has premature convergence, especially in complex multimodal functions. Extremal optimization (EO) is a recently developed local-search heuristic method and has been successfully applied to a wide variety of hard optimization problems. To overcome the limitation of PSO, this paper proposes a novel hybrid algorithm, called hybrid PSO-EO algorithm, through introducing EO to PSO. The hybrid approach elegantly combines the exploration ability of PSO with the exploitation ability of EO. We testify the performance of the proposed approach on a suite of unimodal/multimodal benchmark functions and provide comparisons with other meta-heuristics. The proposed approach is shown to have superior performance and great capability of preventing premature convergence across it comparing favorably with the other algorithms.

[1]  A. Percus,et al.  Nature's Way of Optimizing , 1999, Artif. Intell..

[2]  Patrick Siarry,et al.  Particle swarm and ant colony algorithms hybridized for improved continuous optimization , 2007, Appl. Math. Comput..

[3]  Stefan Boettcher,et al.  Optimization with Extremal Dynamics , 2000, Complex..

[4]  Min-Rong Chen,et al.  A novel elitist multiobjective optimization algorithm: Multiobjective extremal optimization , 2008, Eur. J. Oper. Res..

[5]  Min-Rong Chen,et al.  Multiobjective optimization using population-based extremal optimization , 2008, Neural Computing and Applications.

[6]  Thomas Kiel Rasmussen,et al.  Hybrid Particle Swarm Optimiser with breeding and subpopulations , 2001 .

[7]  Andries Petrus Engelbrecht,et al.  Locating multiple optima using particle swarm optimization , 2007, Appl. Math. Comput..

[8]  Jiangye Yuan,et al.  A modified particle swarm optimizer with dynamic adaptation , 2007, Appl. Math. Comput..

[9]  Min-Rong Chen,et al.  Population-Based Extremal Optimization with Adaptive Lévy Mutation for Constrained Optimization , 2006, 2006 International Conference on Computational Intelligence and Security.

[10]  Chun Lu,et al.  An improved GA and a novel PSO-GA-based hybrid algorithm , 2005, Inf. Process. Lett..

[11]  Kwok-Wo Wong,et al.  A novel particle swarm optimizer with time-delay , 2007, Appl. Math. Comput..

[12]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[13]  Shu-Kai S. Fan,et al.  A hybrid simplex search and particle swarm optimization for unconstrained optimization , 2007, Eur. J. Oper. Res..

[14]  M. Senthil Arumugam,et al.  On the improved performances of the particle swarm optimization algorithms with adaptive parameters, cross-over operators and root mean square (RMS) variants for computing optimal control of a class of hybrid systems , 2008, Appl. Soft Comput..

[15]  Tang,et al.  Self-Organized Criticality: An Explanation of 1/f Noise , 2011 .

[16]  Hitoshi Iba,et al.  Particle swarm optimization with Gaussian mutation , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[17]  Yu-Wang Chen,et al.  Hybrid evolutionary algorithm with marriage of genetic algorithm and extremal optimization for production scheduling , 2008 .

[18]  Q. Henry Wu,et al.  MCPSO: A multi-swarm cooperative particle swarm optimizer , 2007, Appl. Math. Comput..

[19]  Kwok-Wo Wong,et al.  An improved particle swarm optimization algorithm combined with piecewise linear chaotic map , 2007, Appl. Math. Comput..

[20]  Douglas B. Kell,et al.  The landscape adaptive particle swarm optimizer , 2008, Appl. Soft Comput..

[21]  Erwie Zahara,et al.  A hybrid genetic algorithm and particle swarm optimization for multimodal functions , 2008, Appl. Soft Comput..

[22]  ChunXia Zhao,et al.  Particle swarm optimization with adaptive population size and its application , 2009, Appl. Soft Comput..

[23]  Konstantinos E. Parsopoulos,et al.  Initializing the Particle Swarm Optimizer Using the Nonlinear Simplex Method , 2002 .

[24]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[25]  K. Parsopoulos,et al.  Stretching technique for obtaining global minimizers through Particle Swarm Optimization , 2001 .

[26]  Stefan Boettcher,et al.  Extremal Optimization: Methods derived from Co-Evolution , 1999, GECCO.

[27]  Stefan Boettcher,et al.  Extremal optimization at the phase transition of the three-coloring problem. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  D. Turcotte,et al.  Self-organized criticality , 1999 .

[29]  Dipti Srinivasan,et al.  Particle Swarm Inspired Evolutionary Algorithm (PS-EA) for Multi-Criteria Optimization Problems , 2003, Evolutionary Multiobjective Optimization.

[30]  Tim Hendtlass,et al.  Solving Problems with Hidden Dynamics – Comparison of Extremal Optimisation and Ant Colony System , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[31]  Yang Genke,et al.  Multiobjective extremal optimization with applications to engineering design , 2007 .

[32]  Peng Chen,et al.  Optimization with extremal dynamics for the traveling salesman problem , 2007 .

[33]  P. J. Angeline,et al.  Using selection to improve particle swarm optimization , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[34]  M. Senthil Arumugam,et al.  A novel and effective particle swarm optimization like algorithm with extrapolation technique , 2009, Appl. Soft Comput..

[35]  Min-Rong Chen,et al.  Studies on Extremal Optimization and Its Applications in Solving RealWorld Optimization Problems , 2007, 2007 IEEE Symposium on Foundations of Computational Intelligence.

[36]  Stefan Boettcher,et al.  Optimizing Glasses with Extremal Dynamics , 2006 .

[37]  Bak,et al.  Punctuated equilibrium and criticality in a simple model of evolution. , 1993, Physical review letters.

[38]  Ajith Abraham,et al.  Chaotic dynamic characteristics in swarm intelligence , 2007, Appl. Soft Comput..

[39]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[40]  Yanchun Liang,et al.  Hybrid evolutionary algorithms based on PSO and GA , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..