A novel differential evolution scheme combined with particle swarm intelligence

Differential evolution (DE) and particle swarm optimization (PSO) are the evolutionary computation paradigms, and both have shown superior performance on complex nonlinear function optimization problems. This paper detects the underlying relationship between them and then qualitatively proves that the two heuristic approaches from different theoretical background are consistent in form. Within the general perspective, the PSO can be regarded as a kind of DE. Inspired by this, a novel variant of DE mixed with particle swarm intelligence (DE-SI) is presented. Comparison experiments involving ten test functions well studied in the evolutionary optimization literature are used to highlight some performance differences between the DE-SI, two versions of DE and two PSO variants. The results from our study show that DE-SI keeps the most rapid convergence rate of all techniques and obtains the global optima for most benchmark problems.

[1]  S. Kannan,et al.  Application and comparison of metaheuristic techniques to generation expansion planning problem , 2005, IEEE Transactions on Power Systems.

[2]  Xiao-Feng Xie,et al.  DEPSO: hybrid particle swarm with differential evolution operator , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[3]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[4]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[5]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[6]  J.G. Vlachogiannis,et al.  A Comparative Study on Particle Swarm Optimization for Optimal Steady-State Performance of Power Systems , 2006, IEEE Transactions on Power Systems.

[7]  Amit Konar,et al.  Two improved differential evolution schemes for faster global search , 2005, GECCO '05.

[8]  Hussein A. Abbass,et al.  An evolutionary artificial neural networks approach for breast cancer diagnosis , 2002, Artif. Intell. Medicine.

[9]  Han Huang,et al.  A Particle Swarm Optimization Algorithm with Differential Evolution , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[10]  Tim Hendtlass,et al.  A Combined Swarm Differential Evolution Algorithm for Optimization Problems , 2001, IEA/AIE.

[11]  M. Batouche,et al.  Hybrid particle swarm with differential evolution for multimodal image registration , 2004, 2004 IEEE International Conference on Industrial Technology, 2004. IEEE ICIT '04..

[12]  Andries Petrus Engelbrecht,et al.  Differential Evolution Based Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[14]  Hakan Temeltas,et al.  Fuzzy-differential evolution algorithm for planning time-optimal trajectories of a unicycle mobile robot on a predefined path , 2004, Adv. Robotics.

[15]  Jacques Riget,et al.  A Diversity-Guided Particle Swarm Optimizer - the ARPSO , 2002 .

[16]  Ying Zhao,et al.  Particle swarm optimization algorithm in signal detection and blind extraction , 2004, 7th International Symposium on Parallel Architectures, Algorithms and Networks, 2004. Proceedings..

[17]  Alcherio Martinoli,et al.  Inspiring and Modeling Multi-Robot Search with Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[18]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[19]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[20]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[21]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[22]  R. Storn.  Designing nonstandard filters with differential evolution , 2005, IEEE Signal Process. Mag..

[23]  Amit Konar,et al.  Improving particle swarm optimization with differentially perturbed velocity , 2005, GECCO '05.

[24]  Xie Xiao-feng.  Empirical study of differential evolution , 2004 .

[25]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .