Hybridizing Differential Evolution Variants Through Heterogeneous Mixing in a Distributed Framework

While hybridizing the complementary constituent soft computing techniques has displayed improved efficacy, the hybridization of complementary characteristics of different Differential Evolution (DE) variants (could as well be extended to evolutionary algorithms variants in general) through heterogeneous mixing in a distributed framework also holds a great potential. This chapter proposes to mix competitive DE variants with diverse characteristics in a distributed framework as against the typical distributed (homogeneous) Differential Evolution (dDE) algorithms found in DE literature. After an empirical analysis of 14 classical DE variants on 14 test functions, two heterogeneous dDE frameworks dDE_HeM_best and dDE_HeM_worst obtained by mixing best DE variants and worst DE variants, respectively, have been realized, implemented and tested on the benchmark optimization problems. The simulation results have validated the robustness of the heterogeneous mixing of best variants. The chapter also hybridized DE and dynamic DE variants in a distributed framework. The robustness of the resulting framework has been validated by benchmarking it against the state-of-the-art DE algorithms in the literature.

[1]  Anyong Qing.  A study on base vector for differential evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[2]  C. Shunmuga Velayutham,et al.  An Empirical Performance Analysis of Differential Evolution Variants on Unconstrained Global Optimization Problems , 2010, CISIM 2010.

[3]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[4]  Haibin Duan,et al.  DEACO: Hybrid Ant Colony Optimization with Differential Evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[5]  Jing Xiao,et al.  Classification-based self-adaptive differential evolution with fast and reliable convergence performance , 2011, Soft Comput..

[6]  Xin Yao,et al.  Self-adaptive differential evolution with neighborhood search , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[7]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[8]  Amit Konar,et al.  Annealed Differential Evolution , 2007, 2007 IEEE Congress on Evolutionary Computation.

[9]  Xin Yao,et al.  Making a Difference to Differential Evolution , 2008, Advances in Metaheuristics for Hard Optimization.

[10]  N. P. Padhy,et al.  Application of particle swarm optimization technique and its variants to generation expansion planning problem , 2004 .

[11]  Russell C. Eberhart,et al.  Evolutionary Computation Theory and Paradigms , 2001 .

[12]  Ji-Pyng Chiou,et al.  Ant direction hybrid differential evolution for solving large capacitor placement problems , 2004 .

[13]  Amit Konar,et al.  Improving particle swarm optimization with differentially perturbed velocity , 2005, GECCO '05.

[14]  X. Yao,et al.  Fast evolutionary algorithms , 2003 .

[15]  Vitaliy Feoktistov.  Differential Evolution: In Search of Solutions , 2006 .

[16]  Kevin M. Passino,et al.  Biomimicry of bacterial foraging for distributed optimization and control , 2002 .

[17]  Shengwu Xiong,et al.  Self-adaptive Hybrid differential evolution with simulated annealing algorithm for numerical optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[18]  Anyong Qing,et al.  Dynamic differential evolution strategy and applications in electromagnetic inverse scattering problems , 2006, IEEE Trans. Geosci. Remote. Sens..

[19]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[20]  Ganesh K. Venayagamoorthy,et al.  Evolving Digital Circuits Using Hybrid Particle Swarm Optimization and Differential Evolution , 2006, Int. J. Neural Syst..

[21]  D. Dasgupta.  Artificial Immune Systems and Their Applications , 1998, Springer Berlin Heidelberg.

[22]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[23]  Andries Petrus Engelbrecht,et al.  Bare bones differential evolution , 2009, Eur. J. Oper. Res..

[24]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[25]  Francisco Herrera,et al.  Gradual distributed real-coded genetic algorithms , 2000, IEEE Trans. Evol. Comput..

[26]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[27]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[28]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[29]  Kenneth V. Price,et al.  An introduction to differential evolution , 1999 .

[30]  P. Suganthan,et al.  Differential evolution algorithm with ensemble of populations for global numerical optimization , 2009 .

[31]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[32]  Ville Tirronen,et al.  Distributed differential evolution with explorative–exploitative population families , 2009, Genetic Programming and Evolvable Machines.

[33]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[34]  Han Huang,et al.  A Particle Swarm Optimization Algorithm with Differential Evolution , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[35]  Tim Hendtlass,et al.  A Combined Swarm Differential Evolution Algorithm for Optimization Problems , 2001, IEA/AIE.

[36]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[37]  Nikolaus Hansen,et al.  Compilation of Results on the 2005 CEC Benchmark Function Set , 2005 .

[38]  Xing Xu,et al.  A novel differential evolution scheme combined with particle swarm intelligence , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[39]  Lin Han,et al.  A novel binary differential evolution algorithm based on artificial immune system , 2007, 2007 IEEE Congress on Evolutionary Computation.

[40]  Xiao-Feng Xie,et al.  DEPSO: hybrid particle swarm with differential evolution operator , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[41]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[42]  Feng-Sheng Wang,et al.  Hybrid method of evolutionary algorithms for static and dynamic optimization problems with application to a fed-batch fermentation process , 1999 .

[43]  C. Shunmuga Velayutham,et al.  A Comparative Study on Theoretical and Empirical Evolution of Population Variance of Differential Evolution Variants , 2010, SEAL.

[44]  James Kennedy,et al.  Bare bones particle swarms , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[45]  Arthur C. Sanderson,et al.  JADE: Self-adaptive differential evolution with fast and reliable convergence performance , 2007, 2007 IEEE Congress on Evolutionary Computation.

[46]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[47]  Jing Xiao,et al.  P-ADE: Self-adaptive differential evolution with fast and reliable convergence performance , 2010, 2010 The 2nd International Conference on Industrial Mechatronics and Automation.