Competition-Based Distributed Differential Evolution

Differential evolution (DE) is a simple and efficient evolutionary algorithm for global optimization. In distributed differential evolution (DDE), the population is divided into several sub-populations and each sub-population evolves independently for enhancing algorithmic performance. Through sharing elite individuals between sub-populations, effective information is spread. However, the information exchanged through individuals is still too limited. To address this issue, a competition-based strategy is proposed in this paper to achieve comprehensive interaction between sub-populations. Two operators named opposition-invasion and cross-invasion are designed to realize the invasion from good performing sub-populations to bad performing subpopulations. By utilizing opposite invading sub-population, the search efficiency at promising regions is improved by opposition-invasion. In cross-invasion, information from both invading and invaded sub-populations is combined and population diversity is maintained. Moreover, the proposed algorithm is implemented in a parallel master-slave manner. Extensive experiments are conducted on 15 widely used large-scale benchmark functions. Experimental results demonstrate that the proposed competition-based DDE (DDE-CB) could achieve competitive or even better performance compared with several state-of-the-art DDE algorithms. The effect of proposed competition-based strategy cooperation with well-known DDE variants is also verified.

[1]  Ivanoe De Falco,et al.  Biological invasion-inspired migration in distributed evolutionary algorithms , 2012, Inf. Sci..

[2]  César Hervás-Martínez,et al.  COVNET: a cooperative coevolutionary model for evolving artificial neural networks , 2003, IEEE Trans. Neural Networks.

[3]  G. Leguizamon,et al.  Island Based Distributed Differential Evolution: An Experimental Study on Hybrid Testbeds , 2008, 2008 Eighth International Conference on Hybrid Intelligent Systems.

[4]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[5]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[6]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[7]  Zhiwen Yu,et al.  Enhancing distributed differential evolution with a space-driven topology , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[8]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[9]  Janez Brest,et al.  Structured Population Size Reduction Differential Evolution with Multiple Mutation Strategies on CEC 2013 real parameter optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[10]  Ivanoe De Falco,et al.  Satellite Image Registration by Distributed Differential Evolution , 2007, EvoWorkshops.

[11]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[12]  Chia-Feng Juang,et al.  An Interpretable Fuzzy System Learned Through Online Rule Generation and Multiobjective ACO With a Mobile Robot Control Application , 2016, IEEE Transactions on Cybernetics.

[13]  Wei-jie Yu,et al.  A tri-objective differential evolution approach for multimodal optimization , 2018, Inf. Sci..

[14]  Ville Tirronen,et al.  Shuffle or update parallel differential evolution for large-scale optimization , 2011, Soft Comput..

[15]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[16]  Dario Izzo,et al.  Parallel global optimisation meta-heuristics using an asynchronous island-model , 2009, 2009 IEEE Congress on Evolutionary Computation.

[17]  Meie Shen,et al.  Differential Evolution With Two-Level Parameter Adaptation , 2014, IEEE Transactions on Cybernetics.

[18]  Gexiang Zhang,et al.  Enhancing distributed differential evolution with multicultural migration for global numerical optimization , 2013, Inf. Sci..

[19]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[20]  A. F. Ioffe,et al.  NEW MIGRATION SCHEME FOR PARALLEL DIFFERENTIAL EVOLUTION , 2006 .

[21]  Shengxiang Yang,et al.  An Improved Multiobjective Optimization Evolutionary Algorithm Based on Decomposition for Complex Pareto Fronts , 2016, IEEE Transactions on Cybernetics.

[22]  Mengjie Zhang,et al.  Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach , 2013, IEEE Transactions on Cybernetics.

[23]  Dimitris K. Tasoulis,et al.  Parallel differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[24]  Ville Tirronen,et al.  Distributed differential evolution with explorative–exploitative population families , 2009, Genetic Programming and Evolvable Machines.

[25]  Jun Zhang,et al.  Distributed Differential Evolution Based on Adaptive Mergence and Split for Large-Scale Optimization , 2018, IEEE Transactions on Cybernetics.

[26]  Guohua Wu,et al.  Differential evolution with multi-population based ensemble of mutation strategies , 2016, Inf. Sci..