Differential evolution with individual-dependent topology adaptation

Abstract Differential evolution (DE) is an efficient and robust evolutionary algorithm (EA), that has been widely and successfully applied to solve global optimization problems in diverse real-world applications. As the population structure has a major influence on the behavior of an EA, effectively incorporating population topology into DE has recently attracted increasing attention. Previous works have shown the effectiveness of different topologies in improving the performance of DE and revealed that different topologies can have different effects on the population’s ability to solve optimization problems. However, the synergy of different topologies for the problems being solved has not been systematically investigated in most DE variants. Moreover, individuals with different fitness values play different roles in guiding the search during the evolutionary process. Nevertheless, the individual-dependent roles are not considered in most DE variants that consider the population topology. To overcome these drawbacks and utilize the information that is derived from the differences between the fitness values of individuals for topology adaption, we propose a multi-topology-based DE (MTDE) algorithm that includes an ensemble of multiple population topologies (MPT), an individual-dependent adaptive topology selection (ITS) scheme, and a topology-dependent mutation (TDM) strategy. In the ensemble of MPT, multiple population topologies with different degrees of connectivity are employed. In the ITS scheme, each individual adaptively selects the topology that is most compatible its role in guiding the search based on its fitness value. In the TDM strategy, the parents for mutation are chosen from the neighborhood of the current individual based on the corresponding topology to generate offspring. The effectiveness of the proposed algorithm is extensively evaluated on a suite of benchmark functions. Experimental results demonstrate the competitive performance of MTDE when compared with other state-of-the-art DE variants and EAs.

[1]  Pascal Bouvry,et al.  Study of different small-world topology generation mechanisms for Genetic Algorithms , 2012, 2012 IEEE Congress on Evolutionary Computation.

[2]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[3]  Jun Zhang,et al.  Distributed Differential Evolution Based on Adaptive Mergence and Split for Large-Scale Optimization , 2018, IEEE Transactions on Cybernetics.

[4]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[5]  Yansheng Li,et al.  Performance of Distributed Switch-and-Stay Combining for Cognitive Relay Networks with Primary Transceiver , 2017, Wirel. Pers. Commun..

[6]  Yiqiao Cai,et al.  A Novel Neighborhood-Dependent Mutation Operator for Differential Evolution , 2017, 22017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC).

[7]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[8]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[9]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[10]  Yu Sun,et al.  A Novel Differential Evolution Algorithm with Adaptive of Population Topology , 2012, ICICA.

[11]  Ivanoe De Falco,et al.  Exploiting diversity in an asynchronous migration model for distributed differential evolution , 2017, GECCO.

[12]  Mohammad Reza Meybodi,et al.  CellularDE: A Cellular Based Differential Evolution for Dynamic Optimization Problems , 2011, ICANNGA.

[13]  Hui Tian,et al.  Neighborhood-adaptive differential evolution for global numerical optimization , 2017, Appl. Soft Comput..

[14]  István Erlich,et al.  Hybrid Mean-Variance Mapping Optimization for solving the IEEE-CEC 2013 competition problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[15]  Houfeng Wang,et al.  Model approach to grammatical evolution: theory and case study , 2016, Soft Comput..

[16]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[17]  Ville Tirronen,et al.  A study on scale factor in distributed differential evolution , 2011, Inf. Sci..

[18]  Dirk Thierens,et al.  An Adaptive Pursuit Strategy for Allocating Operator Probabilities , 2005, BNAIC.

[19]  Yiqiao Cai,et al.  Differential Evolution With Neighborhood and Direction Information for Numerical Optimization , 2013, IEEE Transactions on Cybernetics.

[20]  Meng Zhao,et al.  Neighborhood guided differential evolution , 2016, Soft Computing.

[21]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[22]  Andries Petrus Engelbrecht,et al.  Bare bones differential evolution , 2009, Eur. J. Oper. Res..

[23]  Jin Li,et al.  Model approach to grammatical evolution: deep-structured analyzing of model and representation , 2016, Soft Computing.

[24]  Zhaoquan Cai,et al.  Facial age estimation by using stacked feature composition and selection , 2016, The Visual Computer.

[25]  Yonghong Chen,et al.  Cellular direction information based differential evolution for numerical optimization: an empirical study , 2015, Soft Computing.

[26]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[27]  Yunfei Chen,et al.  On Secrecy Performance of MISO SWIPT Systems With TAS and Imperfect CSI , 2016, IEEE Transactions on Communications.

[28]  Jun Zhang,et al.  Small-world particle swarm optimization with topology adaptation , 2013, GECCO '13.

[29]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[30]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[31]  Giovanni Iacca,et al.  A CMA-ES super-fit scheme for the re-sampled inheritance search , 2013, 2013 IEEE Congress on Evolutionary Computation.

[32]  David E. Goldberg,et al.  Probability Matching, the Magnitude of Reinforcement, and Classifier System Bidding , 1990, Machine Learning.

[33]  Hitoshi Iba,et al.  Cellular Differential Evolution Algorithm , 2010, Australasian Conference on Artificial Intelligence.

[34]  Yiqiao Cai,et al.  Differential Evolution Enhanced With Multiobjective Sorting-Based Mutation Operators , 2014, IEEE Transactions on Cybernetics.

[35]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[36]  Pascal Bouvry,et al.  Improving Classical and Decentralized Differential Evolution With New Mutation Operator and Population Topologies , 2011, IEEE Transactions on Evolutionary Computation.

[37]  Ville Tirronen,et al.  Distributed differential evolution with explorative–exploitative population families , 2009, Genetic Programming and Evolvable Machines.

[38]  Dimitris K. Tasoulis,et al.  Parallel differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[39]  Zhigang Shang,et al.  Memetic differential evolution based on fitness Euclidean-distance ratio , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[40]  Ponnuthurai N. Suganthan,et al.  An Adaptive Differential Evolution Algorithm With Novel Mutation and Crossover Strategies for Global Numerical Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[41]  Andries Petrus Engelbrecht,et al.  A self-adaptive heterogeneous pso for real-parameter optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[42]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[43]  Alex S. Fukunaga,et al.  Evaluating the performance of SHADE on CEC 2013 benchmark problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[44]  Dana Petcu,et al.  Adaptive Pareto Differential Evolution and Its Parallelization , 2003, PPAM.

[45]  István Erlich,et al.  Evaluating the Mean-Variance Mapping Optimization on the IEEE-CEC 2014 test suite , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[46]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[47]  Ruhul A. Sarker,et al.  A genetic algorithm for solving the CEC'2013 competition problems on real-parameter optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[48]  Andries Petrus Engelbrecht,et al.  Using the Ring Neighborhood Topology with Self-adaptive Differential Evolution , 2006, ICNC.

[49]  Dimitris K. Tasoulis,et al.  A Review of Major Application Areas of Differential Evolution , 2008 .