Neighborhood-adaptive differential evolution for global numerical optimization

Abstract In this study, we consider the scenario that differential evolution (DE) is applied for global numerical optimization and the index-based neighborhood information of population is used for enhancing the performance of DE. Although many methods are developed under this scenario, neighborhood information of current population has not been systematically exploited in the DE algorithm design. Furthermore, previous studies have shown the effect of neighborhood topology interacted with the function being solved. However, there are few investigations of DE that consider different topologies for different functions during the evolutionary process. Motivated by these observations, a new DE framework, named neighborhood-adaptive DE (NaDE), is presented. In NaDE, a pool of index-based neighborhood topologies is firstly used to define multiple neighborhood relationships for each individual and then the neighborhood relationships are adaptively selected for the specific functions during the evolutionary process. In this way, a more appropriate neighborhood relationship for each individual can be determined adaptively to match different phases of the search process for the function being solved. After that, a neighborhood-dependent directional mutation operator is introduced into NaDE to generate a new solution with the selected neighborhood topology. Being a general framework, NaDE is easy to implement and can be realized with most existing DE algorithms. In order to test the effectiveness of the proposed framework, we have evaluated NaDE via investigating several instantiations of it. Experimental results have shown that NaDE generally outperforms its corresponding DE algorithm on different kinds of optimization problems. Moreover, the synergy among different neighborhood topologies in NaDE is also revealed when compared with the DE variants with single neighborhood topology.

[1]  Yiqiao Cai,et al.  Differential evolution with hybrid linkage crossover , 2015, Inf. Sci..

[2]  Amer Draa,et al.  A sinusoidal differential evolution algorithm for numerical optimisation , 2015, Appl. Soft Comput..

[3]  Alex S. Fukunaga,et al.  Evaluating the performance of SHADE on CEC 2013 benchmark problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[4]  Wei Luo,et al.  Adaptive direction information in differential evolution for numerical optimization , 2016, Soft Comput..

[5]  István Erlich,et al.  Evaluating the Mean-Variance Mapping Optimization on the IEEE-CEC 2014 test suite , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[6]  Min-Yuan Cheng,et al.  Hybrid multiple objective artificial bee colony with differential evolution for the time-cost-quality tradeoff problem , 2015, Knowl. Based Syst..

[7]  Hitoshi Iba,et al.  Cellular Differential Evolution Algorithm , 2010, Australasian Conference on Artificial Intelligence.

[8]  Souvik Kundu,et al.  Differential Evolution with a Relational Neighbourhood-Based Strategy for Numerical Optimization , 2012, SEMCCO.

[9]  Zhigang Shang,et al.  Memetic differential evolution based on fitness Euclidean-distance ratio , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[10]  Mohammad Reza Meybodi,et al.  CellularDE: A Cellular Based Differential Evolution for Dynamic Optimization Problems , 2011, ICANNGA.

[11]  Athanasios V. Vasilakos,et al.  Information sharing in bee colony for detecting multiple niches in non-stationary environments , 2013, GECCO.

[12]  Jouni Lampinen,et al.  A Trigonometric Mutation Operation to Differential Evolution , 2003, J. Glob. Optim..

[13]  Ponnuthurai N. Suganthan,et al.  Synchronizing Differential Evolution with a modified affinity-based mutation framework , 2013, 2013 IEEE Symposium on Differential Evolution (SDE).

[14]  Jing Xiao,et al.  Classification-based self-adaptive differential evolution with fast and reliable convergence performance , 2011, Soft Comput..

[15]  Adam P. Piotrowski,et al.  Adaptive Memetic Differential Evolution with Global and Local neighborhood-based mutation operators , 2013, Inf. Sci..

[16]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[17]  Dimitris K. Tasoulis,et al.  A Review of Major Application Areas of Differential Evolution , 2008 .

[18]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[19]  Yuren Zhou,et al.  Differential evolution with guiding archive for global numerical optimization , 2016, Appl. Soft Comput..

[20]  Yiqiao Cai,et al.  Differential Evolution With Neighborhood and Direction Information for Numerical Optimization , 2013, IEEE Transactions on Cybernetics.

[21]  Yonghong Chen,et al.  Cellular direction information based differential evolution for numerical optimization: an empirical study , 2016, Soft Comput..

[22]  Ivanoe De Falco,et al.  Impact of the Topology on the Performance of Distributed Differential Evolution , 2014, EvoApplications.

[23]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[24]  Xinye Cai,et al.  An improved memetic algorithm using ring neighborhood topology for constrained optimization , 2014, Soft Comput..

[25]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[26]  Zhao Yang Dong,et al.  Power system fault diagnosis based on history driven differential evolution and stochastic time domain simulation , 2014, Inf. Sci..

[27]  Yiqiao Cai,et al.  Learning-enhanced differential evolution for numerical optimization , 2012, Soft Comput..

[28]  Swagatam Das,et al.  An Improved Parent-Centric Mutation With Normalized Neighborhoods for Inducing Niching Behavior in Differential Evolution , 2014, IEEE Transactions on Cybernetics.

[29]  David E. Goldberg,et al.  Probability Matching, the Magnitude of Reinforcement, and Classifier System Bidding , 1990, Machine Learning.

[30]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[31]  M. Frank Norman,et al.  Probability matching , 1966 .

[32]  Yu-Xuan Wang,et al.  Exploring new learning strategies in Differential Evolution algorithm , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[33]  Shiu Yin Yuen,et al.  A directional mutation operator for differential evolution algorithms , 2015, Appl. Soft Comput..

[34]  Pascal Bouvry,et al.  Improving Classical and Decentralized Differential Evolution With New Mutation Operator and Population Topologies , 2011, IEEE Transactions on Evolutionary Computation.

[35]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[36]  Giovanni Iacca,et al.  Disturbed Exploitation compact Differential Evolution for limited memory optimization problems , 2011, Inf. Sci..

[37]  Sahand Ghavidel,et al.  Modified teaching learning algorithm and double differential evolution algorithm for optimal reactive power dispatch problem: A comparative study , 2014, Inf. Sci..

[38]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[39]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[40]  Giovanni Iacca,et al.  A CMA-ES super-fit scheme for the re-sampled inheritance search , 2013, 2013 IEEE Congress on Evolutionary Computation.

[41]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[42]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[43]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[44]  Yu Sun,et al.  A Novel Differential Evolution Algorithm with Adaptive of Population Topology , 2012, ICICA.

[45]  István Erlich,et al.  Hybrid Mean-Variance Mapping Optimization for solving the IEEE-CEC 2013 competition problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[46]  Swagatam Das,et al.  An Adaptive Clustering and Re-clustering Based Crowding Differential Evolution for Continuous Multi-modal Optimization , 2015 .

[47]  Stefan Janaqi,et al.  Generalization of the strategies in differential evolution , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[48]  Swagatam Das,et al.  Inducing Niching Behavior in Differential Evolution Through Local Information Sharing , 2015, IEEE Transactions on Evolutionary Computation.

[49]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[50]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[51]  Jie Chen,et al.  Hybridizing Differential Evolution and Particle Swarm Optimization to Design Powerful Optimizers: A Review and Taxonomy , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[52]  Wenyin Gong,et al.  Differential Evolution With Ranking-Based Mutation Operators , 2013, IEEE Transactions on Cybernetics.

[53]  Ruhul A. Sarker,et al.  A genetic algorithm for solving the CEC'2013 competition problems on real-parameter optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[54]  Hui Tian,et al.  Differential Evolution Enhanced with Composite Population Information Based Mutation Operators , 2015 .

[55]  Yiqiao Cai,et al.  Differential Evolution Enhanced With Multiobjective Sorting-Based Mutation Operators , 2014, IEEE Transactions on Cybernetics.

[56]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[57]  Dirk Thierens,et al.  An Adaptive Pursuit Strategy for Allocating Operator Probabilities , 2005, BNAIC.

[58]  Silvestre Fialho,et al.  Adaptive operator selection for optimization , 2010 .

[59]  Hui Li,et al.  Adaptive strategy selection in differential evolution for numerical optimization: An empirical study , 2011, Inf. Sci..

[60]  M. M. Ali,et al.  Differential evolution algorithms using hybrid mutation , 2007, Comput. Optim. Appl..

[61]  Ponnuthurai N. Suganthan,et al.  An Adaptive Differential Evolution Algorithm With Novel Mutation and Crossover Strategies for Global Numerical Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[62]  Francisco Herrera,et al.  A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability , 2009, Soft Comput..

[63]  Andries Petrus Engelbrecht,et al.  A self-adaptive heterogeneous pso for real-parameter optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[64]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[65]  Ville Tirronen,et al.  A study on scale factor in distributed differential evolution , 2011, Inf. Sci..

[66]  Swagatam Das,et al.  Cluster-based differential evolution with Crowding Archive for niching in dynamic environments , 2014, Inf. Sci..

[67]  Jing J. Liang,et al.  Differential evolution based on fitness Euclidean-distance ratio for multimodal optimization , 2014, Neurocomputing.

[68]  Ning Xiong,et al.  Greedy adaptation of control parameters in differential evolution for global optimization problems , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[69]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[70]  Yiqiao Cai,et al.  Multiobjective evolutionary algorithm for frequency assignment problem in satellite communications , 2015, Soft Comput..

[71]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[72]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[73]  J. Kennedy,et al.  Neighborhood topologies in fully informed and best-of-neighborhood particle swarms , 2003, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[74]  Dimitris K. Tasoulis,et al.  Enhancing Differential Evolution Utilizing Proximity-Based Mutation Operators , 2011, IEEE Transactions on Evolutionary Computation.

[75]  P. N. Suganthan,et al.  Problem Definitions and Evaluation Criteria for CEC 2011 Competition on Testing Evolutionary Algorithms on Real World Optimization Problems , 2011 .

[76]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).