Enhancing differential evolution with interactive information

Differential evolution (DE) is well known for its simple structure and excellent performance among various evolutionary algorithms. Difference vectors have a dominant effect on the evolution progress. But the difference vectors in mutation operators for the conventional DE are simply generated by selecting individuals from the current population without any selective pressure. Besides, the directional information only depends on the existing individuals and hardly exploits the interaction between individuals. Therefore, a novel interactive information scheme called IIN is proposed to overcome this weakness. It attempts to provide more effective directional information during the evolution process and achieve a good balance between exploration and exploitation. In IIN, both the ranking information based on fitness and the interactive information between individuals is fully considered. The interaction between individuals is implemented by the mathematically weight-based combination according to ranking information. Hence, the interactive information inherited from existing individuals acts as a directional vector. In this way, IIN-DE utilizes the directional information to speed up convergence. The proposed scheme can be easily incorporated into different mutation strategies to provide useful directional information. To verify the effectiveness, the proposed IIN is incorporated into the original DEs based on several mutation operators as well as several state-of-art DE variants. With the incorporation of IIN, significant improvements can be achieved for most of the compared DEs, as demonstrated by the experimental results.

[1]  Arthur C. Sanderson,et al.  Adaptive Differential Evolution: A Robust Approach to Multimodal Problem Optimization , 2009 .

[2]  Ponnuthurai N. Suganthan,et al.  An Adaptive Differential Evolution Algorithm With Novel Mutation and Crossover Strategies for Global Numerical Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Shahryar Rahnamayan,et al.  Center-based sampling for population-based algorithms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[4]  Jouni Lampinen,et al.  A Trigonometric Mutation Operation to Differential Evolution , 2003, J. Glob. Optim..

[5]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[6]  Ali R. Yildiz,et al.  A new hybrid differential evolution algorithm for the selection of optimal machining parameters in milling operations , 2013, Appl. Soft Comput..

[7]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[8]  Sanyou Zeng,et al.  A new WiFi microstrip antenna designed by differential evolution , 2015, Int. J. Wirel. Mob. Comput..

[9]  Wenyin Gong,et al.  DE/BBO: a hybrid differential evolution with biogeography-based optimization for global numerical optimization , 2010, Soft Comput..

[10]  Tapabrata Ray,et al.  Differential Evolution With Dynamic Parameters Selection for Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.

[11]  Yuren Zhou,et al.  Differential evolution with guiding archive for global numerical optimization , 2016, Appl. Soft Comput..

[12]  Ali Wagdy Mohamed,et al.  Constrained optimization based on modified differential evolution algorithm , 2012, Inf. Sci..

[13]  Mehmet Fatih Tasgetiren,et al.  An ensemble of discrete differential evolution algorithms for solving the generalized traveling salesman problem , 2010, Appl. Math. Comput..

[14]  Robert G. Reynolds,et al.  A modified cultural algorithm with a balanced performance for the differential evolution frameworks , 2016, Knowl. Based Syst..

[15]  Yiqiao Cai,et al.  Differential Evolution With Neighborhood and Direction Information for Numerical Optimization , 2013, IEEE Transactions on Cybernetics.

[16]  M. M. Ali,et al.  A numerical study of some modified differential evolution algorithms , 2006, Eur. J. Oper. Res..

[17]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[18]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[19]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[20]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[21]  Jing J. Liang,et al.  Differential Evolution With Neighborhood Mutation for Multimodal Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[22]  Jason Sheng-Hong Tsai,et al.  Improving Differential Evolution With a Successful-Parent-Selecting Framework , 2015, IEEE Transactions on Evolutionary Computation.

[23]  Thomas Bäck,et al.  Evolutionary Algorithms in Theory and Practice , 1996 .

[24]  Amer Draa,et al.  A sinusoidal differential evolution algorithm for numerical optimisation , 2015, Appl. Soft Comput..

[25]  Yang Liu,et al.  A fast differential evolution algorithm using k-Nearest Neighbour predictor , 2011, Expert Syst. Appl..

[26]  Lixin Tang,et al.  Differential Evolution With an Individual-Dependent Mechanism , 2015, IEEE Transactions on Evolutionary Computation.

[27]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[28]  Guohua Wu,et al.  Differential evolution with multi-population based ensemble of mutation strategies , 2016, Inf. Sci..

[29]  Dimitris K. Tasoulis,et al.  Enhancing Differential Evolution Utilizing Proximity-Based Mutation Operators , 2011, IEEE Transactions on Evolutionary Computation.

[30]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[31]  Millie Pant,et al.  An efficient Differential Evolution based algorithm for solving multi-objective optimization problems , 2011, Eur. J. Oper. Res..

[32]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[33]  Ruhul A. Sarker,et al.  An Improved Self-Adaptive Differential Evolution Algorithm for Optimization Problems , 2013, IEEE Transactions on Industrial Informatics.

[34]  Swagatam Das,et al.  Hyper-spectral image segmentation using Rényi entropy based multi-level thresholding aided with differential evolution , 2016, Expert Syst. Appl..

[35]  Gang Liu,et al.  Enhanced differential evolution using random-based sampling and neighborhood mutation , 2015, Soft Comput..

[36]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[37]  Laizhong Cui,et al.  Adaptive differential evolution algorithm with novel mutation strategies in multiple sub-populations , 2016, Comput. Oper. Res..

[38]  Michael G. Epitropakis,et al.  Evolving cognitive and social experience in Particle Swarm Optimization through Differential Evolution: A hybrid approach , 2012, Inf. Sci..

[39]  Yiqiao Cai,et al.  Differential Evolution Enhanced With Multiobjective Sorting-Based Mutation Operators , 2014, IEEE Transactions on Cybernetics.

[40]  Okan K. Ersoy,et al.  Multi-offspring genetic algorithm and its application to the traveling salesman problem , 2016, Appl. Soft Comput..

[41]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[42]  Arthur C. Sanderson,et al.  Adaptive Differential Evolution , 2009 .

[43]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[44]  Yonghong Chen,et al.  Cellular direction information based differential evolution for numerical optimization: an empirical study , 2015, Soft Computing.

[45]  Swagatam Das,et al.  A Cluster-Based Differential Evolution Algorithm With External Archive for Optimization in Dynamic Environments , 2013, IEEE Transactions on Cybernetics.

[46]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[47]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[48]  Wenyin Gong,et al.  Differential Evolution With Ranking-Based Mutation Operators , 2013, IEEE Transactions on Cybernetics.

[49]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[50]  Luciano Martins Neto,et al.  Horizontal Multilayer Soil Parameter Estimation Through Differential Evolution , 2016, IEEE Transactions on Power Delivery.

[51]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.