NFDDE: A novelty-hybrid-fitness driving differential evolution algorithm

Abstract In differential evolution algorithm (DE), it is a widely accepted method that selecting individuals with higher fitness to generate a mutant vector. In this case, the population evolution is under a fitness-based driving force. Although the driving force is beneficial for the exploitation, it sacrifices performance on the exploration. In this paper, a novelty-hybrid-fitness driving force is introduced to trade off contradictions between the exploration and the exploitation of DE. In the new proposed DE, named as NFDDE, both fitness and novelty values of individuals are considered when choosing individuals to create mutant vectors. In addition, two adaptive scaling factors are proposed to adjust the weights of the fitness-based driving force and the novelty-based driving force, respectively, and then distinct properties of the two driving forces can be effectively utilized. At last, to save computational resources, some individuals with lower novelty are deleted when the population has converged to a certain extent. The comprehensive performance of NFDDE is extensively evaluated by comparisons between it and other 9 state-of-art DE variants based on CEC2017 test suite. In addition, distinct properties of the newly introduced strategies and involved parameters are further confirmed by a set of experiments.

[1]  Alastair Channon.  Passing the ALife Test: Activity Statistics Classify Evolution in Geb as Unbounded , 2001, ECAL.

[2]  R. Venkata Rao,et al.  Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems , 2011, Comput. Aided Des..

[3]  Tianlong Gu,et al.  Historical and Heuristic-Based Adaptive Differential Evolution , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[4]  Swagatam Das,et al.  A Modified Differential Evolution With Distance-based Selection for Continuous Optimization in Presence of Noise , 2017, IEEE Access.

[5]  Yuhai Zhao,et al.  A differential evolution based feature combination selection algorithm for high-dimensional data , 2021, Inf. Sci..

[6]  Kenneth O. Stanley,et al.  Efficiently evolving programs through the search for novelty , 2010, GECCO '10.

[7]  Iztok Fister,et al.  Artificial neural network regression as a local search heuristic for ensemble strategies in differential evolution , 2015, Nonlinear Dynamics.

[8]  Ali Wagdy Mohamed,et al.  Real-parameter unconstrained optimization based on enhanced fitness-adaptive differential evolution algorithm with novel mutation , 2017, Soft Computing.

[9]  Hossam Faris,et al.  Harris hawks optimization: Algorithm and applications , 2019, Future Gener. Comput. Syst..

[10]  Anders Lyhne Christensen,et al.  Evolution of swarm robotics systems with novelty search , 2013, Swarm Intelligence.

[11]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[12]  Guohua Wu,et al.  Differential evolution with multi-population based ensemble of mutation strategies , 2016, Inf. Sci..

[13]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[14]  Haifeng Li,et al.  Ensemble of differential evolution variants , 2018, Inf. Sci..

[15]  Li Tian,et al.  Differential evolution algorithm directed by individual difference information between generations and current individual information , 2018, Applied Intelligence.

[16]  Mengnan Tian,et al.  Differential evolution with neighborhood-based adaptive evolution mechanism for numerical optimization , 2019, Inf. Sci..

[17]  Hongrun Wu,et al.  A fitness-based adaptive differential evolution algorithm , 2021, Inf. Sci..

[18]  Bernhard Sendhoff,et al.  An examination of different fitness and novelty based selection methods for the evolution of neural networks , 2012, Soft Computing.

[19]  Zexuan Zhu,et al.  Differential evolution algorithm with dichotomy-based parameter space compression , 2019, Soft Comput..

[20]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[21]  Shengzhi Du,et al.  Double-layer-clustering differential evolution multimodal optimization by speciation and self-adaptive strategies , 2021, Inf. Sci..

[22]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[23]  Matjaz Perc,et al.  The networked evolutionary algorithm: A network science perspective , 2018, Appl. Math. Comput..

[24]  Yong Wang,et al.  Differential evolution with a two-stage optimization mechanism for numerical optimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[25]  Russell K. Standish,et al.  Open-Ended Artificial Evolution , 2002, Int. J. Comput. Intell. Appl..

[26]  Ponnuthurai N. Suganthan,et al.  Population topologies for particle swarm optimization and differential evolution , 2017, Swarm Evol. Comput..

[27]  Vivek K. Patel,et al.  Heat transfer search (HTS): a novel optimization algorithm , 2015, Inf. Sci..

[28]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[29]  Oscar Castillo,et al.  Optimization of fuzzy controller design using a Differential Evolution algorithm with dynamic parameter adaptation based on Type-1 and Interval Type-2 fuzzy systems , 2019, Soft Computing.

[30]  Shao Yong Zheng,et al.  Multi-Layer Competitive-Cooperative Framework for Performance Enhancement of Differential Evolution , 2018, Inf. Sci..

[31]  Yi Wang,et al.  Differential evolution with adaptive mutation strategy based on fitness landscape analysis , 2021, Inf. Sci..

[32]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[33]  Ponnuthurai N. Suganthan,et al.  Ensemble sinusoidal differential covariance matrix adaptation with Euclidean neighborhood for solving CEC2017 benchmark problems , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[34]  Erik Valdemar Cuevas Jiménez,et al.  A better balance in metaheuristic algorithms: Does it exist? , 2020, Swarm Evol. Comput..

[35]  Xiaobing Yu,et al.  A constrained differential evolution algorithm to solve UAV path planning in disaster scenarios , 2020, Knowl. Based Syst..

[36]  John Yearwood,et al.  Heterogeneous Cooperative Co-Evolution Memetic Differential Evolution Algorithm for Big Data Optimization Problems , 2017, IEEE Transactions on Evolutionary Computation.

[37]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[38]  Ming Yang,et al.  Differential Evolution With Auto-Enhanced Population Diversity , 2015, IEEE Transactions on Cybernetics.

[39]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[40]  Kenneth O. Stanley,et al.  Abandoning Objectives: Evolution Through the Search for Novelty Alone , 2011, Evolutionary Computation.

[41]  Xiaogen Zhou,et al.  Underestimation-Assisted Global-Local Cooperative Differential Evolution and the Application to Protein Structure Prediction , 2020, IEEE Transactions on Evolutionary Computation.

[42]  Eduardo Segredo,et al.  A similarity-based neighbourhood search for enhancing the balance exploration-exploitation of differential evolution , 2020, Comput. Oper. Res..

[43]  Robert G. Reynolds,et al.  An Adaptive Multipopulation Differential Evolution With Dynamic Population Reduction , 2017, IEEE Transactions on Cybernetics.

[44]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[45]  Siew Chin Neoh,et al.  Insights into the effects of control parameters and mutation strategy on self-adaptive ensemble-based differential evolution , 2020, Inf. Sci..

[46]  Nantiwat Pholdee,et al.  Optimal U-shaped baffle square-duct heat exchanger through surrogate-assisted self-adaptive differential evolution with neighbourhood search and weighted exploitation-exploration , 2017 .

[47]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[48]  Michal Pluhacek,et al.  Distance based parameter adaptation for Success-History based Differential Evolution , 2019, Swarm Evol. Comput..

[49]  Rawaa Dawoud Al-Dabbagh,et al.  Algorithmic design issues in adaptive differential evolution schemes: Review and taxonomy , 2018, Swarm Evol. Comput..