Historical and Heuristic-Based Adaptive Differential Evolution

As the mutation strategy and algorithmic parameters in differential evolution (DE) are sensitive to the problems being solved, a hot research topic is to adaptively control the strategy and parameters according to the requirements of the problem. In the literature, most adaptive DE use either historical experiences of the population or heuristic information of the individuals to promote adaptation. In this paper, we develop a novel variant of adaptive DE, utilizing both the historical experience and heuristic information for the adaptation. In this novel historical and heuristic DE (HHDE), each individual dynamically adjusts its mutation strategy and associated parameters not only by learning from previous successful experience of the whole population, but also according to heuristic information related with its own current state. These help the algorithm select a more suitable mutation strategy and determinate better parameters for each individual in different evolutionary stages. The performance of the proposed HHDE is extensively evaluated on 30 benchmark functions with different dimensions. Experimental results confirm the competitiveness of the proposed algorithm to a number of DE variants.

[1]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[2]  Robert G. Reynolds,et al.  An ensemble sinusoidal parameter adaptation incorporated with L-SHADE for solving CEC2014 benchmark problems , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[3]  Hui Li,et al.  Adaptive strategy selection in differential evolution for numerical optimization: An empirical study , 2011, Inf. Sci..

[4]  Guohua Wu,et al.  Differential evolution with multi-population based ensemble of mutation strategies , 2016, Inf. Sci..

[5]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[6]  Ruhul A. Sarker,et al.  Testing united multi-operator evolutionary algorithms on the CEC2014 real-parameter numerical optimization , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[7]  Hui Wang,et al.  Gaussian Bare-Bones Differential Evolution , 2013, IEEE Transactions on Cybernetics.

[8]  Mingyue Ding,et al.  Route Planning for Unmanned Aerial Vehicle (UAV) on the Sea Using Hybrid Differential Evolution and Quantum-Behaved Particle Swarm Optimization , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[9]  Ponnuthurai N. Suganthan,et al.  An Adaptive Differential Evolution Algorithm With Novel Mutation and Crossover Strategies for Global Numerical Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Tapabrata Ray,et al.  Differential Evolution With Dynamic Parameters Selection for Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.

[11]  Pratyusha Rakshit,et al.  Uncertainty Management in Differential Evolution Induced Multiobjective Optimization in Presence of Measurement Noise , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[12]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[13]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[14]  Syuan-Yi Chen,et al.  Energy-Saving Dynamic Bias Current Control of Active Magnetic Bearing Positioning System Using Adaptive Differential Evolution , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[15]  Wenyin Gong,et al.  An Improved Self-adaptive Control Parameter of Differential Evolution for Global Optimization , 2009 .

[16]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[17]  Ruhul A. Sarker,et al.  Differential evolution with multiple strategies for solving CEC2011 real-world numerical optimization problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[18]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[19]  Lixin Tang,et al.  Differential Evolution With an Individual-Dependent Mechanism , 2015, IEEE Transactions on Evolutionary Computation.

[20]  Rainer Storn,et al.  Minimizing the real functions of the ICEC'96 contest by differential evolution , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[21]  Abhisek Ukil,et al.  Modeling of Room Temperature Dynamics for Efficient Building Energy Management , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[22]  Hui Li,et al.  Enhanced Differential Evolution With Adaptive Strategies for Numerical Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  Swagatam Das,et al.  An improved differential evolution algorithm with fitness-based adaptation of the control parameters , 2011, Inf. Sci..

[24]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[25]  Aimin Zhou,et al.  A Multioperator Search Strategy Based on Cheap Surrogate Models for Evolutionary Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[26]  István Erlich,et al.  Evaluating the Mean-Variance Mapping Optimization on the IEEE-CEC 2014 test suite , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[27]  Tetsuyuki Takahama,et al.  Efficient Constrained Optimization by the ε Constrained Rank-Based Differential Evolution , 2012, 2012 IEEE Congress on Evolutionary Computation.

[28]  Michèle Sebag,et al.  Comparison-Based Adaptive Strategy Selection with Bandits in Differential Evolution , 2010, PPSN.

[29]  Dimitris K. Tasoulis,et al.  Enhancing Differential Evolution Utilizing Proximity-Based Mutation Operators , 2011, IEEE Transactions on Evolutionary Computation.

[30]  Wenyin Gong,et al.  Differential Evolution With Ranking-Based Mutation Operators , 2013, IEEE Transactions on Cybernetics.

[31]  Tetsuyuki Takahama,et al.  Rank-based differential evolution with multiple mutation strategies for large scale global optimization , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[32]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[33]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[34]  Jason Sheng-Hong Tsai,et al.  Improving Differential Evolution With a Successful-Parent-Selecting Framework , 2015, IEEE Transactions on Evolutionary Computation.

[35]  Xuefeng Yan,et al.  Self-Adaptive Differential Evolution Algorithm With Zoning Evolution of Control Parameters and Adaptive Mutation Strategies , 2016, IEEE Transactions on Cybernetics.

[36]  Gregory W. Corder,et al.  Nonparametric Statistics for Non-Statisticians: A Step-by-Step Approach , 2009 .

[37]  Liang Gao,et al.  Adaptive Differential Evolution With Sorting Crossover Rate for Continuous Optimization Problems , 2017, IEEE Transactions on Cybernetics.

[38]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[39]  Ju-Jang Lee,et al.  Stochastic Opposition-Based Learning Using a Beta Distribution in Differential Evolution , 2016, IEEE Transactions on Cybernetics.

[40]  Ponnuthurai N. Suganthan,et al.  A Differential Covariance Matrix Adaptation Evolutionary Algorithm for real parameter optimization , 2012, Inf. Sci..

[41]  Kenneth V. Price,et al.  An introduction to differential evolution , 1999 .

[42]  Jian-Xin Xu,et al.  Multiple Exponential Recombination for Differential Evolution. , 2017, IEEE transactions on cybernetics.

[43]  Yusheng Liu,et al.  A Geometric Structure-Based Particle Swarm Optimization Algorithm for Multiobjective Problems , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[44]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[45]  John Murphy,et al.  An Altruistic Prediction-Based Congestion Control for Strict Beaconing Requirements in Urban VANETs , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[46]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[47]  Pratyusha Rakshit,et al.  Realization of an Adaptive Memetic Algorithm Using Differential Evolution and Q-Learning: A Case Study in Multirobot Path Planning , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[48]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[49]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .