A Modified Differential Evolution With Distance-based Selection for Continuous Optimization in Presence of Noise

The performance of evolutionary algorithms (EAs), suitable for optimization on static functional landscapes, usually degrade in presence of noises with different statistical features. In this paper, we present a simple variant of the differential evolution (DE) algorithm, one of the most competitive EAs of recent interest, to tackle complex optimization problems in the presence of additive noise. The proposed DE variant is equipped with three new algorithmic components. A new population central tendency-based mutation scheme is proposed and it is switched in a probabilistic manner with the difference mean-based perturbation strategy in the mutation step. Instead of the regular binomial or exponential crossover of DE, we adopt a blending crossover during the recombination stage. Finally, a novel distance-based selection mechanism is incorporated to enable the occasional inclusion of a few inferior solutions to future generations, thus making the usual DE selection less greedy. Five different additive noise models namely Gaussian, Poisson, Rayleigh, Exponential, and Random are considered with a variety of noise amplitudes to simulate the noisy behavior of the objective functions. In total, 79 benchmark functions from traditional, as well as modern (IEEE CEC 2013 and 2017) test-suites, are used to extensively compare and contrast the proposed method with the other state-of-art evolutionary optimization algorithms, tailor-made for noisy function optimization. Experimental results, supported with the non-parametric statistical tests, indicate that our proposed method is very competitive against the noise-resilient variants of classical as well as very recent evolutionary optimizers, including the winners of the recent IEEE CEC competitions of real parameter optimization on the complex fitness landscapes.

[1]  Sankha Subhra Mullick,et al.  A Switched Parameter Differential Evolution for Large Scale Global Optimization - Simpler May Be Better , 2015, MENDEL.

[2]  Ponnuthurai N. Suganthan,et al.  An Adaptive Differential Evolution Algorithm With Novel Mutation and Crossover Strategies for Global Numerical Optimization , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Jonathan E. Fieldsend,et al.  The Rolling Tide Evolutionary Algorithm: A Multiobjective Optimizer for Noisy Optimization Problems , 2015, IEEE Transactions on Evolutionary Computation.

[4]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[5]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[6]  Jing Hu,et al.  A Diversity-Guided Particle Swarm Optimizer for Dynamic Environments , 2007, LSMS.

[7]  Janez Brest,et al.  Single objective real-parameter optimization: Algorithm jSO , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[8]  Yee Hung See Tau Optimization of Power Delivery Design and Methodologies , 2006, 2006 International Conference on Electronic Materials and Packaging.

[9]  Giovanni Iacca,et al.  Noise analysis compact differential evolution , 2012, Int. J. Syst. Sci..

[10]  Rémi Coulom,et al.  CLOP: Confident Local Optimization for Noisy Black-Box Parameter Tuning , 2011, ACG.

[11]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[12]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[13]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[14]  Sankha Subhra Mullick,et al.  A switched parameter differential evolution with optional blending crossover for scalable numerical optimization , 2017, Appl. Soft Comput..

[15]  Bo Liu,et al.  Hybrid differential evolution for noisy optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[16]  Pratyusha Rakshit,et al.  Differential evolution for noisy multiobjective optimization , 2015, Artif. Intell..

[17]  Robert G. Reynolds,et al.  An Adaptive Multipopulation Differential Evolution With Dynamic Population Reduction , 2017, IEEE Transactions on Cybernetics.

[18]  Lixin Tang,et al.  Differential Evolution With an Individual-Dependent Mechanism , 2015, IEEE Transactions on Evolutionary Computation.

[19]  Pratyusha Rakshit,et al.  Noisy evolutionary optimization algorithms - A comprehensive survey , 2017, Swarm Evol. Comput..

[20]  Alex S. Fukunaga,et al.  Evaluating the performance of SHADE on CEC 2013 benchmark problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[21]  Kalyanmoy Deb,et al.  Hybrid Dynamic Resampling for Guided Evolutionary Multi-Objective Optimization , 2015, EMO.

[22]  Dan Simon,et al.  Biogeography-based optimization with blended migration for constrained optimization problems , 2010, GECCO '10.

[23]  Shu-Mei Guo,et al.  Enhancing Differential Evolution Utilizing Eigenvector-Based Crossover Operator , 2015, IEEE Transactions on Evolutionary Computation.

[24]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[25]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[26]  Amit Konar,et al.  Improved differential evolution algorithms for handling noisy optimization problems , 2005, 2005 IEEE Congress on Evolutionary Computation.

[27]  Swagatam Das,et al.  Modified Differential Evolution with Locality induced Genetic Operators for dynamic optimization , 2016, Eur. J. Oper. Res..

[28]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[29]  Liang Gao,et al.  Adaptive Differential Evolution With Sorting Crossover Rate for Continuous Optimization Problems , 2017, IEEE Transactions on Cybernetics.

[30]  Athanasios V. Vasilakos,et al.  Adaptive differential evolution with difference mean based perturbation for dynamic economic dispatch problem , 2013, 2013 IEEE Symposium on Differential Evolution (SDE).

[31]  Ferrante Neri,et al.  Differential Evolution with Noise Analyzer , 2009, EvoWorkshops.

[32]  Bijaya K. Panigrahi,et al.  A noise resilient Differential Evolution with improved parameter and strategy control , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[33]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[34]  Gary B. Fogel,et al.  Noisy optimization problems - a particular challenge for differential evolution? , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[35]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[36]  Janez Brest,et al.  iL-SHADE: Improved L-SHADE algorithm for single objective real-parameter optimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[37]  Shao Yong Zheng,et al.  An Efficient Multiple Variants Coordination Framework for Differential Evolution , 2017, IEEE Transactions on Cybernetics.

[38]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[39]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[40]  Ferrante Neri,et al.  A memetic Differential Evolution approach in noisy optimization , 2010, Memetic Comput..

[41]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[42]  Olivier Teytaud,et al.  Differential evolution for strongly noisy optimization: Use 1.01n resamplings at iteration n and reach the − 1/2 slope , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[43]  Benjamin W. Wah,et al.  Scheduling of Genetic Algorithms in a Noisy Environment , 1994, Evolutionary Computation.

[44]  Ponnuthurai N. Suganthan,et al.  Recent advances in differential evolution - An updated survey , 2016, Swarm Evol. Comput..

[45]  Amit Konar,et al.  An Improved Differential Evolution Scheme for Noisy Optimization Problems , 2005, PReMI.

[46]  Renato A. Krohling,et al.  Swarm algorithms with chaotic jumps applied to noisy optimization problems , 2011, Inf. Sci..

[47]  Shahryar Rahnamayan,et al.  Opposition-Based Differential Evolution Algorithms , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[48]  Dimitris K. Tasoulis,et al.  Enhancing Differential Evolution Utilizing Proximity-Based Mutation Operators , 2011, IEEE Transactions on Evolutionary Computation.

[49]  Jian-Xin Xu,et al.  Multiple Exponential Recombination for Differential Evolution. , 2017, IEEE transactions on cybernetics.

[50]  Ponnuthurai N. Suganthan,et al.  Ensemble sinusoidal differential covariance matrix adaptation with Euclidean neighborhood for solving CEC2017 benchmark problems , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).