Differential Evolution with Noise Analyzer

This paper proposes a Differential Evolution based algorithm for numerical optimization in the presence of noise. The proposed algorithm, namely Noise Analysis Differential Evolution (NADE), employs a randomized scale factor in order to overcome the structural difficulties of a Differential Evolution in a noisy environment as well as a noise analysis component which determines the amount of samples required for characterizing the stochastic process and thus efficiently performing pairwise comparisons between parent and offspring solutions. The NADE has been compared, for a benchmark set composed of various fitness landscapes under several levels of noise bandwidth, with a classical evolutionary algorithm for noisy optimization and two recently proposed metaheuristics. Numerical results show that the proposed NADE has a very good performance in detecting high quality solutions despite the presence of noise. The NADE seems, in most cases, very fast and reliable in detecting promising search directions and continuing evolution towards the optimum.

[1]  Zbigniew Michalewicz,et al.  Evolutionary Computation 1 , 2018 .

[2]  Amit Konar,et al.  Improved differential evolution algorithms for handling noisy optimization problems , 2005, 2005 IEEE Congress on Evolutionary Computation.

[3]  T. Back,et al.  Thresholding-a selection operator for noisy ES , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[4]  Jürgen Branke,et al.  Selection in the Presence of Noise , 2003, GECCO.

[5]  Rolf Drechsler,et al.  Applications of Evolutionary Computing, EvoWorkshops 2008: EvoCOMNET, EvoFIN, EvoHOT, EvoIASP, EvoMUSART, EvoNUM, EvoSTOC, and EvoTransLog, Naples, Italy, March 26-28, 2008. Proceedings , 2008, EvoWorkshops.

[6]  Hajime Kita,et al.  Online optimization of an engine controller by means of a genetic algorithm using history of search , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[7]  Benjamin W. Wah,et al.  Scheduling of Genetic Algorithms in a Noisy Environment , 1994, Evolutionary Computation.

[8]  Shahryar Rahnamayan,et al.  Opposition-Based Differential Evolution for Optimization of Noisy Problems , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[9]  Peter Stagge,et al.  Averaging Efficiently in the Presence of Noise , 1998, PPSN.

[10]  Ling Wang,et al.  Particle swarm optimization for function optimization in noisy environment , 2006, Appl. Math. Comput..

[11]  R. Lyndon While,et al.  Applying evolutionary algorithms to problems with noisy, time-consuming fitness functions , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[12]  Thomas Bartz-Beielstein,et al.  Particle Swarm Optimization and Sequential Sampling in Noisy Environments , 2007, Metaheuristics.

[13]  John J. Grefenstette,et al.  Genetic algorithms in noisy environments , 1988, Machine Learning.

[14]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[15]  N. Salvatore,et al.  Surrogate assisted local search in PMSM drive design , 2008 .

[16]  Thomas Bäck,et al.  Parallel Problem Solving from Nature — PPSN V , 1998, Lecture Notes in Computer Science.

[17]  Zbigniew Michalewicz,et al.  Evolutionary Computation 2 , 2000 .

[18]  Hans-Georg Beyer,et al.  Toward a Theory of Evolution Strategies: Some Asymptotical Results from the (1,+ )-Theory , 1993, Evolutionary Computation.

[19]  Giuseppe Acciani,et al.  Prudent-Daring vs Tolerant Survivor Selection Schemes in Control Design of Electric Drives , 2006, EvoWorkshops.

[20]  Gary B. Fogel,et al.  Noisy optimization problems - a particular challenge for differential evolution? , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[21]  Julian F. Miller,et al.  Genetic and Evolutionary Computation — GECCO 2003 , 2003, Lecture Notes in Computer Science.

[22]  Bernhard Sendhoff,et al.  Functions with noise-induced multimodality: a test for evolutionary robust Optimization-properties and performance analysis , 2006, IEEE Transactions on Evolutionary Computation.

[23]  Jürgen Branke,et al.  Sequential Sampling in Noisy Environments , 2004, PPSN.

[24]  Michael N. Vrahatis,et al.  Particle filtering with particle swarm optimization in systems with multiplicative noise , 2008, GECCO '08.

[25]  Jürgen Branke,et al.  Efficient fitness estimation in noisy environments , 2001 .

[26]  Amit Konar,et al.  An Improved Differential Evolution Scheme for Noisy Optimization Problems , 2005, PReMI.