Noise analysis compact differential evolution

This article proposes a compact algorithm for optimisation in noisy environments. This algorithm has a compact structure and employs differential evolution search logic. Since it is a compact algorithm, it does not store a population of solutions but a probabilistic representation of the population. This kind of algorithmic structure can be implemented in those real-world problems characterized by memory limitations. The degree of randomization contained in the compact structure allows a robust behaviour in the presence of noise. In addition the proposed algorithm employs the noise analysis survivor selection scheme. This scheme performs an analysis of the noise and automatically performs a re-sampling of the solutions in order to ensure both reliable pairwise comparisons and a minimal cost in terms of fitness evaluations. The noise analysis component can be reliably used in noise environments affected by Gaussian noise which allow an a priori analysis of the noise features. This situation is typical of problems where the fitness is computed by means of measurement devices. An extensive comparative analysis including four different noise levels has been included. Numerical results show that the proposed algorithm displays a very good performance since it regularly succeeds at handling diverse fitness landscapes characterized by diverse noise amplitudes.

[1]  Bernhard Sendhoff,et al.  Functions with noise-induced multimodality: a test for evolutionary robust Optimization-properties and performance analysis , 2006, IEEE Transactions on Evolutionary Computation.

[2]  Peter Stagge,et al.  Averaging Efficiently in the Presence of Noise , 1998, PPSN.

[3]  Jürgen Branke,et al.  Sequential Sampling in Noisy Environments , 2004, PPSN.

[4]  Kai-Yew Lum,et al.  Max-min surrogate-assisted evolutionary algorithm for robust design , 2006, IEEE Transactions on Evolutionary Computation.

[5]  David E. Goldberg,et al.  The compact genetic algorithm , 1999, IEEE Trans. Evol. Comput..

[6]  Mark Sumner,et al.  A Fast Adaptive Memetic Algorithm for Online and Offline Control Design of PMSM Drives , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Kay Chen Tan,et al.  Noise Handling in Evolutionary Multi-Objective Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[8]  Francisco Herrera,et al.  A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability , 2009, Soft Comput..

[9]  Bruce Abramson,et al.  Expected-Outcome: A General Model of Static Evaluation , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Hans-Georg Beyer,et al.  Toward a Theory of Evolution Strategies: Some Asymptotical Results from the (1,+ )-Theory , 1993, Evolutionary Computation.

[11]  Raino A. E. Mäkinen,et al.  Hierarchical Evolutionary Algorithms and Noise Compensation via Adaptation , 2007, Evolutionary Computation in Dynamic and Uncertain Environments.

[12]  Walter J. Gutjahr,et al.  A Converging ACO Algorithm for Stochastic Combinatorial Optimization , 2003, SAGA.

[13]  W. Cody,et al.  Rational Chebyshev approximations for the error function , 1969 .

[14]  Hajime Kita,et al.  Online optimization of an engine controller by means of a genetic algorithm using history of search , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[15]  Ferrante Neri,et al.  Memetic Compact Differential Evolution for Cartesian Robot Control , 2010, IEEE Computational Intelligence Magazine.

[16]  Benjamin W. Wah,et al.  Scheduling of Genetic Algorithms in a Noisy Environment , 1994, Evolutionary Computation.

[17]  Thomas M A Fink,et al.  Stochastic annealing. , 2003, Physical review letters.

[18]  David Naso,et al.  Elitist Compact Genetic Algorithms for Induction Motor Self-tuning Control , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[19]  Petros Koumoutsakos,et al.  Evolutionary Optimization of Feedback Controllers for Thermoacoustic Instabilities , 2008 .

[20]  Ata Allah Taleizadeh,et al.  Optimising multi-product multi-chance-constraint inventory control system with stochastic period lengths and total discount under fuzzy purchasing price and holding costs , 2010, Int. J. Syst. Sci..

[21]  Ville Tirronen,et al.  Scale factor inheritance mechanism in distributed differential evolution , 2009, Soft Comput..

[22]  Niko Kotilainen,et al.  A Memetic-Neural Approach to Discover Resources in P2P Networks , 2008, Recent Advances in Evolutionary Computation for Combinatorial Optimization.

[23]  Shengxiang Yang,et al.  Guest editorial: Memetic Computing in the presence of uncertainties , 2010, Memetic Comput..

[24]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[25]  Carlos Cotta,et al.  Recent Advances in Evolutionary Computation for Combinatorial Optimization , 2008, Recent Advances in Evolutionary Computation for Combinatorial Optimization.

[26]  Tommi Kärkkäinen,et al.  Noise Analysis Compact Genetic Algorithm , 2010, EvoApplications.

[27]  Petros Koumoutsakos,et al.  A Method for Handling Uncertainty in Evolutionary Optimization With an Application to Feedback Control of Combustion , 2009, IEEE Transactions on Evolutionary Computation.

[28]  Chang Wook Ahn,et al.  Elitism-based compact genetic algorithms , 2003, IEEE Trans. Evol. Comput..

[29]  Yaochu Jin,et al.  Single/Multi-objective Inverse Robust Evolutionary Design Methodology in the Presence of Uncertainty , 2007, Evolutionary Computation in Dynamic and Uncertain Environments.

[30]  Ferrante Neri,et al.  Optimization of Delayed-State Kalman-Filter-Based Algorithm via Differential Evolution for Sensorless Control of Induction Motors , 2010, IEEE Transactions on Industrial Electronics.

[31]  Shahryar Rahnamayan,et al.  Opposition-Based Differential Evolution for Optimization of Noisy Problems , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[32]  Jürgen Branke,et al.  Selection in the Presence of Noise , 2003, GECCO.

[33]  Kay Chen Tan,et al.  An Investigation on Noisy Environments in Evolutionary Multiobjective Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[34]  Gwi-Tae Park,et al.  Evolutionary design of Sugeno-type fuzzy systems for modelling humanoid robots , 2010, Int. J. Syst. Sci..

[35]  R. Lyndon While,et al.  Applying evolutionary algorithms to problems with noisy, time-consuming fitness functions , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[36]  N. Salvatore,et al.  Surrogate assisted local search in PMSM drive design , 2008 .

[37]  Gary B. Fogel,et al.  Noisy optimization problems - a particular challenge for differential evolution? , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[38]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[39]  Erick Cantú-Paz,et al.  Adaptive Sampling for Noisy Problems , 2004, GECCO.

[40]  Kay Chen Tan,et al.  Handling Uncertainties in Evolutionary Multi-Objective Optimization , 2008, WCCI.

[41]  Hans-Georg Beyer,et al.  A general noise model and its effects on evolution strategy performance , 2006, IEEE Transactions on Evolutionary Computation.

[42]  Ferrante Neri,et al.  Differential Evolution with Noise Analyzer , 2009, EvoWorkshops.

[43]  Giuseppe Acciani,et al.  Prudent-Daring vs Tolerant Survivor Selection Schemes in Control Design of Electric Drives , 2006, EvoWorkshops.

[44]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[45]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[46]  David E. Goldberg,et al.  Genetic Algorithms, Selection Schemes, and the Varying Effects of Noise , 1996, Evolutionary Computation.

[47]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[48]  J. Fitzpatrick,et al.  Genetic Algorithms in Noisy Environments , 2005, Machine Learning.

[49]  Thomas Bäck,et al.  Evolution Strategies on Noisy Functions: How to Improve Convergence Properties , 1994, PPSN.

[50]  Yee Ming Chen,et al.  Environmentally constrained economic dispatch using Pareto archive particle swarm optimisation , 2010, Int. J. Syst. Sci..

[51]  Bernhard Sendhoff,et al.  Generalizing Surrogate-Assisted Evolutionary Computation , 2010, IEEE Transactions on Evolutionary Computation.

[52]  Benjamin W. Wah,et al.  Dynamic Control of Genetic Algorithms in a Noisy Environment , 1993, ICGA.

[53]  Daniel T. Gladwin,et al.  Internal combustion engine control for series hybrid electric vehicles by parallel and distributed genetic programming/multiobjective genetic algorithms , 2011, Int. J. Syst. Sci..

[54]  David Naso,et al.  Compact Differential Evolution , 2011, IEEE Transactions on Evolutionary Computation.

[55]  Kay Chen Tan,et al.  An investigation on noise-induced features in robust evolutionary multi-objective optimization , 2010, Expert Syst. Appl..

[56]  Ferrante Neri,et al.  A memetic Differential Evolution approach in noisy optimization , 2010, Memetic Comput..

[57]  Bu-Sung Lee,et al.  Inverse multi-objective robust evolutionary design optimization in the presence of uncertainty , 2005, GECCO '05.

[58]  Michael N. Vrahatis,et al.  Particle filtering with particle swarm optimization in systems with multiplicative noise , 2008, GECCO '08.

[59]  Jürgen Branke,et al.  Efficient fitness estimation in noisy environments , 2001 .

[60]  Amit Konar,et al.  An Improved Differential Evolution Scheme for Noisy Optimization Problems , 2005, PReMI.

[61]  Sandor Markon,et al.  Threshold selection, hypothesis tests, and DOE methods , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[62]  F. Cupertino,et al.  Compact genetic algorithms for the optimization of induction motor cascaded control , 2007, 2007 IEEE International Electric Machines & Drives Conference.

[63]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[64]  Thomas Bartz-Beielstein,et al.  Particle Swarm Optimization and Sequential Sampling in Noisy Environments , 2007, Metaheuristics.

[65]  David Naso,et al.  Real-Valued Compact Genetic Algorithms for Embedded Microcontroller Optimization , 2008, IEEE Transactions on Evolutionary Computation.

[66]  Günter Rudolph,et al.  A partial order approach to noisy fitness functions , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[67]  Amit Konar,et al.  Improved differential evolution algorithms for handling noisy optimization problems , 2005, 2005 IEEE Congress on Evolutionary Computation.

[68]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[69]  T. Back,et al.  Thresholding-a selection operator for noisy ES , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[70]  Bu-Sung Lee,et al.  Inverse multi-objective robust evolutionary design , 2006, Genetic Programming and Evolvable Machines.

[71]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[72]  Ling Wang,et al.  Particle swarm optimization for function optimization in noisy environment , 2006, Appl. Math. Comput..