Using statistical inference for designing termination conditions ensuring convergence of Evolutionary Algorithms

A main challenge in Evolutionary Algorithms (EAs) is determining a termination condition ensuring stabilization close to the optimum in real-world applications. Although for known test functions distribution-based quantities are good candidates (as far as suitable parameters are used), in real-world problems an open question still remains unsolved. How can we estimate an upper-bound for the termination condition value ensuring a given accuracy for the (unknown) EA solution? We claim that the termination problem would be fully solved if we defined a quantity (depending only on the EA output) behaving like the solution accuracy. The open question would be, then, satisfactorily answered if we had a model relating both quantities, since accuracy could be predicted from the alternative quantity. We present a statistical inference framework addressing two topics: checking the correlation between the two quantities and defining a regression model for predicting (at a given confidence level) accuracy values from the EA output.

[1]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[2]  Konstantinos G. Margaritis,et al.  An Experimental Study of Benchmarking Functions for Genetic Algorithms , 2002, Int. J. Comput. Math..

[3]  Louis A. Tamburino,et al.  Evolving pattern recognition systems , 2002, IEEE Trans. Evol. Comput..

[4]  Michael R. Greenberg,et al.  Chapter 1 – Theory, Methods, and Applications , 1978 .

[5]  M. Karim Generalized Linear Models With Random Effects , 1991 .

[6]  Jessica Andrea Carballido,et al.  On Stopping Criteria for Genetic Algorithms , 2004, SBIA.

[7]  Stefano Cagnon,et al.  Genetic and Evolutionary Computation for Image Processing and Analysis , 2008 .

[8]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[9]  Carlos A. Coello Coello,et al.  A Review of Particle Swarm Optimization Methods Used for Multimodal Optimization , 2009, Innovations in Swarm Intelligence.

[10]  Amit Konar,et al.  An Improved Differential Evolution Scheme for Noisy Optimization Problems , 2005, PReMI.

[11]  Mehmet Fatih Tasgetiren,et al.  A Multi-Populated Differential Evolution Algorithm for Solving Constrained Optimization Problem , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[12]  K. Zielinski,et al.  Stopping Criteria for Differential Evolution in Constrained Single-Objective Optimization , 2008 .

[13]  Heike Trautmann,et al.  Benchmarking Evolutionary Algorithms: Towards Exploratory Landscape Analysis , 2010, PPSN.

[14]  N. Draper,et al.  Applied Regression Analysis , 1966 .

[15]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[16]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[17]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[18]  J. Nelder,et al.  Generalized Linear Models with Random Effects: Unified Analysis via H-likelihood , 2006 .

[19]  Muni S. Srivastava,et al.  Regression Analysis: Theory, Methods, and Applications , 1991 .

[20]  Ron S. Kenett,et al.  Statistics for Business and Economics. , 1973 .

[21]  Anne Auger,et al.  Comparing results of 31 algorithms from the black-box optimization benchmarking BBOB-2009 , 2010, GECCO '10.

[22]  Jani Rönkkönen ContinuousMultimodal Global Optimization with Differential Evolution-Based Methods , 2009 .

[23]  Thomas Bäck,et al.  Evolutionary computation: comments on the history and current state , 1997, IEEE Trans. Evol. Comput..

[24]  Bijaya K. Panigrahi,et al.  Comparative Study of Evolutionary Computing Methods for Parameter Estimation of Power Quality Signals , 2010, Int. J. Appl. Evol. Comput..

[25]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..