Enhancing covariance matrix adaptation evolution strategy through fitness inheritance

Evolution strategy (ES) has shown to be effective in many search and optimization problems. In particular, the ES with covariance matrix adaptation (CMAES) achieves great successes and is viewed as a state-of-the-art evolutionary algorithm for complex numerical optimization. The CMAES models the population by a multivariate normal distribution, which requires a considerable amount of fitness evaluation results and thus degrades its efficiency. This paper proposes using fitness inheritance to reduce the computational cost at fitness evaluation. More specifically, the proposed FI-CMAES adopts fitness inheritance to approximate the fitness of offspring. The survivors are selected according to the approximated fitness; thereafter, the survival offspring are evaluated by the original fitness function. By this way, several original fitness evaluations on offspring can be saved. Experiments examine the effectiveness and efficiency of FI-CMAES on the CEC2014 test suite. The results show that FI-CMAES can outperform CMAES in terms of solution quality and convergence speed.

[1]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[2]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[3]  Helio J. C. Barbosa,et al.  A study on fitness inheritance for enhanced efficiency in real-coded genetic algorithms , 2012, 2012 IEEE Congress on Evolutionary Computation.

[4]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Comparing Review , 2006, Towards a New Evolutionary Computation.

[5]  David E. Goldberg,et al.  Evaluation relaxation using substructural information and linear estimation , 2006, GECCO '06.

[6]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[7]  Carlos A. Coello Coello,et al.  Dynamic fitness inheritance proportion for multi-objective particle swarm optimization , 2006, GECCO.

[8]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[9]  D. Goldberg,et al.  Don't evaluate, inherit , 2001 .

[10]  Robert E. Smith,et al.  Fitness inheritance in genetic algorithms , 1995, SAC '95.

[11]  David E. Goldberg,et al.  Efficiency enhancement of genetic algorithms via building-block-wise fitness estimation , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[12]  David E. Goldberg,et al.  Efficiency Enhancement of Probabilistic Model Building Genetic Algorithms , 2004, ArXiv.

[13]  Daniele Loiacono,et al.  Speeding-Up Expensive Evaluations in High-Level Synthesis Using Solution Modeling and Fitness Inheritance , 2010 .

[14]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[15]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[16]  Martin Pelikan,et al.  Fitness Inheritance in the Bayesian Optimization Algorithm , 2004, GECCO.

[17]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[18]  Gianluca Palermo,et al.  Improving evolutionary exploration to area-time optimization of FPGA designs , 2008, J. Syst. Archit..

[19]  Mohammad Reza Farmani,et al.  Multidisciplinary design of a small satellite launch vehicle using particle swarm optimization , 2011 .