Increasing Efficiency of Evolutionary Algorithms by Choosing between Auxiliary Fitness Functions with Reinforcement Learning

In this paper further investigation of the previously proposed method of speeding up single-objective evolutionary algorithms is done. The method is based on reinforcement learning which is used to choose auxiliary fitness functions. The requirements for this method are formulated. The compliance of the method with these requirements is illustrated on model problems such as Royal Roads problem and H-IFF optimization problem. The experiments confirm that the method increases the efficiency of evolutionary algorithms.

[1]  S.D. Muller,et al.  Step size adaptation in evolution strategies using reinforcement learning , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[2]  Abhijit Gosavi,et al.  Reinforcement Learning: A Tutorial Survey and Recent Advances , 2009, INFORMS J. Comput..

[3]  Mikkel T. Jensen,et al.  Helper-objectives: Using multi-objective evolutionary algorithms for single-objective optimisation , 2004, J. Math. Model. Algorithms.

[4]  Anton Schwartz,et al.  A Reinforcement Learning Method for Maximizing Undiscounted Rewards , 1993, ICML.

[5]  Richard A. Watson,et al.  Reducing Local Optima in Single-Objective Problems by Multi-objectivization , 2001, EMO.

[6]  Maxim Buzdalov,et al.  OPTIMIZATION WITH AUXILIARY CRITERIA USING EVOLUTIONARY ALGORITHMS AND REINFORCEMENT LEARNING ∗ , 2012 .

[7]  Arina Buzdalova,et al.  Choosing Best Fitness Function with Reinforcement Learning , 2011, 2011 10th International Conference on Machine Learning and Applications and Workshops.

[8]  M. Jensen.  Helper-Objectives: Using Multi-Objective Evolutionary Algorithms for Single-Objective Optimisation , 2004 .

[9]  Lihong Li,et al.  PAC model-free reinforcement learning , 2006, ICML.

[10]  Martijn C. Schut,et al.  Reinforcement Learning for Online Control of Evolutionary Algorithms , 2006, ESOA.

[11]  Maxim Buzdalov,et al.  Generation of tests for programming challenge tasks using evolution algorithms , 2011, GECCO.

[12]  Martin J. Oates,et al.  PESA-II: region-based selection in evolutionary multiobjective optimization , 2001 .

[13]  Zbigniew Michalewicz,et al.  Parameter Control in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[14]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[15]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.