Incorporating Fitness Inheritance and k-Nearest Neighbors for Evolutionary Dynamic Optimization

Many real-world problems encounter varying environments while searching for the optimal solutions. Problems of these kinds are known as dynamic optimization problems. Evolutionary algorithms (EAs) have shown their high capability of solving dynamic optimization problems. The large number of fitness evaluations, however, limits the utility of EAs in dynamic optimization with expensive fitness evaluation. This study proposes a fitness inheritance method based on $k$-nearest neighbors (kNN) to reduce the number of fitness evaluations. This fitness inheritance method is applied to the covariance matrix adaptation evolution strategy (CMAES), a state-of-the-art evolutionary algorithm for complex numerical optimization problems, to save fitness evaluations and improve search efficiency. This study further presents a convergence checking operator to maintain a reasonable accuracy of fitness inheritance by reinitializing the population and multivariate normal distribution model timely. Experimental results verify the effectiveness and efficiency of the proposed method on six benchmark problems of dynamic optimization.

[1]  Shengxiang Yang,et al.  Explicit Memory Schemes for Evolutionary Algorithms in Dynamic Environments , 2007, Evolutionary Computation in Dynamic and Uncertain Environments.

[2]  Jürgen Branke,et al.  Efficient fitness estimation in noisy environments , 2001 .

[3]  Narayan Raman,et al.  The job shop tardiness problem: A decomposition approach , 1993 .

[4]  Xin Yao,et al.  Empirical analysis of evolutionary algorithms with immigrants schemes for dynamic optimization , 2009, Memetic Comput..

[5]  Changhe Li,et al.  A Clustering Particle Swarm Optimizer for Locating and Tracking Multiple Optima in Dynamic Environments , 2010, IEEE Transactions on Evolutionary Computation.

[6]  Janez Brest,et al.  Dynamic optimization using Self-Adaptive Differential Evolution , 2009, 2009 IEEE Congress on Evolutionary Computation.

[7]  Xin Yao,et al.  Benchmark Generator for the IEEE WCCI-2014 Competition on Evolutionary Computation for Dynamic Optimization Problems: Dynamic Travelling Salesman Problem Benchmark Generator , 2013 .

[8]  Ponnuthurai N. Suganthan,et al.  Evolutionary programming with ensemble of explicit memories for dynamic optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[9]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Comparing Review , 2006, Towards a New Evolutionary Computation.

[10]  Kay Chen Tan,et al.  Evolutionary Multi-objective Optimization in Uncertain Environments - Issues and Algorithms , 2009, Studies in Computational Intelligence.

[11]  Tapabrata Ray,et al.  Performance of infeasibility driven evolutionary algorithm (IDEA) on constrained dynamic single objective optimization problems , 2009, 2009 IEEE Congress on Evolutionary Computation.

[12]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[13]  Thomas M. Cover,et al.  Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition , 1965, IEEE Trans. Electron. Comput..

[14]  Susana Cecilia Esquivel,et al.  An Evolutionary Algorithm to Track Changes of Optimum Value Locations in Dynamic Environments , 2004 .

[15]  Shengxiang Yang,et al.  Evolutionary dynamic optimization: A survey of the state of the art , 2012, Swarm Evol. Comput..