A Surrogate-Assisted Evolutionary Algorithm with Random Feature Selection for Large-Scale Expensive Problems

When optimizing large-scale problems an evolutionary algorithm typically requires a substantial number of fitness evaluations to discover a good approximation to the global optimum. This is an issue when the problem is also computationally expensive. Surrogate-assisted evolutionary algorithms have shown better performance on high-dimensional problems which are no larger than 200 dimensions. However, it is very difficult to train sufficiently accurate surrogate models for a large-scale optimization problem due to the lack of training data. In this paper, a random feature selection technique is utilized to select decision variables from the original large-scale optimization problem to form a number of sub-problems, whose dimension may differ to each other, at each generation. The population employed to optimize the original large-scale optimization problem is updated by sequentially optimizing each sub-problem assisted by a surrogate constructed for this sub-problem. A new candidate solution of the original problem is generated by replacing the decision variables of the best solution found so far with those of the sub-problem that has achieved the best approximated fitness among all sub-problems. This new solution is then evaluated using the original expensive problem and used to update the best solution. In order to evaluate the performance of the proposed method, we conduct the experiments on 15 CEC’2013 benchmark problems and compare to some state-of-the-art algorithms. The experimental results show that the proposed method is more effective than the state-of-the-art algorithms, especially on problems that are partially separable or non-separable.

[1]  Hans-Martin Gutmann,et al.  A Radial Basis Function Method for Global Optimization , 2001, J. Glob. Optim..

[2]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[3]  Jun Zhang,et al.  Distributed Differential Evolution Based on Adaptive Mergence and Split for Large-Scale Optimization , 2018, IEEE Transactions on Cybernetics.

[4]  Xiaodong Li,et al.  Cooperative Co-evolution for large scale optimization through more frequent random grouping , 2010, IEEE Congress on Evolutionary Computation.

[5]  Max Kuhn,et al.  Applied Predictive Modeling , 2013 .

[6]  Jianchao Zeng,et al.  Surrogate-Assisted Cooperative Swarm Optimization of High-Dimensional Expensive Problems , 2017, IEEE Transactions on Evolutionary Computation.

[7]  Ying Tan,et al.  Surrogate-assisted hierarchical particle swarm optimization , 2018, Inf. Sci..

[8]  Giuseppe A. Trunfio,et al.  Investigating surrogate-assisted cooperative coevolution for large-Scale global optimization , 2019, Inf. Sci..

[9]  K. Deb,et al.  Optimal Scheduling of Casting Sequence Using Genetic Algorithms , 2003 .

[10]  Ying Tan,et al.  Multiobjective Infill Criterion Driven Gaussian Process-Assisted Particle Swarm Optimization of High-Dimensional Expensive Problems , 2019, IEEE Transactions on Evolutionary Computation.

[11]  Jon Atli Benediktsson,et al.  Sensitivity of Support Vector Machines to Random Feature Selection in Classification of Hyperspectral Data , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[13]  Giuseppe A. Trunfio,et al.  Large scale optimization of computationally expensive functions: an approach based on parallel cooperative coevolution and fitness metamodeling , 2017, GECCO.

[14]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[15]  Xiaodong Li,et al.  DG2: A Faster and More Accurate Differential Grouping for Large-Scale Black-Box Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[16]  Jianqiao Chen,et al.  A surrogate-based particle swarm optimization algorithm for solving optimization problems with expensive black box functions , 2013 .

[17]  Jianchao Zeng,et al.  A fitness approximation assisted competitive swarm optimizer for large scale expensive optimization problems , 2018, Memetic Comput..

[18]  Ian Griffin,et al.  A hybrid multi-objective evolutionary algorithm using an inverse neural network for aircraft control system design , 2005, 2005 IEEE Congress on Evolutionary Computation.

[19]  Saman K. Halgamuge,et al.  A Recursive Decomposition Method for Large Scale Continuous Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[20]  Yaochu Jin,et al.  A social learning particle swarm optimization algorithm for scalable optimization , 2015, Inf. Sci..

[21]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[22]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[23]  Xiaodong Li,et al.  Adaptive threshold parameter estimation with recursive differential grouping for problem decomposition , 2018, GECCO.

[24]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[25]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[26]  Pao-Ta Yu,et al.  A Dynamic Subspace Method for Hyperspectral Image Classification , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[28]  Kalyanmoy Deb,et al.  Breaking the Billion-Variable Barrier in Real-World Optimization Using a Customized Evolutionary Algorithm , 2016, GECCO.

[29]  Xinyu Li,et al.  Surrogate-guided differential evolution algorithm for high dimensional expensive problems , 2019, Swarm Evol. Comput..

[30]  Bernhard Sendhoff,et al.  A framework for evolutionary optimization with approximate fitness functions , 2002, IEEE Trans. Evol. Comput..

[31]  John Doherty,et al.  Offline Data-Driven Evolutionary Optimization Using Selective Surrogate Ensembles , 2019, IEEE Transactions on Evolutionary Computation.

[32]  X. Yao,et al.  Scaling up fast evolutionary programming with cooperative coevolution , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[33]  Zhigang Ren,et al.  Surrogate model assisted cooperative coevolution for large scale optimization , 2018, Applied Intelligence.

[34]  Jun Zhang,et al.  A Level-Based Learning Swarm Optimizer for Large-Scale Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[35]  Yuan Sun,et al.  Extended Differential Grouping for Large Scale Global Optimization with Direct and Indirect Variable Interactions , 2015, GECCO.