A Gaussian Process Assisted Offline Estimation of Multivariate Gaussian Distribution Algorithm

Surrogated assisted evolutionary algorithms are commonly used to solve real-world expensive optimization problems. However, in some situations, no online data is available during the evolution process. In this situation, we have to build surrogate models based on offline historical data, which is known as offline data-driven optimization. Since no new data can be used to improve the surrogate models, offline data-driven optimization remains a challenging problem. In this paper, we propose a Gaussian process assisted offline estimation of multivariate Gaussian distribution algorithm to address the offline data-driven optimization problem. Instead of using surrogate models to predict the fitness values of individuals, we utilize a surrogate model to predict the rankings of individuals based on the frequently used lower confidence bound. In this way, the robustness of the proposed algorithm could be enhanced. Experiments are conducted on five commonly used benchmark problems. The experimental results demonstrate that the proposed offline surrogate model and the multivariate Gaussian estimation of distribution algorithm are able to achieve competitive performance.

[1]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[2]  Sam Kwong,et al.  Evolutionary Divide-and-Conquer Algorithm for Virus Spreading Control Over Networks , 2020, IEEE Transactions on Cybernetics.

[3]  Feng Zhao,et al.  A Cooperative Co-Evolutionary Approach to Large-Scale Multisource Water Distribution Network Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[4]  Wei-Neng Chen,et al.  A Preference Biobjective Evolutionary Algorithm for the Payment Scheduling Negotiation Problem. , 2020, IEEE transactions on cybernetics.

[5]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[6]  Jun Zhang,et al.  Multimodal Estimation of Distribution Algorithms , 2017, IEEE Transactions on Cybernetics.

[7]  Jakub Repický,et al.  Gaussian Process Surrogate Models for the CMA Evolution Strategy , 2019, Evolutionary Computation.

[8]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[9]  Jun Zhang,et al.  Distributed Cooperative Co-Evolution With Adaptive Computing Resource Allocation for Large Scale Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[10]  Nikolaus Hansen,et al.  A global surrogate assisted CMA-ES , 2019, GECCO.

[11]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[12]  Jun Zhang,et al.  A Classifier-Assisted Level-Based Learning Swarm Optimizer for Expensive Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[13]  Jun Zhang,et al.  Handling Uncertainty in Financial Decision Making: A Clustering Estimation of Distribution Algorithm With Simplified Simulation , 2020, IEEE Transactions on Emerging Topics in Computational Intelligence.

[14]  Dan Guo,et al.  Data-Driven Evolutionary Optimization: An Overview and Case Studies , 2019, IEEE Transactions on Evolutionary Computation.

[15]  John Doherty,et al.  Offline Data-Driven Evolutionary Optimization Using Selective Surrogate Ensembles , 2019, IEEE Transactions on Evolutionary Computation.

[16]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[17]  Petros Koumoutsakos,et al.  Local Meta-models for Optimization Using Evolution Strategies , 2006, PPSN.

[18]  Piet Demeester,et al.  A Surrogate Modeling and Adaptive Sampling Toolbox for Computer Based Design , 2010, J. Mach. Learn. Res..

[19]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[20]  Jun Zhang,et al.  Adaptive Multimodal Continuous Ant Colony Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[21]  Qingfu Zhang,et al.  A Gaussian Process Surrogate Model Assisted Evolutionary Algorithm for Medium Scale Expensive Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.

[22]  Jun Zhang,et al.  A Distributed Swarm Optimizer With Adaptive Communication for Large-Scale Optimization , 2020, IEEE Transactions on Cybernetics.