Multi-Objective Multi-Generation Gaussian Process Optimizer

We present a multi-objective evolutionary optimization algorithm that uses Gaussian process (GP) regression-based models to select trial solutions in a multi-generation iterative procedure. In each generation, a surrogate model is constructed for each objective function with the sample data. The models are used to evaluate solutions and to select the ones with a high potential before they are evaluated on the actual system. Since the trial solutions selected by the GP models tend to have better performance than other methods that only rely on random operations, the new algorithm has much higher efficiency in exploring the parameter space. Simulations with multiple test cases show that the new algorithm has a substantially higher convergence speed and stability than NSGA-II, MOPSO, and some other recent preselection-assisted algorithms.

[1]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[2]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[3]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[4]  Jianqiang Li,et al.  A novel multi-objective particle swarm optimization with multiple search strategies , 2015, Eur. J. Oper. Res..

[5]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[6]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[7]  Hisao Ishibuchi,et al.  A Framework for Large-Scale Multiobjective Optimization Based on Problem Transformation , 2018, IEEE Transactions on Evolutionary Computation.

[8]  Xiaobiao Huang,et al.  Storage ring nonlinear dynamics optimization with multi-objective multi-generation Gaussian process optimizer , 2020 .

[9]  Carlos A. Coello Coello,et al.  A Study of the Parallelization of a Coevolutionary Multi-objective Evolutionary Algorithm , 2004, MICAI.

[10]  Konstantinos Liagkouras,et al.  An Elitist Polynomial Mutation Operator for Improved Performance of MOEAs in Computer Networks , 2013, 2013 22nd International Conference on Computer Communication and Networks (ICCCN).

[11]  Charles Sinclair,et al.  Multivariate optimization of a high brightness dc gun photoinjector , 2005 .

[12]  A. Xiao,et al.  DIRECT METHODS OF OPTIMIZATION OF STORAGE RING DYNAMIC AND MOMENTUM APERTURE , 2010 .

[13]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[14]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[15]  Lawrence J. Rybarcyk,et al.  Multi-objective particle swarm and genetic algorithm for the optimization of the LANSCE linac operation , 2014 .

[16]  D Robin,et al.  Global Optimization of the Magnetic Lattice Using Genetic Algoritihms , 2008 .

[17]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[18]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[19]  Zhe Zhang,et al.  Online accelerator optimization with a machine learning-based stochastic algorithm , 2020, Mach. Learn. Sci. Technol..

[20]  Xiaobiao Huang,et al.  Nonlinear dynamics optimization with particle swarm and genetic algorithms for SPEAR3 emittance upgrade , 2014 .

[21]  Aimin Zhou,et al.  A Multiobjective Evolutionary Algorithm Based on Decomposition and Preselection , 2015, BIC-TA.

[22]  Nando de Freitas,et al.  A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning , 2010, ArXiv.

[23]  Qingfu Zhang,et al.  A decomposition based multiobjective evolutionary algorithm with classification , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).