On lower confidence bound improvement matrix-based approaches for multiobjective Bayesian optimization and its applications to thin-walled structures

Abstract In engineering practice, most design criteria require time-consuming functional evaluation. To tackle such design problems, multiobjective Bayesian optimization has been widely applied to generation of optimal Pareto solutions. However, improvement function-based expected improvement (EI) and the hypervolume improvement-based lower confidence bound (LCB) infill-criteria are frequently criticized for their high computational cost. To address this issue, this study proposes a novel approach for developing multiobjective LCB criteria on the basis of LCB improvement matrix. Specifically, three cheap yet efficient infill-criteria are suggested by introducing three different improvement functions (namely, hypervolume improvement, Euclidean distance and maximin distance) that assemble the improvement matrix to a scalar value, which is then maximized for adding solution points sequentially. All these criteria have closed-form expressions and can maintain the anticipated properties, thereby largely reducing computational efforts without either integration or expensive evaluation of hypervolume indicator. The efficiency of the proposed criteria is demonstrated through the ZDT and DTLZ tests with different numbers of design variables and different complexities of objectives. The testing results exhibit that the proposed criteria have faster convergence, and enable to generate satisfactory Pareto front with fairly low computational cost compared with other conventional criteria. Finally, the best performing criterion is further applied to real-life design problems of tailor rolled blank (TRB) thin-walled structures under impact loads, which demonstrates a strong search capability for with good distribution of Pareto points, potentially providing an effective means to engineering design with strong nonlinearity and sophistication.

[1]  Thomas J. Santner,et al.  Multiobjective optimization of expensive-to-evaluate deterministic computer simulator models , 2016, Comput. Stat. Data Anal..

[2]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[3]  Jianguang Fang,et al.  A new multi-objective discrete robust optimization algorithm for engineering design , 2018 .

[4]  Qing Li,et al.  Characterization of initial and subsequent yield behaviors of closed-cell aluminum foams under multiaxial loadings , 2020 .

[5]  Hao Wang,et al.  A Multicriteria Generalization of Bayesian Global Optimization , 2016, Advances in Stochastic and Deterministic Global Optimization.

[6]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[7]  Mark Fleischer,et al.  The measure of pareto optima: Applications to multi-objective metaheuristics , 2003 .

[8]  Michael T. M. Emmerich,et al.  Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels , 2006, IEEE Transactions on Evolutionary Computation.

[9]  Tom Dhaene,et al.  Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization , 2014, J. Glob. Optim..

[10]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.

[11]  Thomas Bäck,et al.  Efficient computation of expected hypervolume improvement using box decomposition algorithms , 2019, Journal of Global Optimization.

[12]  Carlos M. Fonseca,et al.  A Box Decomposition Algorithm to Compute the Hypervolume Indicator , 2015, Comput. Oper. Res..

[13]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[14]  Ping Zhu,et al.  Metamodel-based lightweight design of B-pillar with TWB structure via support vector regression , 2010 .

[15]  Andy J. Keane,et al.  On the Design of Optimization Strategies Based on Global Response Surface Approximation Models , 2005, J. Glob. Optim..

[16]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[17]  Andreas Krause,et al.  Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting , 2009, IEEE Transactions on Information Theory.

[18]  Thomas J. Santner,et al.  Design and analysis of computer experiments , 1998 .

[19]  Tom Dhaene,et al.  Multi-objective Bayesian Optimization for Engineering Simulation , 2019, High-Performance Simulation-Based Optimization.

[20]  Jonas Mockus,et al.  On Bayesian Methods for Seeking the Extremum , 1974, Optimization Techniques.

[21]  Carlos M. Fonseca,et al.  Computing 3-D Expected Hypervolume Improvement and Related Integrals in Asymptotically Optimal Time , 2017, EMO.

[22]  Carlos A. Coello Coello,et al.  Solving Multiobjective Optimization Problems Using an Artificial Immune System , 2005, Genetic Programming and Evolvable Machines.

[23]  Jianguang Fang,et al.  On design optimization for structural crashworthiness and its state of the art , 2017 .

[24]  Qing Li,et al.  Robust optimization of foam-filled thin-walled structure based on sequential Kriging metamodel , 2014 .

[25]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[26]  Thomas Bäck,et al.  Multi-Objective Bayesian Global Optimization using expected hypervolume improvement gradient , 2019, Swarm Evol. Comput..

[27]  Qing Li,et al.  Crashing analysis and multiobjective optimization for thin-walled structures with functionally graded thickness , 2014 .

[28]  Michael T. M. Emmerich,et al.  Infill Criteria for Multiobjective Bayesian Optimization , 2020, High-Performance Simulation-Based Optimization.

[29]  Nicola Beume,et al.  An EMO Algorithm Using the Hypervolume Measure as Selection Criterion , 2005, EMO.

[30]  Jianguang Fang,et al.  Multi-objective and multi-case reliability-based design optimization for tailor rolled blank (TRB) structures , 2017 .

[31]  Yunkai Gao,et al.  Crashworthiness analysis and design of multi-cell hexagonal columns under multiple loading cases , 2015 .

[32]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[33]  Marion Merklein,et al.  A review on tailored blanks—Production, applications and evaluation , 2014 .

[34]  Wolfgang Ponweiser,et al.  Multiobjective Optimization on a Limited Budget of Evaluations Using Model-Assisted -Metric Selection , 2008, PPSN.

[35]  Qing Li,et al.  Design of bionic-bamboo thin-walled structures for energy absorption , 2019, Thin-Walled Structures.

[36]  Andy J. Keane,et al.  Statistical Improvement Criteria for Use in Multiobjective Design Optimization , 2006 .

[37]  R. L. Hardy Multiquadric equations of topography and other irregular surfaces , 1971 .

[38]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[39]  Bernhard Sendhoff,et al.  A systems approach to evolutionary multiobjective structural optimization and beyond , 2009, IEEE Computational Intelligence Magazine.

[40]  Xinyu Wang,et al.  A modified hypervolume based expected improvement for multi-objective efficient global optimization method , 2018 .

[41]  Yuansheng Cheng,et al.  Expected Improvement Matrix-Based Infill Criteria for Expensive Multiobjective Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[42]  Wolfgang Ponweiser,et al.  On Expected-Improvement Criteria for Model-based Multi-objective Optimization , 2010, PPSN.

[43]  Qing Li,et al.  A novel failure criterion based upon forming limit curve for thermoplastic composites , 2020 .

[44]  Nando de Freitas,et al.  Taking the Human Out of the Loop: A Review of Bayesian Optimization , 2016, Proceedings of the IEEE.

[45]  Yan Wang,et al.  A New Multi-Objective Bayesian Optimization Formulation With the Acquisition Function for Convergence and Diversity , 2020 .

[46]  Qing Li,et al.  An experimental and numerical study on quasi-static and dynamic crashing behaviors for tailor rolled blank (TRB) structures , 2017 .

[47]  C.A. Coello Coello,et al.  MOPSO: a proposal for multiple objective particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[48]  Bernhard Sendhoff,et al.  A Multiobjective Evolutionary Algorithm Using Gaussian Process-Based Inverse Modeling , 2015, IEEE Transactions on Evolutionary Computation.

[49]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[50]  Søren Nymand Lophaven,et al.  DACE - A Matlab Kriging Toolbox , 2002 .

[51]  Shigeru Obayashi,et al.  Efficient global optimization (EGO) for multi-objective problem and data mining , 2005, 2005 IEEE Congress on Evolutionary Computation.

[52]  Qing Li,et al.  Parallelized multiobjective efficient global optimization algorithm and its applications , 2020 .

[53]  Vladimir Vapnik,et al.  Support-vector networks , 2004, Machine Learning.

[54]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[55]  Xin Yao,et al.  A benchmark test suite for evolutionary many-objective optimization , 2017, Complex & Intelligent Systems.

[56]  Guangyong Sun,et al.  Energy absorption mechanism of axially-varying thickness (AVT) multicell thin-walled structures under out-of-plane loading , 2019, Engineering Structures.