An active learning variable-fidelity metamodelling approach based on ensemble of metamodels and objective-oriented sequential sampling

ABSTRACT Computational simulation models with different fidelity have been widely used in complex systems design. However, running the high-fidelity (HF) simulation models tends to be very time-consuming, while incorporating low-fidelity (LF), inexpensive models into the design process may result in inaccurate design alternatives. To make a trade-off between high accuracy and low expense, an active learning variable-fidelity (VF) metamodelling approach aiming to integrate information from both LF and HF models is proposed. In the proposed VF metamodelling approach, a model fusion technology based on ensemble of metamodels is employed to map the difference between the HF and LF models. Furthermore, an active learning strategy based on a generalised objective-oriented sequential sampling strategy is introduced to make full use of the already-acquired information of difference characteristics between the HF and LF models. Several numerical and engineering cases verify the applicability of the proposed VF metamodelling approach. Different types of test cases, sample sizes, and metamodel performance evaluation measures including accuracy and robustness are considered.

[1]  Liang Gao,et al.  A generalised collaborative optimisation method and its combination with kriging metamodels for engineering design , 2012 .

[2]  Liang Gao,et al.  A hybrid variable-fidelity global approximation modelling method combining tuned radial basis function base and kriging correction , 2013 .

[3]  P. A. Newman,et al.  Approximation and Model Management in Aerodynamic Optimization with Variable-Fidelity Models , 2001 .

[4]  Bing Li,et al.  A comparative study on quality design of fixture planning for sheet metal assembly , 2008 .

[5]  Wei Chen,et al.  A New Variable-Fidelity Optimization Framework Based on Model Fusion and Objective-Oriented Sequential Sampling , 2007, DAC 2007.

[6]  Dimitri J. Mavriplis,et al.  Derivative-Enhanced Variable Fidelity Surrogate Modeling for Aerodynamic Functions , 2013 .

[7]  Haitao Liu,et al.  A Robust Error-Pursuing Sequential Sampling Approach for Global Metamodeling Based on Voronoi Diagram and Cross Validation , 2014 .

[8]  Shawn E. Gano,et al.  Update strategies for kriging models used in variable fidelity optimization , 2006 .

[9]  Raphael T. Haftka,et al.  Sensitivity-based scaling for approximating. Structural response , 1993 .

[10]  Shawn E. Gano,et al.  Hybrid Variable Fidelity Optimization by Using a Kriging-Based Scaling Function , 2005 .

[11]  Jae-Woo Lee,et al.  A modified variable complexity modeling for efficient multidisciplinary aircraft conceptual design , 2015 .

[12]  G. Gary Wang,et al.  Review of Metamodeling Techniques in Support of Engineering Design Optimization , 2007, DAC 2006.

[13]  Abdollah Homaifar,et al.  Constrained Optimization Via Genetic Algorithms , 1994, Simul..

[14]  Wei Chen,et al.  An Efficient Algorithm for Constructing Optimal Design of Computer Experiments , 2005, DAC 2003.

[15]  Andy J. Keane,et al.  Recent advances in surrogate-based optimization , 2009 .

[16]  Tom Dhaene,et al.  Efficient space-filling and non-collapsing sequential design strategies for simulation-based modeling , 2011, Eur. J. Oper. Res..

[17]  Hui Zhou,et al.  A deterministic robust optimisation method under interval uncertainty based on the reverse model , 2015 .

[18]  Liang Gao,et al.  Difference mapping method using least square support vector regression for variable-fidelity metamodelling , 2015 .

[19]  Sankaran Mahadevan,et al.  Variable-fidelity model selection for stochastic simulation , 2014, Reliab. Eng. Syst. Saf..

[20]  H. Fang,et al.  Global response approximation with radial basis functions , 2006 .

[21]  G. Gary Wang,et al.  Survey of modeling and optimization strategies to solve high-dimensional design problems with computationally-expensive black-box functions , 2010 .

[22]  Erdem Acar,et al.  Effect of error metrics on optimum weight factor selection for ensemble of metamodels , 2015, Expert Syst. Appl..

[23]  Deyi Xue,et al.  A Weighted Sequential Sampling Method Considering Influences of Sample Qualities in Input and Output Parameter Spaces for Global Optimization , 2015, J. Optim. Theory Appl..

[24]  Liang Gao,et al.  A prior-knowledge input LSSVR metamodeling method with tuning based on cellular particle swarm optimization for engineering design , 2014, Expert Syst. Appl..

[25]  Timothy W. Simpson,et al.  Analysis of support vector regression for approximation of complex engineering analyses , 2003, DAC 2003.

[26]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[27]  Carlos A. Coello Coello,et al.  Use of a self-adaptive penalty approach for engineering optimization problems , 2000 .

[28]  Xiao Jian Zhou,et al.  Ensemble of surrogates with recursive arithmetic average , 2011 .

[29]  Stefan Görtz,et al.  Improving variable-fidelity surrogate modeling via gradient-enhanced kriging and a generalized hybrid bridge function , 2013 .

[30]  Vassili Toropov,et al.  Metamodel-based collaborative optimization framework , 2009 .

[31]  Reinhard Radermacher,et al.  Cross-validation based single response adaptive design of experiments for Kriging metamodeling of deterministic computer simulations , 2013 .

[32]  Stefan Görtz,et al.  Hierarchical Kriging Model for Variable-Fidelity Surrogate Modeling , 2012 .

[33]  Tom Dhaene,et al.  Generating Sequential Space-Filling Designs Using Genetic Algorithms and Monte Carlo Methods , 2010, SEAL.

[34]  Farrokh Mistree,et al.  A Sequential Exploratory Experimental Design Method: Development of Appropriate Empirical Models in Design , 2004, DAC 2004.

[35]  Hui Zhou,et al.  An adaptive global variable fidelity metamodeling strategy using a support vector regression based scaling function , 2015, Simul. Model. Pract. Theory.

[36]  Xin Wei,et al.  A new sequential optimal sampling method for radial basis functions , 2012, Appl. Math. Comput..

[37]  Timothy W. Simpson,et al.  Metamodeling in Multidisciplinary Design Optimization: How Far Have We Really Come? , 2014 .

[38]  M. Tyan,et al.  Improving variable-fidelity modelling by exploring global design space and radial basis function networks for aerofoil design , 2015 .

[39]  Dirk Gorissen,et al.  A Novel Hybrid Sequential Design Strategy for Global Surrogate Modeling of Computer Experiments , 2011, SIAM J. Sci. Comput..

[40]  Peng Wang,et al.  Multi-fidelity information fusion based on prediction of kriging , 2015 .

[41]  Guangyao Li,et al.  Variable fidelity design based surrogate and artificial bee colony algorithm for sheet metal forming process , 2012 .

[42]  Liang Gao,et al.  Analysis of gene expression programming for approximation in engineering design , 2012 .

[43]  R. Lewis,et al.  An Overview of First-Order Model Management for Engineering Optimization , 2001 .

[44]  Daniel M. Dunlavy,et al.  Formulations for Surrogate-Based Optimization with Data Fit, Multifidelity, and Reduced-Order Models , 2006 .

[45]  Shapour Azarm,et al.  An accumulative error based adaptive design of experiments for offline metamodeling , 2009 .

[46]  Selen Cremaschi,et al.  Adaptive sequential sampling for surrogate model generation with artificial neural networks , 2014, Comput. Chem. Eng..