A New Variable-Fidelity Optimization Framework Based on Model Fusion and Objective-Oriented Sequential Sampling

Computational models with variable fidelity have been widely used in engineering design. To alleviate the computational burden, surrogate models are used for optimization without recourse to expensive high-fidelity simulations. In this work, a model fusion technique based on Bayesian Gaussian process modeling is employed to construct cheap, surrogate models to integrate information from both low-fidelity and high-fidelity models, while the interpolation uncertainty of the surrogate model due to the lack of sufficient high-fidelity simulations is quantified. In contrast to space filling, the sequential sampling of a high-fidelity simulation model in our proposed framework is objective-oriented, aiming for improving a design objective. Strategy based on periodical switching criteria is studied which is shown to be effective in guiding the sequential sampling of a high-fidelity model towards improving a design objective as well as reducing the interpolation uncertainty. A design confidence (DC) metric is proposed to serves as the stopping criterion to facilitate design decision making against the interpolation uncertainty. Numerical and engineering examples are provided to demonstrate the benefits of the proposed methodology.

[1]  Ruichen Jin,et al.  On Sequential Sampling for Global Metamodeling in Engineering Design , 2002, DAC 2002.

[2]  Wei Chen,et al.  A Design-Driven Validation Approach Using Bayesian Prediction Models , 2008 .

[3]  Rahul Rai,et al.  Q2S2: A New Methodology for Merging Quantitative and Qualitative Information in Experimental Design , 2008 .

[4]  Michael James Sasena,et al.  Flexibility and efficiency enhancements for constrained global design optimization with kriging approximations. , 2002 .

[5]  Joseph L. Stout,et al.  Robust Piston Design and Optimization Using Piston Secondary Motion Analysis , 2003 .

[6]  Vladimir Balabanov,et al.  Combined Kriging and Gradient-Based Optimization Method , 2006 .

[7]  Daniel W. Apley,et al.  Understanding the Effects of Model Uncertainty in Robust Design With Computer Experiments , 2006 .

[8]  Farrokh Mistree,et al.  A Sequential Exploratory Experimental Design Method: Development of Appropriate Empirical Models in Design , 2004, DAC 2004.

[9]  John E. Renaud,et al.  Variable Fidelity Optimization Using a Kriging Based Scaling Function , 2004 .

[10]  J. F. Rodríguez,et al.  Sequential approximate optimization using variable fidelity response surface approximations , 2000 .

[11]  Andy J. Keane,et al.  A Derivative Based Surrogate Model for Approximating and Optimizing the Output of an Expensive Computer Simulation , 2004, J. Glob. Optim..

[12]  Michael L. Stein,et al.  Interpolation of spatial data , 1999 .

[13]  D. Dennis,et al.  A statistical method for global optimization , 1992, [Proceedings] 1992 IEEE International Conference on Systems, Man, and Cybernetics.

[14]  Shapour Azarm,et al.  Bayesian meta‐modelling of engineering design simulations: a sequential approach with adaptation to irregularities in the response behaviour , 2005 .

[15]  Ruichen. Jin,et al.  Enhancements of metamodeling techniques in engineering design. , 2004 .

[16]  Peter Z. G. Qian,et al.  Bayesian Hierarchical Modeling for Integrating Low-Accuracy and High-Accuracy Experiments , 2008, Technometrics.

[17]  Jay D. Martin,et al.  USE OF ADAPTIVE METAMODELING FOR DESIGN OPTIMIZATION , 2002 .

[18]  S. Azarm,et al.  Bayesian Meta-Modeling of Engineering Design Simulations : A Sequential Approach with Adaptation to Irregularities in the Response Behavior , 2005 .

[19]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[20]  Farrokh Mistree,et al.  A STRATEGY FOR SIMULATION-BASED DESIGN OF MULTISCALE , MULTI-FUNCTIONAL PRODUCTS AND ASSOCIATED DESIGN PROCESSES , 2005 .

[21]  J.W. Bandler,et al.  Space mapping: the state of the art , 2004, IEEE Transactions on Microwave Theory and Techniques.

[22]  Zhengyuan Zhu,et al.  ASYMPTOTIC THEORY FOR KRIGING WITH ESTIMATED PARAMETERS AND ITS APPLICATION TO NETWORK DESIGN ( PRELIMINARY VERSION ) , 2004 .

[23]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[24]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[25]  Thomas J. Santner,et al.  Design and analysis of computer experiments , 1998 .

[26]  Wei Chen,et al.  Bayesian Validation of Computer Models , 2009, Technometrics.

[27]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[28]  R. A. Miller,et al.  Sequential kriging optimization using multiple-fidelity evaluations , 2006 .

[29]  Runze Li,et al.  Analysis of Computer Experiments Using Penalized Likelihood in Gaussian Kriging Models , 2005, Technometrics.

[30]  Richard H. Crawford,et al.  Generic Sequential Sampling for Metamodel Approximations , 2003 .

[31]  Runze Li,et al.  Penalized Likelihood Kriging Model for Analysis of Computer Experiments , 2003, DAC 2003.

[32]  Shawn E. Gano,et al.  Update strategies for kriging models used in variable fidelity optimization , 2006 .

[33]  D. Dennis,et al.  SDO : A Statistical Method for Global Optimization , 1997 .

[34]  Harold S. Park,et al.  Nano Mechanics and Materials: Theory, Multiscale Methods and Applications , 2006 .

[35]  George A. Hazelrigg,et al.  Thoughts on Model Validation for Engineering Design , 2003 .

[36]  Wei Chen,et al.  An Efficient Algorithm for Constructing Optimal Design of Computer Experiments , 2005, DAC 2003.

[37]  Wei Chen,et al.  SOME METRICS AND A BAYESIAN PROCEDURE FOR VALIDATING PREDICTIVE MODELS IN ENGINEERING DESIGN , 2006, DAC 2006.

[38]  P. A. Newman,et al.  Optimization with variable-fidelity models applied to wing design , 1999 .

[39]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[40]  Carolyn Conner Seepersad,et al.  Building Surrogate Models Based on Detailed and Approximate Simulations , 2004, DAC 2004.

[41]  Farrokh Mistree,et al.  A Strategy for Simulation-Based Multiscale, Multi-Functional Products and Associated Design Processes , 2005, DAC 2005.