Variable-fidelity model selection for stochastic simulation

This paper presents a model selection methodology for maximizing the accuracy in the predicted distribution of a stochastic output of interest subject to an available computational budget. Model choices of different resolutions/fidelities such as coarse vs. fine mesh and linear vs. nonlinear material model are considered. The proposed approach makes use of efficient simulation techniques and mathematical surrogate models to develop a model selection framework. The model decision is made by considering the expected (or estimated) discrepancy between model prediction and the best available information about the quantity of interest, as well as the simulation effort required for the particular model choice. The form of the best available information may be the result of a maximum fidelity simulation, a physical experiment, or expert opinion. Several different situations corresponding to the type and amount of data are considered for a Monte Carlo simulation over the input space. The proposed methods are illustrated for a crack growth simulation problem in which model choices must be made for each cycle or cycle block even within one input sample.

[1]  R. Ghanem,et al.  Stochastic Finite Elements: A Spectral Approach , 1990 .

[2]  C. L. Mallows.  Some comments on C_p , 1973 .

[3]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[4]  Sankaran Mahadevan,et al.  BIAS MINIMIZATION IN GAUSSIAN PROCESS SURROGATE MODELING FOR UNCERTAINTY QUANTIFICATION , 2011 .

[5]  Theresa Dawn Robinson,et al.  Surrogate-Based Optimization Using Multifidelity Models with Variable Parameterization and Corrected Space Mapping , 2008 .

[6]  Noel A Cressie,et al.  Statistics for Spatial Data, Revised Edition. , 1994 .

[7]  M. Rosenblatt.  Remarks on a Multivariate Transformation , 1952 .

[8]  Marc P. Mignolet,et al.  Recursive Simulation of Stationary Multivariate Random Processes—Part II , 1987 .

[9]  P. Paris.  A rational analytic theory of fatigue , 1961 .

[10]  P. A. Newman,et al.  Approximation and Model Management in Aerodynamic Optimization with Variable-Fidelity Models , 2001 .

[11]  Jerome Sacks,et al.  Designs for Computer Experiments , 1989 .

[12]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[13]  Daniel A. McAdams,et al.  A Methodology for Model Selection in Engineering Design , 2005 .

[14]  Christian P. Robert,et al.  Monte Carlo Statistical Methods , 2005, Springer Texts in Statistics.

[15]  R. Rackwitz,et al.  Structural reliability under combined random load sequences , 1978 .

[16]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[17]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[18]  Sankaran Mahadevan,et al.  Ductile structural system reliability analysis using adaptive importance sampling , 1998 .

[19]  H. Akaike.  A new look at the statistical model identification , 1974 .

[20]  D. Xiu.  Numerical Methods for Stochastic Computations: A Spectral Method Approach , 2010 .

[21]  Sankaran Mahadevan,et al.  Efficient surrogate models for reliability analysis of systems with multiple failure modes , 2011, Reliab. Eng. Syst. Saf..

[22]  Mike Rees,et al.  5. Statistics for Spatial Data , 1993 .

[23]  M. Shinozuka,et al.  Simulation of Stochastic Processes by Spectral Representation , 1991 .

[24]  P. Grünwald.  The Minimum Description Length Principle (Adaptive Computation and Machine Learning) , 2007 .

[25]  Noel A Cressie,et al.  Statistics for Spatial Data. , 1992 .

[26]  Farrokh Mistree,et al.  Model Selection Under Limited Information Using a Value-of-Information-Based Indicator , 2010 .

[27]  Achintya Haldar,et al.  Probability, Reliability and Statistical Methods in Engineering Design (Haldar, Mahadevan) , 1999 .

[28]  Raphael T. Haftka,et al.  Surrogate-based Analysis and Optimization , 2005 .

[29]  A. Harbitz.  An efficient sampling method for probability of failure calculation , 1986 .

[30]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[31]  Sankaran Mahadevan,et al.  Model Selection Among Physics-Based Models , 2013 .

[32]  C. Mallows.  Some Comments on Cp , 2000, Technometrics.