Model validation and calibration based on component functions of model output

The target in this work is to validate the component functions of model output between physical observation and computational model with the area metric. Based on the theory of high dimensional model representations (HDMR) of independent input variables, conditional expectations are component functions of model output, and the conditional expectations reflect partial information of model output. Therefore, the model validation of conditional expectations tells the discrepancy between the partial information of the computational model output and that of the observations. Then a calibration of the conditional expectations is carried out to reduce the value of model validation metric. After that, a recalculation of the model validation metric of model output is taken with the calibrated model parameters, and the result shows that a reduction of the discrepancy in the conditional expectations can help decrease the difference in model output. At last, several examples are employed to demonstrate the rationality and necessity of the methodology in case of both single validation site and multiple validation sites.

[1]  Ying Xiong,et al.  A better understanding of model updating strategies in validating engineering models , 2009 .

[2]  D Sornette,et al.  Algorithm for model validation: Theory and applications , 2007, Proceedings of the National Academy of Sciences.

[3]  W. Oberkampf,et al.  Validation of imprecise probability models , 2009 .

[4]  Christopher J. Roy,et al.  Verification and Validation in Scientific Computing , 2010 .

[5]  Wei Chen,et al.  Bayesian Validation of Computer Models , 2009, Technometrics.

[6]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[7]  Christopher J. Roy,et al.  A comprehensive framework for verification, validation, and uncertainty quantification in scientific computing , 2011 .

[8]  Douglas M. Bates,et al.  Nonlinear Regression Analysis and Its Applications , 1988 .

[9]  Sankaran Mahadevan,et al.  Validation of reliability computational models using Bayes networks , 2005, Reliab. Eng. Syst. Saf..

[10]  Laura Painton Swiler,et al.  Calibration, validation, and sensitivity analysis: What's what , 2006, Reliab. Eng. Syst. Saf..

[11]  Sankaran Mahadevan,et al.  Model Predictive Capability Assessment Under Uncertainty , 2005 .

[12]  Wei Chen,et al.  SOME METRICS AND A BAYESIAN PROCEDURE FOR VALIDATING PREDICTIVE MODELS IN ENGINEERING DESIGN , 2006, DAC 2006.

[13]  W. Oberkampf,et al.  Model validation and predictive capability for the thermal challenge problem , 2008 .

[14]  Herschel Rabitz,et al.  General formulation of HDMR component functions with independent and correlated variables , 2011, Journal of Mathematical Chemistry.

[15]  Matthew F. Barone,et al.  Measures of agreement between computation and experiment: Validation metrics , 2004, J. Comput. Phys..

[16]  Herschel Rabitz,et al.  Sixth International Conference on Sensitivity Analysis of Model Output Global Sensitivity Analysis for Systems with Independent and / or Correlated Inputs , 2013 .

[17]  Wei Chen,et al.  Toward a Better Understanding of Model Validation Metrics , 2011 .

[18]  Wei Chen,et al.  Approaches for Model Validation: Methodology and Illustration on a Sheet Metal Flanging Process , 2006 .

[19]  Timothy G. Trucano,et al.  Verification and Validation in Computational Fluid Dynamics , 2002 .