A framework of model validation and virtual product qualification with limited experimental data based on statistical inference

Virtual testing is a recent engineering development trend to design, evaluate, and test new engineered products. This research proposes a framework of virtual testing based on statistical inference for new product development comprising of three successive steps: (i) statistical model calibration, (ii) hypothesis test for validity check and (iii) virtual qualification. Statistical model calibration first improves the predictive capability of a computational model in a calibration domain. Next, the hypothesis test is performed with limited observed data to see if a calibrated model is sufficiently predictive for virtual testing of a new product design. An area metric and the u-pooling method are employed for the hypothesis test to measure the degree of mismatch between predicted and observed results while considering statistical uncertainty in the area metric due to the lack of experimental data. Once the calibrated model becomes valid, the virtual qualification process can be executed with a qualified model for new product developments. The qualification process builds a design decision matrix to aid in rational decision-making for product design alternatives. The effectiveness of the proposed framework is demonstrated through the case study of a tire tread block.

[1]  James O. Berger,et al.  A Bayesian analysis of the thermal challenge problem , 2008 .

[2]  Ben H. Thacker,et al.  Concepts of Model Verification and Validation , 2004 .

[3]  J. C. Cho,et al.  Prediction of Tread Pattern Wear by an Explicit Finite Element Model3 , 2007 .

[4]  Herbert A. Mang,et al.  Sliding behaviour of simplified tire tread patterns investigated by means of FEM , 2006 .

[5]  Laura Painton Swiler,et al.  Calibration, validation, and sensitivity analysis: What's what , 2006, Reliab. Eng. Syst. Saf..

[6]  T. Trucano,et al.  Verification, Validation, and Predictive Capability in Computational Engineering and Physics , 2004 .

[7]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[8]  P. Roache Verification of Codes and Calculations , 1998 .

[9]  Leonard E. Schwer,et al.  An overview of the PTC 60/V&V 10: guide for verification and validation in computational solid mechanics , 2007, Engineering with Computers.

[10]  Sang Bum Kim,et al.  A hierarchical framework for statistical model calibration in engineering product development , 2011 .

[11]  Chao Hu,et al.  A comparative study of probability estimation methods for reliability analysis , 2012 .

[12]  Matthew F. Barone,et al.  Measures of agreement between computation and experiment: Validation metrics , 2004, J. Comput. Phys..

[13]  Sankaran Mahadevan,et al.  Bayesian methodology for reliability model acceptance , 2003, Reliab. Eng. Syst. Saf..

[14]  Ying Xiong,et al.  A better understanding of model updating strategies in validating engineering models , 2009 .

[15]  Brian Williams,et al.  A Bayesian calibration approach to the thermal problem , 2008 .

[16]  Thaweepat Buranathiti,et al.  Model validation via uncertainty propagation and data transformations , 2004 .

[17]  B. Youn,et al.  Eigenvector dimension reduction (EDR) method for sensitivity-free probability analysis , 2008 .

[18]  Katherine Campbell,et al.  Statistical calibration of computer simulations , 2006, Reliab. Eng. Syst. Saf..

[19]  Byeng D. Youn,et al.  A study on robust design optimization of layered plate bonding process considering uncertainties , 2007 .

[20]  J. Tinsley Oden,et al.  Verification and validation in computational engineering and science: basic concepts , 2004 .

[21]  Mohammad Modarres,et al.  Reliability engineering and risk analysis : a practical guide , 2016 .

[22]  Timothy G. Trucano,et al.  Statistical Validation of Engineering and Scientific Models: A Maximum Likelihood Based Metric , 2002 .

[23]  W. Oberkampf,et al.  Model validation and predictive capability for the thermal challenge problem , 2008 .

[24]  Wei Chen,et al.  A Design-Driven Validation Approach Using Bayesian Prediction Models , 2008 .

[25]  Byeng D. Youn,et al.  Optimal Design of Constrained-Layer Damping Structures Considering Material and Operational Condition Variability , 2009 .

[26]  Byeng D. Youn,et al.  Bayesian Reliability Analysis With Evolving, Insufficient, and Subjective Data Sets , 2009 .