Model improvement with experimental design for identifying error sources in a computational model

Optimization-based model improvement has been introduced as a strategy to enhance the prediction ability of a computational model. It involves model calibration, model validation, and model refinement. Model calibration estimates the optimal value of unknown parameters. Model validation determines the validity of a computational model, and model refinement enhances a model to improve its accuracy. In model improvement, a variety of sources of errors in the observation and prediction can interrupt the model improvement process. The error sources degrade the parameter estimation accuracy in model calibration. When a computational model turns out to be invalid because of these error sources, model refinement is required. However, since model validation cannot distinguish between parameter estimation errors and modeling errors, the existing method is difficult to refine the computational model efficiently. Thus, this study aims to develop a model improvement process that identifies the leading cause of invalidity of a prediction. In this work, an experimental design method is integrated with optimization-based model improvement to minimize the effect of estimation errors in model calibration. Through use of the proposed method, after calibration, the computational model mainly includes the effect of unrecognized modeling errors. Two case studies are provided to confirm the efficacy of the proposed method: an analytical beam study and automotive wheel rim analysis.

[1]  Lorenzo Macorini,et al.  Optimal sensor placement for structural parameter identification , 2016, Structural and Multidisciplinary Optimization.

[2]  Sunwon Park,et al.  Parameter estimation and unique identifiability , 1982 .

[3]  Byeng D. Youn,et al.  Review of statistical model calibration and validation—from the perspective of uncertainty structures , 2019, Structural and Multidisciplinary Optimization.

[4]  Anthony C. Atkinson,et al.  Optimum Experimental Designs, with SAS , 2007 .

[5]  Sankaran Mahadevan,et al.  Quantitative model validation techniques: New insights , 2012, Reliab. Eng. Syst. Saf..

[6]  Sang Bum Kim,et al.  A hierarchical framework for statistical model calibration in engineering product development , 2011 .

[7]  Taejin Kim,et al.  Uncertainty characterization under measurement errors using maximum likelihood estimation: cantilever beam end-to-end UQ test problem , 2019 .

[8]  Ikjin Lee,et al.  Industrial issues and solutions to statistical model improvement: a case study of an automobile steering column , 2020 .

[9]  Byeng D. Youn,et al.  A systematic approach for model refinement considering blind and recognized uncertainties in engineered product development , 2016 .

[10]  Dragan Peraković,et al.  Information and Communication Technologies Within Industry 4.0 Concept , 2018, Lecture Notes in Mechanical Engineering.

[11]  Paul D. Arendt,et al.  Quantification of model uncertainty: Calibration, model discrepancy, and identifiability , 2012 .

[12]  F. Pukelsheim Optimal Design of Experiments , 1993 .

[13]  Roland Eils,et al.  Optimal Experimental Design for Parameter Estimation of a Cell Signaling Model , 2009, PLoS Comput. Biol..

[14]  W. Oberkampf,et al.  Model validation and predictive capability for the thermal challenge problem , 2008 .

[15]  Wei Li,et al.  Integrating Bayesian Calibration, Bias Correction, and Machine Learning for the 2014 Sandia Verification and Validation Challenge Problem , 2016 .

[16]  Sankaran Mahadevan,et al.  Validation and error estimation of computational models , 2006, Reliab. Eng. Syst. Saf..

[17]  Satyandra K. Gupta,et al.  A survey of CAD model simplification techniques for physics-based simulation applications , 2009, Comput. Aided Des..

[18]  M. Plumlee Bayesian Calibration of Inexact Computer Models , 2017 .

[19]  Virgilio Cruz-Machado,et al.  Scanning the Industry 4.0: A Literature Review on Technologies for Manufacturing Systems , 2019, Engineering Science and Technology, an International Journal.

[20]  Daniel C. Kammer Sensor placement for on-orbit modal identification and correlation of large space structures , 1991 .

[21]  William L. Oberkampf,et al.  Verification and Validation in Scientific Computing: Contents , 2010 .

[22]  Alexander Y. Sun,et al.  Model Calibration and Parameter Estimation: For Environmental and Water Resource Systems , 2015 .

[23]  Fei Tao,et al.  Digital Twin and Big Data Towards Smart Manufacturing and Industry 4.0: 360 Degree Comparison , 2018, IEEE Access.

[24]  H. L. Lucas,et al.  DESIGN OF EXPERIMENTS IN NON-LINEAR SITUATIONS , 1959 .

[25]  Hans Bock,et al.  Parameter Estimation and Optimum Experimental Design for Differential Equation Models , 2013 .

[26]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[27]  Dragan Peraković,et al.  Challenges and Issues of ICT in Industry 4.0 , 2019, Lecture Notes in Mechanical Engineering.

[28]  Zhen Hu,et al.  A sequential calibration and validation framework for model uncertainty quantification and reduction , 2020 .

[29]  Byeng D. Youn,et al.  A framework of model validation and virtual product qualification with limited experimental data based on statistical inference , 2015 .

[30]  Wei Chen,et al.  Toward a Better Understanding of Model Validation Metrics , 2011 .

[31]  R. C. St. John,et al.  D-Optimality for Regression Designs: A Review , 1975 .

[32]  W. B. Zimmerman,et al.  INTRODUCTION TO COMSOL MULTIPHYSICS , 2006 .

[33]  D. Ucinski Optimal measurement methods for distributed parameter system identification , 2004 .

[34]  Christopher J. Roy,et al.  Verification and Validation in Scientific Computing , 2010 .

[35]  Guilian Yi,et al.  Special issue: a comprehensive study on enhanced optimization-based model calibration using gradient information , 2018 .

[36]  Rolf Rannacher,et al.  Model Based Parameter Estimation , 2013 .

[37]  Brian Williams,et al.  A Bayesian calibration approach to the thermal problem , 2008 .

[38]  G. Roeck,et al.  Design of sensor networks for instantaneous inversion of modally reduced order models in structural dynamics , 2015 .

[39]  YangQuan Chen,et al.  Optimal Observation for Cyber-physical Systems , 2009 .

[40]  Todd A. Oliver,et al.  Validating predictions of unobserved quantities , 2014, 1404.7555.

[41]  Ying Xiong,et al.  A better understanding of model updating strategies in validating engineering models , 2009 .

[42]  Pieter J. Mosterman,et al.  Industry 4.0 as a Cyber-Physical System study , 2016, Software & Systems Modeling.

[43]  Laura Painton Swiler,et al.  Calibration, validation, and sensitivity analysis: What's what , 2006, Reliab. Eng. Syst. Saf..