Sequential Experimental Design and Model Calibration for Targeted Events

Model calibration is often performed with a limited number of data points due to the significant cost of high fidelity simulations or experiments. To capture specific events, such as failure, optimal data collection methods can aid in achieving globally accurate models that can also predict targeted events. In this research, the expected information gain criterion for experimental design is used to determine the most informative designs for sequential calibration of uncertain model parameters. For accurate prediction of events of interest, the Targeted Information Gain for Error Reduction (TIGER) method is introduced to balance the placement of exploration points in the design space based on model accuracy and capturing the event of interest. This approach was compared to using sequential and all-at-once random data collection methods. The comparison of global and local prediction errors indicated that this is a feasible approach based on an analytical two-dimensional example. The method was also successful in a classification problem for flutter and critical limit cycle oscillation amplitude for a panel in hypersonic flow.

[1]  H. Wynn,et al.  Maximum entropy sampling and optimal Bayesian experimental design , 2000 .

[2]  K. J. Ryan,et al.  Estimating Expected Information Gains for Experimental Designs With Application to the Random Fatigue-Limit Model , 2003 .

[3]  M. Eldred,et al.  Efficient Global Reliability Analysis for Nonlinear Implicit Performance Functions , 2008 .

[4]  D. Lindley On a Measure of the Information Provided by an Experiment , 1956 .

[5]  Dinggang Shen,et al.  Multimodality image registration by maximization of quantitative-qualitative measure of mutual information , 2008, Pattern Recognit..

[6]  A. O'Hagan,et al.  Bayesian calibration of computer models , 2001 .

[7]  Ling Li,et al.  Sequential design of computer experiments for the estimation of a probability of failure , 2010, Statistics and Computing.

[8]  W. Oberkampf,et al.  Model validation and predictive capability for the thermal challenge problem , 2008 .

[9]  Gabriel Terejanu,et al.  An Information-Theoretic Approach to Optimally Calibrate Approximate Models , 2012 .

[10]  Michael I. Jordan,et al.  On Discriminative vs. Generative Classifiers: A comparison of logistic regression and naive Bayes , 2001, NIPS.

[11]  C. D. Perttunen,et al.  Lipschitzian optimization without the Lipschitz constant , 1993 .

[12]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[13]  Ricardo Perez,et al.  Investigating Model Uncertainty in the Nonlinear Aeroelastic Response of Thin Panels , 2015 .

[14]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[15]  Victor Picheny,et al.  Adaptive Designs of Experiments for Accurate Approximation of a Target Region , 2010 .

[16]  Peretz P. Friedmann,et al.  Flutter-Boundary Identification for Time-Domain Computational Aeroelasticity , 2007 .

[17]  Diane Villanueva,et al.  Using Expected Information Gain to Design Aerothermal Model Calibration Experiments , 2015 .

[18]  Christopher K. I. Williams,et al.  Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning) , 2005 .

[19]  Silviu Guiasu,et al.  A quantitative-qualitative measure of information in cybernetic systems (Corresp.) , 1968, IEEE Trans. Inf. Theory.

[20]  Anirban Chaudhuri,et al.  Estimating Feasibility Using Multiple Surrogates and ROC Curves , 2013 .

[21]  Xun Huan,et al.  Simulation-based optimal Bayesian experimental design for nonlinear systems , 2011, J. Comput. Phys..

[22]  Michael P. H. Stumpf,et al.  Maximizing the Information Content of Experiments in Systems Biology , 2013, PLoS Comput. Biol..

[23]  Sankaran Mahadevan,et al.  Efficient surrogate models for reliability analysis of systems with multiple failure modes , 2011, Reliab. Eng. Syst. Saf..

[24]  F. Pukelsheim Optimal Design of Experiments , 1993 .

[25]  A. Basudhar,et al.  An improved adaptive sampling scheme for the construction of explicit boundaries , 2010 .