Bayesian cross-entropy methodology for optimal design of validation experiments

An important concern in the design of validation experiments is how to incorporate the mathematical model in the design in order to allow conclusive comparisons of model prediction with experimental output in model assessment. The classical experimental design methods are more suitable for phenomena discovery and may result in a subjective, expensive, time-consuming and ineffective design that may adversely impact these comparisons. In this paper, an integrated Bayesian cross-entropy methodology is proposed to perform the optimal design of validation experiments incorporating the computational model. The expected cross entropy, an information-theoretic distance between the distributions of model prediction and experimental observation, is defined as a utility function to measure the similarity of two distributions. A simulated annealing algorithm is used to find optimal values of input variables through minimizing or maximizing the expected cross entropy. The measured data after testing with the optimum input values are used to update the distribution of the experimental output using Bayes theorem. The procedure is repeated to adaptively design the required number of experiments for model assessment, each time ensuring that the experiment provides effective comparison for validation. The methodology is illustrated for the optimal design of validation experiments for a three-leg bolted joint structure and a composite helicopter rotor hub component.

[1]  Timothy G. Trucano,et al.  General Concepts for Experimental Validation of ASCI Code Applications , 2002 .

[2]  Sankaran Mahadevan,et al.  Bayesian methodology for reliability model acceptance , 2003, Reliab. Eng. Syst. Saf..

[3]  A. Emery,et al.  Optimal experiment design , 1998 .

[4]  Sankaran Mahadevan,et al.  Model uncertainty and Bayesian updating in reliability-based inspection , 2000 .

[5]  Kathryn Chaloner,et al.  Bayesian Experimental Design for Nonlinear Mixed‐Effects Models with Application to HIV Dynamics , 2004, Biometrics.

[6]  W. L. Oberkampf What are validation experiments? , 2001 .

[7]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[8]  J. W. Tedesco,et al.  Structural Dynamics: Theory and Applications , 1998 .

[9]  Jiju Antony,et al.  Design of experiments for engineers and scientists , 2003 .

[10]  J. Berger,et al.  Testing Precise Hypotheses , 1987 .

[11]  Natasha Smith,et al.  Bayesian networks for system reliability reassessment , 2001 .

[12]  Ian H. Leslie,et al.  Case study for model validation : assessing a model for thermal decomposition of polyurethane foam. , 2004 .

[13]  K. Chaloner,et al.  Bayesian Experimental Design: A Review , 1995 .

[14]  William L. Oberkampf,et al.  Experimental Methodology for Computational Fluid Dynamics Code Validation , 1998 .

[15]  Sankaran Mahadevan,et al.  Validation of reliability computational models using Bayes networks , 2005, Reliab. Eng. Syst. Saf..

[16]  Sankaran Mahadevan,et al.  Bayesian risk-based decision method for model validation under uncertainty , 2007, Reliab. Eng. Syst. Saf..

[17]  Thaweepat Buranathiti,et al.  Model validation via uncertainty propagation and data transformations , 2004 .

[18]  Daniel J. Segalman A Four-Parameter Iwan Model for Lap-Type Joints , 2002 .

[19]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[20]  Robert L. Mason,et al.  Statistical Design and Analysis of Experiments , 2003 .

[21]  Sankaran Mahadevan,et al.  Reliability Analysis of Rotorcraft Composite Structures , 2001 .

[22]  J. Marden,et al.  Hypothesis Testing: From p Values to Bayes Factors , 2000 .

[23]  Timothy G. Trucano,et al.  Verification and Validation in Computational Fluid Dynamics , 2002 .

[24]  Sankaran Mahadevan,et al.  Integration of computation and testing for reliability estimation , 2001, Reliab. Eng. Syst. Saf..

[25]  Sankaran Mahadevan,et al.  Statistical Methods for Model Validation under Uncertainty , 2006 .

[26]  Hojjat Adeli,et al.  Freeway Work Zone Traffic Delay and Cost Optimization Model , 2003 .

[27]  Jeannot Trampert,et al.  Optimal nonlinear Bayesian experimental design: an application to amplitude versus offset experiments , 2003 .

[28]  Sankaran Mahadevan,et al.  Fatigue test planning using reliability and confidence simulation , 2001 .

[29]  B. Bowerman Statistical Design and Analysis of Experiments, with Applications to Engineering and Science , 1989 .

[30]  Douglas C. Montgomery,et al.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments , 1995 .

[31]  Brian Ray Resor,et al.  Experimental Investigations of an Inclined Lap-Type Bolted Joint , 2003 .

[32]  Christian P. Robert,et al.  Estimation of Accuracy in Testing , 1992 .

[33]  Timothy G. Trucano,et al.  Verification and validation. , 2005 .

[34]  James C. Spall,et al.  Introduction to Stochastic Search and Optimization. Estimation, Simulation, and Control (Spall, J.C. , 2007 .

[35]  J. Berger,et al.  Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence , 1987 .

[36]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.