Design of validation experiments for life prediction models

This paper proposes a novel validation experiment design optimization (VEDO) method for the assurance of life prediction model, which is one of the key steps in guaranteeing the reliable design of products in meeting the target service life. Life testing data collected from experiments are important for the validation of time-dependent models. However, directly collecting life data for model validation at the operating stress level is usually time-consuming and expensive. In order to overcome this challenge, the accelerated life testing (ALT) method is employed in the proposed method to collect data for model validation. The connection between ALT and model validation is established first; then a VEDO model is developed using the prior information obtained from the computer simulation model. In the VEDO model, the information gain for model validation is maximized within the testing budget and available testing chamber constraints. The obtained optimal number of tests and testing stress levels are designed to maximize the confidence in the validation results. Various sources of uncertainty such as prediction uncertainty, uncertainty of prior information, and observation errors are included within the optimization process in order to improve the robustness of validation experiment design. A composite helicopter rotor hub component is used to demonstrate the effectiveness of the proposed VEDO method.

[1]  W. Meeker A Comparison of Accelerated Life Test Plans for Weibull and Lognormal Distributions and Type I Censoring , 1984 .

[2]  Yao Zhang,et al.  Bayesian Methods for Planning Accelerated Life Tests , 2006, Technometrics.

[3]  Sankaran Mahadevan,et al.  Threshold stress intensity factor and crack growth rate prediction under mixed-mode loading , 2007 .

[4]  Zissimos P. Mourelatos,et al.  Time-Dependent Reliability of Random Dynamic Systems Using Time-Series Modeling and Importance Sampling , 2011 .

[5]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[6]  Xiaoping Du,et al.  Time-dependent reliability analysis with joint upcrossing rates , 2013 .

[7]  Ramesh Rebba,et al.  Computational methods for model reliability assessment , 2008, Reliab. Eng. Syst. Saf..

[8]  W. Meeker Accelerated Testing: Statistical Models, Test Plans, and Data Analyses , 1991 .

[9]  Lin Sun,et al.  Separation of aleatory and epistemic uncertainty in probabilistic model validation , 2016, Reliab. Eng. Syst. Saf..

[10]  Francis G. Pascual,et al.  Model-Robust Test Plans With Applications in Accelerated Life Testing , 2003, Technometrics.

[11]  Wei Li,et al.  New validation metrics for models with multiple correlated responses , 2014, Reliab. Eng. Syst. Saf..

[12]  Sankaran Mahadevan,et al.  Bayesian risk-based decision method for model validation under uncertainty , 2007, Reliab. Eng. Syst. Saf..

[13]  Sankaran Mahadevan,et al.  Validation of reliability computational models using Bayes networks , 2005, Reliab. Eng. Syst. Saf..

[14]  Sankaran Mahadevan,et al.  Accelerated Life Testing (ALT) Design Based on Computational Reliability Analysis , 2016, Qual. Reliab. Eng. Int..

[15]  W. Oberkampf,et al.  Model validation and predictive capability for the thermal challenge problem , 2008 .

[16]  Sankaran Mahadevan,et al.  Model Predictive Capability Assessment Under Uncertainty , 2005 .

[17]  Sankaran Mahadevan,et al.  Validation of models with multivariate output , 2006, Reliab. Eng. Syst. Saf..

[18]  Hao Zhang,et al.  Design of PH-based accelerated life testing plans under multiple-stress-type , 2007, Reliab. Eng. Syst. Saf..

[19]  D. Massart,et al.  The Mahalanobis distance , 2000 .

[20]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[21]  Tao Yang,et al.  Planning Constant-Stress Accelerated Life Tests for Acceleration Model Selection , 2015, IEEE Transactions on Reliability.

[22]  Sankaran Mahadevan,et al.  Validation and error estimation of computational models , 2006, Reliab. Eng. Syst. Saf..

[23]  Francis G. Pascual,et al.  Accelerated Life Test Plans Robust to Misspecification of the Stress—Life Relationship , 2006, Technometrics.

[24]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[25]  Ying Xiong,et al.  A better understanding of model updating strategies in validating engineering models , 2009 .

[26]  Søren Nymand Lophaven,et al.  DACE - A Matlab Kriging Toolbox, Version 2.0 , 2002 .

[27]  Sankaran Mahadevan,et al.  Quantitative model validation techniques: New insights , 2012, Reliab. Eng. Syst. Saf..

[28]  Zhen Hu,et al.  A Sampling Approach to Extreme Value Distribution for Time-Dependent Reliability Analysis , 2013 .

[29]  Haitao Liao,et al.  Reliability inference for field conditions from accelerated degradation testing , 2006 .

[30]  Raul Tempone,et al.  Fast estimation of expected information gains for Bayesian experimental designs based on Laplace approximations , 2013 .

[31]  Xu Xu,et al.  Surrogate Models for Mixed Discrete-Continuous Variables , 2014, Constraint Programming and Decision Making.

[32]  Xun Huan,et al.  Simulation-based optimal Bayesian experimental design for nonlinear systems , 2011, J. Comput. Phys..

[33]  Sankaran Mahadevan,et al.  Bayesian methodology for reliability model acceptance , 2003, Reliab. Eng. Syst. Saf..

[34]  J. Tinsley Oden,et al.  Virtual model validation of complex multiscale systems: Applications to nonlinear elastostatics , 2013 .

[35]  W. Oberkampf,et al.  Validation of imprecise probability models , 2009 .

[36]  Sankaran Mahadevan,et al.  Fatigue test planning using reliability and confidence simulation , 2001 .

[37]  Xiaoping Du,et al.  Reliability analysis for hydrokinetic turbine blades , 2012 .

[38]  Zhen Hu,et al.  Calibration experimental design considering field response and model uncertainty , 2017 .

[39]  Xiang Jiang,et al.  Bayesian cross-entropy methodology for optimal design of validation experiments , 2006 .

[40]  X. Huan,et al.  GRADIENT-BASED STOCHASTIC OPTIMIZATION METHODS IN BAYESIAN EXPERIMENTAL DESIGN , 2012, 1212.2228.

[41]  Nuno Vasconcelos,et al.  A Kullback-Leibler Divergence Based Kernel for SVM Classification in Multimedia Applications , 2003, NIPS.

[42]  W. Nelson Accelerated Life Testing - Step-Stress Models and Data Analyses , 1980, IEEE Transactions on Reliability.

[43]  Randy R. Sitter,et al.  Using Genetic Algorithms to Design Experiments: A Review , 2015, Qual. Reliab. Eng. Int..

[44]  Zhaojun Li,et al.  Multiobjective Design of Equivalent Accelerated Life Testing Plans , 2008 .

[45]  Wei Zhang,et al.  Investigation of incremental fatigue crack growth mechanisms using in situ SEM testing , 2012 .

[46]  Suzana Dragicevic,et al.  Assessing cellular automata model behaviour using a sensitivity analysis approach , 2006, Comput. Environ. Urban Syst..

[47]  A. Stroud,et al.  Gaussian quadrature formulas , 1966 .

[48]  N. Fard,et al.  Optimal simple step stress accelerated life test design for reliability prediction , 2009 .

[49]  William Q. Meeker,et al.  Theory for Optimum Accelerated Censored Life Tests for Weibull and Extreme Value Distributions , 1978 .

[50]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[51]  Jack P. C. Kleijnen,et al.  EUROPEAN JOURNAL OF OPERATIONAL , 1992 .

[52]  Abhishek Halder,et al.  Model validation: A probabilistic formulation , 2011, IEEE Conference on Decision and Control and European Control Conference.

[53]  Sankaran Mahadevan,et al.  Reliability Analysis of Rotorcraft Composite Structures , 2001 .