Advanced Methodology for Uncertainty Propagation in Computer Experiments with Large Number of Inputs

Abstract In the framework of the estimation of safety margins in nuclear accident analysis, a quantitative assessment of the uncertainties tainting the results of computer simulations is essential. Accurate uncertainty propagation (estimation of high probabilities or quantiles) and quantitative sensitivity analysis may call for several thousand code simulations. Complex computer codes, as the ones used in thermal-hydraulic accident scenario simulations, are often too CPU-time expensive to be directly used to perform these studies. A solution consists in replacing the computer model by a CPU-inexpensive mathematical function, called a metamodel, built from a reduced number of code simulations. However, in case of high-dimensional experiments (with typically several tens of inputs), the metamodel building process remains difficult. To face this limitation, we propose a methodology which combines several advanced statistical tools: initial space-filling design, screening to identify the noninfluential inputs, and Gaussian process (Gp) metamodel building with the group of influential inputs as explanatory variables. The residual effect of the group of noninfluential inputs is captured by another Gp metamodel. Then, the resulting joint Gp metamodel is used to accurately estimate Sobol’ sensitivity indices and high quantiles (here 95% quantile). The efficiency of the methodology to deal with a large number of inputs and reduce the calculation budget is illustrated on a thermal-hydraulic calculation case simulating with the CATHARE2 code a loss-of-coolant accident scenario in a pressurized water reactor. A predictive Gp metamodel is built with only a few hundred code simulations which allows the calculation of the Sobol’ sensitivity indices. This Gp also provides a more accurate estimation of the 95% quantile and associated confidence interval than the empirical approach, at equal calculation budget. Moreover, on this test case, the joint Gp approach outperforms the simple Gp.

[1]  Alessandro Petruzzi,et al.  Approaches, Relevant Topics, and Internal Method for Uncertainty Evaluation in Predictions of Thermal-Hydraulic System Codes , 2008 .

[2]  A. Prošek,et al.  The State-of-the-Art Theory and Applications of Best-Estimate Plus Uncertainty Methods , 2007 .

[3]  Graham B. Wallis,et al.  Uncertainties and probabilities in nuclear reactor regulation , 2007 .

[4]  Henry P. Wynn,et al.  Screening, predicting, and computer experiments , 1992 .

[5]  B. Iooss,et al.  Derivative based global sensitivity measures , 2014, 1412.2619.

[6]  W. Hoeffding A Class of Statistics with Asymptotically Normal Distribution , 1948 .

[7]  Susan M. Lewis,et al.  Design of experiments for screening , 2015, 1510.05248.

[8]  J. P. Dejean,et al.  Prediction and Density Estimation of a Horizontal Well Productivity Index Using Generalized Linear Models , 1998 .

[9]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[10]  H Christopher Frey,et al.  OF SENSITIVITY ANALYSIS , 2001 .

[11]  Bertrand Iooss,et al.  An efficient methodology for the analysis and modeling of computer experiments with large number of inputs , 2017, 1704.07090.

[12]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[13]  Francesco Saverio D'Auria,et al.  Assessment of an Isolation Condenser of an Integral Reactor in View of Uncertainties in Engineering Parameters , 2011 .

[14]  Francesc Reventos,et al.  Uncertainty and sensitivity analysis of the LOFT L2-5 test: Results of the BEMUSE programme , 2008 .

[15]  Brian Rutherford,et al.  A response-modeling alternative to surrogate models for support in computational analyses , 2006, Reliab. Eng. Syst. Saf..

[16]  Saltelli Andrea,et al.  Global Sensitivity Analysis: The Primer , 2008 .

[17]  Bertrand Iooss,et al.  Global sensitivity analysis of computer models with functional inputs , 2008, Reliab. Eng. Syst. Saf..

[18]  R. P. Martin,et al.  Perspectives on the Application of Order-Statistics in Best-Estimate Plus Uncertainty Nuclear Safety Analysis , 2011 .

[19]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[20]  Bertrand Iooss,et al.  An efficient methodology for modeling complex computer codes with Gaussian processes , 2008, Comput. Stat. Data Anal..

[21]  Bernhard Schölkopf,et al.  Measuring Statistical Dependence with Hilbert-Schmidt Norms , 2005, ALT.

[22]  Jerome Sacks,et al.  Choosing the Sample Size of a Computer Experiment: A Practical Guide , 2009, Technometrics.

[23]  D. Cacuci Sensitivity theory for nonlinear systems. I. Nonlinear functional analysis approach , 1981 .

[24]  Gary E. Wilson,et al.  Historical insights in the development of Best Estimate Plus Uncertainty safety analysis , 2013 .

[25]  Olivier Roustant,et al.  Data-driven Kriging models based on FANOVA-decomposition , 2012, Stat. Comput..

[26]  M. Morris The Design and Analysis of Computer Experiments , 2004 .

[27]  Andy J. Keane,et al.  Engineering Design via Surrogate Modelling - A Practical Guide , 2008 .

[28]  Thomas Hochkirchen Design and Modeling for Computer Experiments by K.-T. Fang, R. Li and A. Sudjianto , 2006 .

[29]  Enrico Zio,et al.  Bootstrap and Order Statistics for Quantifying Thermal-Hydraulic Code Uncertainties in the Estimation of Safety Margins , 2008 .

[30]  Stefano Tarantola,et al.  Uncertainty in Industrial Practice , 2008 .

[31]  Ilya M. Sobol,et al.  Sensitivity Estimates for Nonlinear Mathematical Models , 1993 .

[32]  V. R. Joseph,et al.  Maximum projection designs for computer experiments , 2015 .

[33]  B. Iooss,et al.  Controlled stratification for quantile estimation , 2008, 0802.2426.

[34]  Carlo Meloni,et al.  Uncertainty Management in Simulation-Optimization of Complex Systems : Algorithms and Applications , 2015 .

[35]  Sébastien Da Veiga,et al.  Global sensitivity analysis with dependence measures , 2013, ArXiv.

[36]  Runze Li,et al.  Design and Modeling for Computer Experiments , 2005 .

[37]  J. Chilès,et al.  Geostatistics: Modeling Spatial Uncertainty , 1999 .

[38]  Claire Cannamela,et al.  A Bayesian Approach for Global Sensitivity Analysis of (Multifidelity) Computer Codes , 2013, SIAM/ASA J. Uncertain. Quantification.

[39]  F. Gamboa,et al.  Statistical inference for Sobol pick-freeze Monte Carlo method , 2013, 1303.6447.

[40]  Alessandro Petruzzi,et al.  Comparison between Best-Estimate–Plus–Uncertainty Methods and Conservative Tools for Nuclear Power Plant Licensing , 2010 .

[41]  Jon C. Helton,et al.  Survey of sampling-based methods for uncertainty and sensitivity analysis , 2006, Reliab. Eng. Syst. Saf..

[42]  B. Iooss,et al.  A Review on Global Sensitivity Analysis Methods , 2014, 1404.2405.

[43]  Bertrand Iooss,et al.  Global sensitivity analysis of stochastic computer models with joint metamodels , 2008, Statistics and Computing.

[44]  A. Marrel,et al.  New improvements in the use of dependence measures for sensitivity analysis and screening , 2014, 1412.1414.

[45]  David Ginsbourger,et al.  ANOVA kernels and RKHS of zero mean functions for model-based sensitivity analysis , 2011, J. Multivar. Anal..

[46]  Bertrand Iooss,et al.  Numerical studies of space-filling designs: optimization of Latin Hypercube Samples and subprojection properties , 2013, J. Simulation.

[47]  J. Uhlmann,et al.  ROBUSTNESS OF WILKS' CONSERVATIVE ESTIMATE OF CONFIDENCE INTERVALS , 2015 .

[48]  J. Oakley Estimating percentiles of uncertain computer code outputs , 2004 .

[49]  Wei Chen,et al.  An Efficient Algorithm for Constructing Optimal Design of Computer Experiments , 2005, DAC 2003.

[50]  Ana Sánchez,et al.  Uncertainty analysis of a large break loss of coolant accident in a pressurized water reactor using non-parametric methods , 2018, Reliab. Eng. Syst. Saf..

[51]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[52]  A. Saltelli,et al.  Importance measures in global sensitivity analysis of nonlinear models , 1996 .

[53]  Emanuele Borgonovo,et al.  Sensitivity analysis: A review of recent advances , 2016, Eur. J. Oper. Res..

[54]  Graham B. Wallis,et al.  Evaluation of nuclear safety from the outputs of computer codes in the presence of uncertainties , 2004, Reliab. Eng. Syst. Saf..

[55]  Jack P. C. Kleijnen,et al.  Sensitivity analysis and related analyses: A review of some statistical techniques , 1997 .

[56]  Olivier Roustant,et al.  Poincaré inequalities on intervals – application to sensitivity analysis , 2016, 1612.03689.

[57]  Mohammad Modarres,et al.  Integrated Methodology for Thermal-Hydraulic Code Uncertainty Analysis with Application , 2009 .