Variance based sensitivity analysis for Monte Carlo and importance sampling reliability assessment with Gaussian processes

Running a reliability analysis on engineering problems involving complex numerical models can be computationally very expensive, requiring advanced simulation methods to reduce the overall numerical cost. Gaussian process based active learning methods for reliability analysis have emerged as a promising way for reducing this computational cost. The learning phase of these methods consists in building a Gaussian process surrogate model of the performance function and using the uncertainty structure of the Gaussian process to enrich iteratively this surrogate model. For that purpose a learning criterion has to be defined. Then, the estimation of the probability of failure is typically obtained by a classification of a population evaluated on the final surrogate model. Hence, the estimator of the probability of failure holds two different uncertainty sources related to the surrogate model approximation and to the sampling based integration technique. In this paper, we propose a methodology to quantify the sensitivity of the probability of failure estimator to both uncertainty sources. This analysis also enables to control the whole error associated to the failure probability estimate and thus provides an accuracy criterion on the estimation. Thus, an active learning approach integrating this analysis to reduce the main source of error and stopping when the global variability is sufficiently low is introduced. The approach is proposed for both a Monte Carlo based method as well as an importance sampling based method, seeking to improve the estimation of rare event probabilities. Performance of the proposed strategy is then assessed on several examples.

[1]  Gerardo Rubino,et al.  Introduction to Rare Event Simulation , 2009, Rare Event Simulation using Monte Carlo Methods.

[2]  Claire Cannamela,et al.  A Bayesian Approach for Global Sensitivity Analysis of (Multifidelity) Computer Codes , 2013, SIAM/ASA J. Uncertain. Quantification.

[3]  Maurice Lemaire,et al.  Assessing small failure probabilities by combined subset simulation and Support Vector Machines , 2011 .

[4]  I. Sobol,et al.  Sensitivity Measures, ANOVA-like Techniques and the Use of Bootstrap , 1997 .

[5]  Francesco Cadini,et al.  A Bayesian Monte Carlo-based algorithm for the estimation of small failure probabilities of systems affected by uncertainties , 2016, Reliab. Eng. Syst. Saf..

[6]  Shie Mannor,et al.  A Tutorial on the Cross-Entropy Method , 2005, Ann. Oper. Res..

[7]  Carlo Meloni,et al.  Uncertainty Management in Simulation-Optimization of Complex Systems : Algorithms and Applications , 2015 .

[8]  Stefano Marelli,et al.  Rare Event Estimation Using Polynomial-Chaos Kriging , 2017 .

[9]  Jérôme Morio,et al.  Extreme quantile estimation with nonparametric adaptive importance sampling , 2012, Simul. Model. Pract. Theory.

[10]  Ling Li,et al.  Sequential design of computer experiments for the estimation of a probability of failure , 2010, Statistics and Computing.

[11]  Abdul-Hamid Soubra,et al.  Improved active learning probabilistic approach for the computation of failure probability , 2021 .

[12]  Xiaoping Du,et al.  Reliability Analysis With Monte Carlo Simulation and Dependent Kriging Predictions , 2016 .

[13]  G. Matheron Principles of geostatistics , 1963 .

[14]  Carlos Guedes Soares,et al.  Adaptive surrogate model with active refinement combining Kriging and a trust region method , 2017, Reliab. Eng. Syst. Saf..

[15]  Thomas Most,et al.  A comparison of approximate response functions in structural reliability analysis , 2008 .

[16]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[17]  M. Balesdent,et al.  Kriging-based adaptive Importance Sampling algorithms for rare event estimation , 2013 .

[18]  Nicolas Gayton,et al.  AK-MCSi: A Kriging-based method to deal with small failure probabilities and time-consuming models , 2018, Structural Safety.

[19]  Zeyu Wang,et al.  REAK: Reliability analysis through Error rate-based Adaptive Kriging , 2019, Reliab. Eng. Syst. Saf..

[20]  Nicolas Gayton,et al.  AK-SYS: An adaptation of the AK-MCS method for system reliability , 2014, Reliab. Eng. Syst. Saf..

[21]  Costas Papadimitriou,et al.  Sequential importance sampling for structural reliability analysis , 2016 .

[22]  Sankaran Mahadevan,et al.  Efficient surrogate models for reliability analysis of systems with multiple failure modes , 2011, Reliab. Eng. Syst. Saf..

[23]  Jérôme Morio,et al.  A survey of rare event simulation methods for static input-output models , 2014, Simul. Model. Pract. Theory.

[24]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[25]  Nicolas Gayton,et al.  A combined Importance Sampling and Kriging reliability method for small failure probabilities with time-demanding numerical models , 2013, Reliab. Eng. Syst. Saf..

[26]  Samy Missoum,et al.  Reliability assessment using probabilistic support vector machines , 2013 .

[27]  L. Schueremans,et al.  Benefit of splines and neural networks in simulation based structural reliability analysis , 2005 .

[28]  Zeyu Wang,et al.  ESC: an efficient error-based stopping criterion for kriging-based reliability analysis methods , 2018, Structural and Multidisciplinary Optimization.

[29]  Ping Zhang Nonparametric Importance Sampling , 1996 .

[30]  Christopher K. I. Williams,et al.  Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning) , 2005 .

[31]  Hongping Zhu,et al.  Assessing small failure probabilities by AK–SS: An active learning method combining Kriging and Subset Simulation , 2016 .

[32]  Nicolas Gayton,et al.  AK-MCS: An active learning reliability method combining Kriging and Monte Carlo Simulation , 2011 .

[33]  M. Eldred,et al.  Efficient Global Reliability Analysis for Nonlinear Implicit Performance Functions , 2008 .

[34]  Ralf Zimmermann,et al.  On the condition number anomaly of Gaussian correlation matrices , 2015 .

[35]  D. Krige A statistical approach to some basic mine valuation problems on the Witwatersrand, by D.G. Krige, published in the Journal, December 1951 : introduction by the author , 1951 .

[36]  Pan Wang,et al.  A new learning function for Kriging and its applications to solve reliability problems in engineering , 2015, Comput. Math. Appl..

[37]  Robert E. Melchers,et al.  Structural Reliability: Analysis and Prediction , 1987 .

[38]  Enrico Zio,et al.  An improved adaptive kriging-based importance technique for sampling multiple failure regions of low probability , 2014, Reliab. Eng. Syst. Saf..

[39]  Guillaume Perrin,et al.  Active learning surrogate models for the conception of systems with multiple failure modes , 2016, Reliab. Eng. Syst. Saf..

[40]  B. Sudret,et al.  Metamodel-based importance sampling for structural reliability analysis , 2011, 1105.0562.

[41]  Lei Wang,et al.  REIF: A novel active-learning function toward adaptive Kriging surrogate models for structural reliability analysis , 2019, Reliab. Eng. Syst. Saf..

[42]  Andy J. Keane,et al.  Recent advances in surrogate-based optimization , 2009 .

[43]  Julien Bect,et al.  A sequential Bayesian algorithm to estimate a probability of failure , 2009 .

[44]  Ling Li,et al.  Bayesian Subset Simulation: a kriging-based subset simulation algorithm for the estimation of small probabilities of failure , 2012, 1207.1963.

[45]  B. Iooss,et al.  A Review on Global Sensitivity Analysis Methods , 2014, 1404.2405.

[46]  Alan C. Koivunen,et al.  On the condition number of Gaussian sample-covariance matrices , 2000, IEEE Trans. Geosci. Remote. Sens..

[47]  Eric Walter,et al.  An informational approach to the global optimization of expensive-to-evaluate functions , 2006, J. Glob. Optim..

[48]  I. Papaioannou,et al.  Numerical methods for the discretization of random fields by means of the Karhunen–Loève expansion , 2014 .