Improvement of the cross-entropy method in high dimension for failure probability estimation through a one-dimensional projection without gradient estimation

Rare event probability estimation is an important topic in reliability analysis. Stochastic methods, such as importance sampling, have been developed to estimate such probabilities but they often fail in high dimension. In this paper, we propose a new cross-entropy-based importance sampling algorithm to improve rare event probability estimation in high dimension. We focus on the cross-entropy method with Gaussian auxiliary distributions and we suggest to update the Gaussian covariance matrix only in a one-dimensional subspace. For that purpose, the main idea is to consider the projection in the one-dimensional subspace spanned by the sample mean vector, which gives an influential direction for the variance estimation. This approach does not require any additional simulation budget compared to the basic cross-entropy algorithm and we show on different numerical test cases that it greatly improves its performance in high dimension.

[1]  Dirk P. Kroese,et al.  Improved cross-entropy method for estimation , 2011, Statistics and Computing.

[2]  John Dalsgaard Sørensen,et al.  AKOIS: An adaptive Kriging oriented importance sampling method for structural system reliability analysis , 2020 .

[3]  M. Munoz Zuniga,et al.  Structural reliability assessment through surrogate based importance sampling with dimension reduction , 2021, Reliab. Eng. Syst. Saf..

[4]  Zhenzhou Lu,et al.  Subset simulation for structural reliability sensitivity analysis , 2009, Reliab. Eng. Syst. Saf..

[5]  A. Kiureghian,et al.  Multivariate distribution models with prescribed marginals and covariances , 1986 .

[6]  Peter W. Glynn,et al.  How to Deal with the Curse of Dimensionality of Likelihood Ratios in Monte Carlo Simulation , 2009 .

[7]  J. Beck,et al.  Estimation of Small Failure Probabilities in High Dimensions by Subset Simulation , 2001 .

[8]  Petar M. Djuric,et al.  Adaptive Importance Sampling: The past, the present, and the future , 2017, IEEE Signal Processing Magazine.

[9]  Efstratios Nikolaidis,et al.  First- and Second-Order Reliability Methods , 2004 .

[10]  Lambros S. Katafygiotis,et al.  Geometric insight into the challenges of solving high-dimensional reliability problems , 2008 .

[11]  P. Bickel,et al.  Curse-of-dimensionality revisited: Collapse of the particle filter in very large scale systems , 2008, 0805.3034.

[12]  Bernard Delyon,et al.  Asymptotic optimality of adaptive importance sampling , 2018, NeurIPS.

[13]  S. Geyer,et al.  Cross entropy-based importance sampling using Gaussian densities revisited , 2019, Structural Safety.

[14]  Tiangang Cui,et al.  Certified dimension reduction in nonlinear Bayesian inverse problems , 2018, Math. Comput..

[15]  J. Beck,et al.  Important sampling in high dimensions , 2003 .

[16]  Sergey Oladyshkin,et al.  Reliability analysis with stratified importance sampling based on adaptive Kriging , 2020, Reliab. Eng. Syst. Saf..

[17]  Junho Song,et al.  Cross-entropy-based adaptive importance sampling using von Mises-Fisher mixture for high dimensional reliability analysis , 2016 .

[18]  Lih-Yuan Deng,et al.  The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning , 2006, Technometrics.

[19]  S. Marelli,et al.  A generalized framework for active learning reliability: survey and benchmark , 2021 .

[20]  Iason Papaioannou,et al.  Cross-Entropy-Based Importance Sampling with Failure-Informed Dimension Reduction for Rare Event Simulation , 2020, SIAM/ASA J. Uncertain. Quantification.

[21]  Jan C. Neddermeyer Computationally Efficient Nonparametric Importance Sampling , 2008, 0805.3591.

[22]  Shie Mannor,et al.  A Tutorial on the Cross-Entropy Method , 2005, Ann. Oper. Res..

[23]  Christian Gogu,et al.  Variance based sensitivity analysis for Monte Carlo and importance sampling reliability assessment with Gaussian processes , 2020, ArXiv.

[24]  K. M. Zuev,et al.  ESTIMATION OF SMALL FAILURE PROBABILITIES IN HIGH DIMENSIONS BY ADAPTIVE LINKED IMPORTANCE SAMPLING , 2007 .

[25]  Mónica F. Bugallo,et al.  Robust Covariance Adaptation in Adaptive Importance Sampling , 2018, IEEE Signal Processing Letters.

[26]  O. Papaspiliopoulos,et al.  Importance Sampling: Intrinsic Dimension and Computational Cost , 2015, 1511.06196.

[27]  Youngjun Choe,et al.  Cross-entropy based importance sampling for stochastic simulation models , 2018, Reliab. Eng. Syst. Saf..

[28]  J.-M. Bourinet,et al.  The cross-entropy method for reliability assessment of cracked structures subjected to random Markovian loads , 2014, Reliab. Eng. Syst. Saf..

[29]  Jérôme Morio,et al.  A survey of rare event simulation methods for static input-output models , 2014, Simul. Model. Pract. Theory.

[30]  De-Cheng Feng,et al.  A recursive dimension-reduction method for high-dimensional reliability analysis with rare failure event , 2021, Reliab. Eng. Syst. Saf..

[31]  A. Owen,et al.  Safe and Effective Importance Sampling , 2000 .

[32]  Jean-Marc Bourinet Reliability analysis and optimal design under uncertainty - Focus on adaptive surrogate-based approaches , 2018 .

[33]  Iason Papaioannou,et al.  Improved cross entropy-based importance sampling with a flexible mixture model , 2019, Reliab. Eng. Syst. Saf..

[34]  Dirk P. Kroese,et al.  Convergence properties of the cross-entropy method for discrete optimization , 2007, Oper. Res. Lett..

[35]  Jérôme Morio,et al.  Non-parametric adaptive importance sampling for the probability estimation of a launcher impact position , 2011, Reliab. Eng. Syst. Saf..

[36]  Sandeep Juneja,et al.  Portfolio Credit Risk with Extremal Dependence: Asymptotic Analysis and Efficient Simulation , 2008, Oper. Res..

[37]  R. Rackwitz,et al.  Non-Normal Dependent Vectors in Structural Safety , 1981 .

[38]  Xufeng Yang,et al.  System reliability analysis with small failure probability based on active learning Kriging model and multimodal adaptive importance sampling , 2020 .

[39]  Dirk P. Kroese,et al.  Simulation and the Monte Carlo Method (Wiley Series in Probability and Statistics) , 1981 .