Cross-Entropy-Based Importance Sampling with Failure-Informed Dimension Reduction for Rare Event Simulation

The estimation of rare event or failure probabilities in high dimensions is of interest in many areas of science and technology. We consider problems where the rare event is expressed in terms of a computationally costly numerical model. Importance sampling with the cross-entropy method offers an efficient way to address such problems provided that a suitable parametric family of biasing densities is employed. Although some existing parametric distribution families are designed to perform efficiently in high dimensions, their applicability within the cross-entropy method is limited to problems with dimension of O(1e2). In this work, rather than directly building sampling densities in high dimensions, we focus on identifying the intrinsic low-dimensional structure of the rare event simulation problem. To this end, we exploit a connection between rare event simulation and Bayesian inverse problems. This allows us to adapt dimension reduction techniques from Bayesian inference to construct new, effectively low-dimensional, biasing distributions within the cross-entropy method. In particular, we employ the approach in [47], as it enables control of the error in the approximation of the optimal biasing distribution. We illustrate our method using two standard high-dimensional reliability benchmark problems and one structural mechanics application involving random fields.

[1]  S. Asmussen Large Deviations in Rare Events Simulation: Examples, Counterexamples and Alternatives , 2002 .

[2]  Iason Papaioannou,et al.  Improved cross entropy-based importance sampling with a flexible mixture model , 2019, Reliab. Eng. Syst. Saf..

[3]  Robert E. Melchers,et al.  General multi-dimensional probability integration by directional simulation , 1990 .

[4]  Claes Johnson Numerical solution of partial differential equations by the finite element method , 1988 .

[5]  Qiqi Wang,et al.  Erratum: Active Subspace Methods in Theory and Practice: Applications to Kriging Surfaces , 2013, SIAM J. Sci. Comput..

[6]  Eugenio Oñate,et al.  Structural Analysis with the Finite Element Method Linear Statics , 2013 .

[7]  K. Gerstle Advanced Mechanics of Materials , 2001 .

[8]  R. Ash,et al.  Probability and measure theory , 1999 .

[9]  Loïc Brevault,et al.  Probability of failure sensitivity with respect to decision variables , 2015 .

[10]  M. Shinozuka Basic Analysis of Structural Safety , 1983 .

[11]  Tiangang Cui,et al.  Certified dimension reduction in nonlinear Bayesian inverse problems , 2018, Math. Comput..

[12]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[13]  Tiangang Cui,et al.  Likelihood-informed dimension reduction for nonlinear inverse problems , 2014, 1403.4680.

[14]  Reuven Y. Rubinstein,et al.  Simulation and the Monte Carlo method , 1981, Wiley series in probability and mathematical statistics.

[15]  P. Moral,et al.  Sequential Monte Carlo samplers , 2002, cond-mat/0212648.

[16]  R. Rackwitz,et al.  Quadratic Limit States in Structural Reliability , 1979 .

[17]  J. Rosenthal A First Look at Rigorous Probability Theory , 2000 .

[18]  A. Vannucci,et al.  BICS Bath Institute for Complex Systems A note on time-dependent DiPerna-Majda measures , 2008 .

[19]  Reuven Y. Rubinstein,et al.  Optimization of computer simulation models with rare events , 1997 .

[20]  M. Valdebenito,et al.  The role of the design point for calculating failure probabilities in view of dimensionality and structural nonlinearities , 2010 .

[21]  Benjamin Peherstorfer,et al.  Multifidelity Preconditioning of the Cross-Entropy Method for Rare Event Simulation and Failure Probability Estimation , 2018, SIAM/ASA J. Uncertain. Quantification.

[22]  Dirk P. Kroese,et al.  Efficient Monte Carlo simulation via the generalized splitting method , 2012, Stat. Comput..

[23]  Paul G. Constantine,et al.  Active Subspaces - Emerging Ideas for Dimension Reduction in Parameter Studies , 2015, SIAM spotlights.

[24]  Peter W. Glynn,et al.  How to Deal with the Curse of Dimensionality of Likelihood Ratios in Monte Carlo Simulation , 2009 .

[25]  R. Ghanem,et al.  Stochastic Finite Elements: A Spectral Approach , 1990 .

[26]  Edward J. Haug,et al.  Methods of Design Sensitivity Analysis in Structural Optimization , 1979 .

[27]  Dirk P. Kroese,et al.  Generalized Cross-entropy Methods with Applications to Rare-event Simulation and Optimization , 2007, Simul..

[28]  Iason Papaioannou,et al.  Multilevel Estimation of Rare Events , 2015, SIAM/ASA J. Uncertain. Quantification.

[29]  Eugenio Oñate Ibáñez de Navarra,et al.  Structural analysis with the Finite Element Method. , 2009 .

[30]  J. Beck,et al.  Estimation of Small Failure Probabilities in High Dimensions by Subset Simulation , 2001 .

[31]  S. Geyer,et al.  Cross entropy-based importance sampling using Gaussian densities revisited , 2019, Structural Safety.

[32]  Iason Papaioannou,et al.  MCMC algorithms for Subset Simulation , 2015 .

[33]  Tiangang Cui,et al.  Optimal Low-rank Approximations of Bayesian Linear Inverse Problems , 2014, SIAM J. Sci. Comput..

[34]  R. Rackwitz,et al.  A benchmark study on importance sampling techniques in structural reliability , 1993 .

[35]  Andrew M. Stuart,et al.  Inverse problems: A Bayesian perspective , 2010, Acta Numerica.

[36]  Junho Song,et al.  Cross-entropy-based adaptive importance sampling using von Mises-Fisher mixture for high dimensional reliability analysis , 2016 .

[37]  Gerardo Rubino,et al.  Introduction to Rare Event Simulation , 2009, Rare Event Simulation using Monte Carlo Methods.

[38]  Pierre Del Moral,et al.  Sequential Monte Carlo for rare event estimation , 2012, Stat. Comput..

[39]  H. Pradlwarter,et al.  Reliability of Structures in High Dimensions , 2003 .

[40]  Costas Papadimitriou,et al.  Sequential importance sampling for structural reliability analysis , 2016 .

[41]  Yan‐Gang Zhao,et al.  Structural Reliability , 2021 .

[42]  George Biros,et al.  BIMC: The Bayesian Inverse Monte Carlo method for goal-oriented uncertainty quantification. Part I. , 2019, 1911.01268.

[43]  M. Hohenbichler,et al.  Improvement Of Second‐Order Reliability Estimates by Importance Sampling , 1988 .

[44]  Charles C. Margossian,et al.  A review of automatic differentiation and its efficient implementation , 2018, WIREs Data Mining Knowl. Discov..

[45]  H. Kahn,et al.  Methods of Reducing Sample Size in Monte Carlo Computations , 1953, Oper. Res..

[46]  R. Rackwitz,et al.  Structural reliability under combined random load sequences , 1978 .