Extreme quantile estimation with nonparametric adaptive importance sampling

In this article, we propose a nonparametric adaptive importance sampling (NAIS) algorithm to estimate rare event quantile. Indeed, Importance Sampling (IS) is a well-known adapted random simulation technique. It consists in generating random weighted samples from an auxiliary distribution rather than the distribution of interest. The optimization of this auxiliary distribution is often very difficult in practice. First, we review how to define the optimal auxiliary density of IS for quantile estimation in the general case and then propose a nonparametric method based on Gaussian kernel density estimator to approach the optimal auxiliary density that does not assume an initial PDF guess. This method is then finally applied to theoretical cases to demonstrate the efficiency of the proposed NAIS algorithm and on the quantile estimation of the temperature of a forest fire detection simulator.

[1]  Francis Sullivan,et al.  The importance of importance sampling , 1999, Comput. Sci. Eng..

[2]  G. Schuëller,et al.  Chair of Engineering Mechanics Ifm-publication 2-374 a Critical Appraisal of Reliability Estimation Procedures for High Dimensions , 2022 .

[3]  Keh-Han Wang,et al.  Flexible Porous Wave Barrier for Enhanced Wetlands Habitat Restoration , 2003 .

[4]  Siu-Kui Au,et al.  Compartment fire risk analysis by advanced Monte Carlo simulation , 2007 .

[5]  Christian P. Robert,et al.  Monte Carlo Statistical Methods , 2005, Springer Texts in Statistics.

[6]  Jérôme Morio,et al.  Onboard sensor orientation analysis with kriging method , 2009 .

[7]  Jan C. Neddermeyer Computationally Efficient Nonparametric Importance Sampling , 2008, 0805.3591.

[8]  Rudy Pastel,et al.  An overview of importance splitting for rare event simulation , 2010 .

[9]  Ingrid K. Glad,et al.  Mean-squared error of kernel estimators for finite values of the sample size , 2007 .

[10]  Mark Denny,et al.  Introduction to importance sampling in rare-event simulations , 2001 .

[11]  Terry E. Dielman,et al.  A comparison of quantile estimators , 1994 .

[12]  Daniel Egloff,et al.  QUANTILE ESTIMATION WITH ADAPTIVE IMPORTANCE SAMPLING , 2010, 1002.4946.

[13]  George Michailidis,et al.  Sequential Experiment Design for Contour Estimation From Complex Computer Codes , 2008, Technometrics.

[14]  Herbert A. David,et al.  Order Statistics , 2011, International Encyclopedia of Statistical Science.

[15]  J. Pickands Statistical Inference Using Extreme Order Statistics , 1975 .

[16]  A. Saltelli,et al.  Making best use of model evaluations to compute sensitivity indices , 2002 .

[17]  Helmut J. Pradlwarter,et al.  Chair of Engineering Mechanics Ifm-publication 2-380 Realistic and Efficient Reliability Estimation for Aerospace Structures , 2022 .

[18]  Jan C. Neddermeyer Non-parametric partial importance sampling for financial derivative pricing , 2008 .

[19]  B. Iooss,et al.  Controlled stratification for quantile estimation , 2008, 0802.2426.

[20]  A. Saltelli,et al.  A quantitative model-independent method for global sensitivity analysis of model output , 1999 .

[21]  C. D. Kemp,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[22]  G. I. Schuëller,et al.  Benchmark Study on Reliability Estimation in Higher Dimensions of Structural Systems – An Overview , 2007 .

[23]  P. Moral,et al.  Rare event simulation for a static distribution , 2009 .

[24]  James L. Beck,et al.  SUBSET SIMULATION AND ITS APPLICATION TO SEISMIC RISK BASED ON DYNAMIC ANALYSIS , 2003 .

[25]  Stuart Barber,et al.  All of Statistics: a Concise Course in Statistical Inference , 2005 .

[26]  J. Beck,et al.  Estimation of Small Failure Probabilities in High Dimensions by Subset Simulation , 2001 .

[27]  R. Rubinstein The Cross-Entropy Method for Combinatorial and Continuous Optimization , 1999 .

[28]  Reuven Y. Rubinstein,et al.  Rare event estimation for static models via cross-entropy and importance sampling , 2003 .

[29]  Jérôme Morio,et al.  Non-parametric adaptive importance sampling for the probability estimation of a launcher impact position , 2011, Reliab. Eng. Syst. Saf..

[30]  Ling Li,et al.  Sequential design of computer experiments for the estimation of a probability of failure , 2010, Statistics and Computing.

[31]  Lambros S. Katafygiotis,et al.  A two-stage Subset Simulation-based approach for calculating the reliability of inelastic structural systems subjected to Gaussian random excitations , 2005 .

[32]  John S. Hendricks,et al.  Importance estimation in forward Monte Carlo calculations , 1984 .

[33]  Arthur Charpentier,et al.  Beta kernel quantile estimators of heavy-tailed loss distributions , 2010, Stat. Comput..

[34]  Yun Bae Kim,et al.  Nonparametric adaptive importance sampling for rare event simulation , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[35]  Ping Zhang Nonparametric Importance Sampling , 1996 .

[36]  I. Beichl,et al.  Approximating the Permanent via Importance Sampling with Application to the Dimer Covering Problem , 1999 .

[37]  Eric P. Smith,et al.  An Introduction to Statistical Modeling of Extreme Values , 2002, Technometrics.

[38]  P. Borcherds Importance sampling: an illustrative introduction , 2000 .

[39]  B. Arnold,et al.  A first course in order statistics , 1994 .

[40]  Lambros S. Katafygiotis,et al.  Application of spherical subset simulation method and auxiliary domain method on a benchmark reliability study , 2007 .

[41]  Siu-Kui Au,et al.  Reliability-based design sensitivity by efficient simulation , 2005 .

[42]  B. Arnold,et al.  A first course in order statistics , 2008 .

[43]  Bernard W. Silverman,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[44]  Dimos C. Charmpis,et al.  Application of line sampling simulation method to reliability benchmark problems , 2007 .

[45]  Arnaud Guyader,et al.  ADAPTIVE PARTICLE TECHNIQUES AND RARE EVENT ESTIMATION , 2007 .

[46]  Reuven Y. Rubinstein,et al.  Optimization of computer simulation models with rare events , 1997 .

[47]  Victor Picheny,et al.  Adaptive Designs of Experiments for Accurate Approximation of a Target Region , 2010 .

[48]  Bruno Tuffin,et al.  Splitting for rare-event simulation , 2006, WSC.

[49]  James Stephen Marron,et al.  Transformations in Density Estimation , 1991 .

[50]  Jérôme Morio,et al.  Importance sampling: how to approach the optimal density? , 2010 .