Sequential Monte Carlo for rare event estimation

This paper discusses a novel strategy for simulating rare events and an associated Monte Carlo estimation of tail probabilities. Our method uses a system of interacting particles and exploits a Feynman-Kac representation of that system to analyze their fluctuations. Our precise analysis of the variance of a standard multilevel splitting algorithm reveals an opportunity for improvement. This leads to a novel method that relies on adaptive levels and produces, in the limit of an idealized version of the algorithm, estimates with optimal variance. The motivation for this theoretical work comes from problems occurring in watermarking and fingerprinting of digital contents, which represents a new field of applications of rare event simulation techniques. Some numerical results show performance close to the idealized version of our technique for these practical applications.

[1]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[2]  A. W. Rosenbluth,et al.  MONTE CARLO CALCULATION OF THE AVERAGE EXTENSION OF MOLECULAR CHAINS , 1955 .

[3]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[4]  M. Eisen,et al.  Probability and its applications , 1975 .

[5]  D. Farnsworth.  A First Course in Order Statistics , 1993 .

[6]  L. Tierney.  Markov Chains for Exploring Posterior Distributions , 1994 .

[7]  B. Arnold,et al.  A first course in order statistics , 1994 .

[8]  A. V. D. Vaart,et al.  Asymptotic Statistics: Frontmatter , 1998 .

[9]  Paul Glasserman,et al.  Multilevel Splitting for Estimating Rare Event Probabilities , 1999, Oper. Res..

[10]  Marnix J. J. Garvels,et al.  The splitting method in rare event simulation , 2000 .

[11]  J. Beck,et al.  Estimation of Small Failure Probabilities in High Dimensions by Subset Simulation , 2001 .

[12]  P. Moral,et al.  Sequential Monte Carlo samplers , 2002, cond-mat/0212648.

[13]  Stefano Giordano,et al.  Rare event simulation , 2002, Eur. Trans. Telecommun..

[14]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[15]  James L. Beck,et al.  SUBSET SIMULATION AND ITS APPLICATION TO SEISMIC RISK BASED ON DYNAMIC ANALYSIS , 2003 .

[16]  Alexander Barg,et al.  Digital fingerprinting codes: problem statements, constructions, identification of traitors , 2003, IEEE Trans. Inf. Theory.

[17]  Fernando Pérez-González,et al.  Performance analysis of existing and new methods for data hiding with known-host information in additive channels , 2003, IEEE Trans. Signal Process..

[18]  P. Moral.  Feynman-Kac Formulae: Genealogical and Interacting Particle Systems with Applications , 2004 .

[19]  P. Rousseeuw,et al.  Wiley Series in Probability and Mathematical Statistics , 2005 .

[20]  Nadia Oudjane,et al.  A sequential particle algorithm that keeps the particle system alive , 2005, 2005 13th European Signal Processing Conference.

[21]  P. Moral,et al.  Sequential Monte Carlo samplers for rare events , 2006 .

[22]  John Lygeros,et al.  Stochastic hybrid systems: Theory and safety critical applications , 2006 .

[23]  F. Gland,et al.  Genetic genealogical models in rare event analysis , 2006 .

[24]  P. Moral,et al.  Branching and interacting particle interpretations of rare event probabilities , 2006 .

[25]  F. Cérou,et al.  Adaptive Multilevel Splitting for Rare Event Analysis , 2007 .

[26]  G. Tardos.  Optimal probabilistic fingerprint codes , 2008, JACM.

[27]  Neri Merhav,et al.  Optimal Watermark Embedding and Detection Strategies Under Limited Detection Resources , 2008, IEEE Trans. Inf. Theory.

[28]  P. Moral,et al.  A non asymptotic variance theorem for unnormalized Feynman-Kac particle models , 2008 .

[29]  Neri Merhav,et al.  Optimal Watermark Embedding and Detection Strategies Under Limited Detection Resources , 2008, IEEE Transactions on Information Theory.

[30]  Dirk P. Kroese,et al.  An Efficient Algorithm for Rare-event Probability Estimation, Combinatorial Optimization, and Counting , 2008 .

[31]  R. Rubinstein.  The Gibbs Cloner for Combinatorial Optimization, Counting and Sampling , 2009 .

[32]  James A. Bucklew,et al.  Introduction to Rare Event Simulation , 2010 .

[33]  P. Moral,et al.  A nonasymptotic theorem for unnormalized Feynman-Kac particle models , 2011 .

[34]  Dirk P. Kroese,et al.  Efficient Monte Carlo simulation via the generalized splitting method , 2012, Stat. Comput..