The design and analysis of a generalized RESTART/DPR algorithm for rare event simulation

We consider a general class of branching methods with killing for the estimation of rare events. The class includes a number of existing schemes, including RESTART and DPR (Direct Probability Redistribution). A method for the design and analysis is developed when the quantity of interest can be embedded in a sequence whose limit is determined by a large deviation principle. A notion of subsolution for the related calculus of variations problem is introduced, and two main results are proved. One is that the number of particles and the total work scales subexponentially in the large deviation parameter when the branching process is constructed according to a subsolution. The second is that the asymptotic performance of the schemes as measured by the variance of the estimate can be characterized in terms of the subsolution. Some examples are given to demonstrate the performance of the method.

[1]  Peter W. Glynn,et al.  Stochastic Simulation: Algorithms and Analysis , 2007 .

[2]  P. Glasserman,et al.  A large deviations perspective on the efficiency of multilevel splitting , 1998, IEEE Trans. Autom. Control..

[3]  Paul Glasserman,et al.  Multilevel Splitting for Estimating Rare Event Probabilities , 1999, Oper. Res..

[4]  J. Keith Townsend,et al.  The theory of direct probability redistribution and its application to rare event simulation , 1999, TOMC.

[5]  Sylvia Richardson,et al.  Markov Chain Monte Carlo in Practice , 1997 .

[6]  P. A. P. Moran,et al.  The estimation of standard errors in Monte Carlo simulation experiments , 1975 .

[7]  Paul Dupuis,et al.  Importance sampling for Jackson networks , 2009, Queueing Syst. Theory Appl..

[8]  P. Dupuis,et al.  Dynamic importance sampling for queueing networks , 2007, 0710.4389.

[9]  P. Dupuis,et al.  A VISCOSITY SOLUTION APPROACH TO THE ASYMPTOTIC ANALYSIS OF QUEUEING SYSTEMS , 1990 .

[10]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[11]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[12]  J. Lynch,et al.  A weak convergence approach to the theory of large deviations , 1997 .

[13]  José Villén-Altamirano,et al.  Analysis of restart simulation: Theoretical basis and sensitivity study , 2002, Eur. Trans. Telecommun..

[14]  Neal Madras.  Lectures on Monte Carlo Methods , 2002 .

[15]  Bruno Tuffin,et al.  Rare events, splitting, and quasi-Monte Carlo , 2007, TOMC.

[16]  Guy Pujolle,et al.  Introduction to queueing networks , 1987 .

[17]  José Villén-Altamirano,et al.  Rare event RESTART simulation of two-stage networks , 2007, Eur. J. Oper. Res..

[18]  A. Sezer.  Importance sampling for a Markov modulated queuing network , 2009 .

[19]  J. K. Townsend,et al.  The theory of direct probability redistribution and its application to rare event simulation , 1998, ICC '98. 1998 IEEE International Conference on Communications. Conference Record. Affiliated with SUPERCOMM'98 (Cat. No.98CH36220).

[20]  Dan Crisan,et al.  Minimal Entropy Approximations and Optimal Algorithms , 2002, Monte Carlo Methods Appl..

[21]  M. Freidlin,et al.  Random Perturbations of Dynamical Systems , 1984 .

[22]  Paul Dupuis,et al.  Subsolutions of an Isaacs Equation and Efficient Schemes for Importance Sampling , 2005, Math. Oper. Res..

[23]  P. Dupuis,et al.  Splitting for rare event simulation : A large deviation approach to design and analysis , 2007, 0711.2037.

[24]  José Villén-Altamirano,et al.  RESTART: a straightforward method for fast simulation of rare events , 1994, Proceedings of Winter Simulation Conference.