Asymptotics and fast simulation for tail probabilities of maximum of sums of few random variables

We derive tail asymptotics for the probability that the maximum of sums of a few random variables exceeds an increasing threshold, when the random variables may be light as well as heavy tailed. These probabilities arise in many applications including in PERT networks where our interest may be in measuring the probability of large project delays. We also develop provably asymptotically optimal importance sampling techniques to efficiently estimate these probabilities. In the light-tailed settings we show that an appropriate mixture of exponentially twisted distributions efficiently estimates these probabilities. As is well known, exponential twisting based methods are not applicable in the heavy-tailed settings. To remedy this, we develop techniques that rely on “asymptotic hazard rate twisting” and prove their effectiveness in both light and heavy-tailed settings. We show that in many cases the latter may have implementation advantages over exponential twisting based methods in the light-tailed settings. However, our experiments suggest that when easily implementable, the exponential twisting based methods significantly outperform asymptotic hazard rate twisting based methods.

[1]  A. Shiryayev On Sums of Independent Random Variables , 1992 .

[2]  Vidyadhar G. Kulkarni,et al.  A classified bibliography of research on stochastic PERT networks: 1966-1987 , 1989 .

[3]  Jana Jurečková Tail-Behavior of Location Estimators , 1981 .

[4]  J. Corcoran Modelling Extremal Events for Insurance and Finance , 2002 .

[5]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[6]  Salah E. Elmaghraby,et al.  Activity networks: Project planning and control by network models , 1977 .

[7]  Philip Heidelberger,et al.  Fast simulation of rare events in queueing and reliability models , 1993, TOMC.

[8]  Sandeep Juneja,et al.  Simulating heavy tailed processes using delayed hazard rate twisting , 1999, WSC '99.

[9]  Karl Sigman,et al.  Appendix: A primer on heavy-tailed distributions , 1999, Queueing Syst. Theory Appl..

[10]  V. V. Petrov Sums of Independent Random Variables , 1975 .

[11]  Walter Willinger,et al.  On the Self-Similar Nature of Ethernet Traffic ( extended version ) , 1995 .

[12]  C. Klüppelberg,et al.  Modelling Extremal Events , 1997 .

[13]  Zhi Huang,et al.  A unified approach for finite-dimensional, rare-event Monte Carlo simulation , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[14]  Sandeep Juneja,et al.  Simulating heavy tailed processes using delayed hazard rate twisting , 2002, ACM Trans. Model. Comput. Simul..

[15]  P. Shahabuddin,et al.  Chapter 11 Rare-Event Simulation Techniques: An Introduction and Recent Advances , 2006, Simulation.

[16]  Anthony G. Pakes Convolution equivalence and infinite divisibility , 2004, Journal of Applied Probability.

[17]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[18]  PAUL EMBRECHTS,et al.  Modelling of extremal events in insurance and finance , 1994, Math. Methods Oper. Res..

[19]  Walter Willinger,et al.  On the self-similar nature of Ethernet traffic , 1993, SIGCOMM '93.

[20]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[21]  J.S. Sadowsky,et al.  On large deviations theory and asymptotically efficient Monte Carlo estimation , 1990, IEEE Trans. Inf. Theory.

[22]  E. Pitman Subexponential distribution functions , 1980 .