On numerical problems in simulations of highly reliable Markovian systems

Simulation of highly reliable Markovian systems has been the subject of an extensive literature in recent years. Among all methods, simulation using importance sampling schemes gives the best results when the state space is large. In this paper, we highlight numerical problems that arise in rare events simulation, even when using importance sampling. The literature has up to now focused on variance reduction techniques, without any relation to the variance estimation for instance. The main contribution here is to relate the estimation of the considered parameter and of its variance to the bounded relative error and bounded normal approximation properties. We especially show that Bounded Normal Approximation implies that the variance is well-estimated, which implies Bounded Relative Error, implying itself that the parameter is well-estimated, but that no converse implication is true. This emphasizes the importance of Bounded Normal Approximation property, not frequently used in the literature yet.

[1]  M. Nakayama Asymptotics of likelihood ratio derivative estimators in simulations of highly reliable Markovian systems , 1995 .

[2]  Ronald L. Wasserstein,et al.  Monte Carlo: Concepts, Algorithms, and Applications , 1997 .

[3]  R. S. Randhawa,et al.  Combining importance sampling and temporal difference control variates to simulate Markov Chains , 2004, TOMC.

[4]  Marvin K. Nakayama,et al.  General conditions for bounded relative error in simulations of highly reliable Markovian systems , 1996, Advances in Applied Probability.

[5]  Perwez Shahabuddin,et al.  Importance sampling for the simulation of highly reliable Markovian systems , 1994 .

[6]  Sandeep Juneja,et al.  Fast Simulation of Markov Chains with Small Transition Probabilities , 2001, Manag. Sci..

[7]  B. Tuffin Bounded normal approximation in simulations of highly reliable Markovian systems , 1999 .

[8]  Philip Heidelberger,et al.  A Unified Framework for Simulating Markovian Models of Highly Dependable Systems , 1992, IEEE Trans. Computers.

[9]  Elmer E Lewis,et al.  Monte Carlo simulation of Markov unreliability models , 1984 .

[10]  Philip Heidelberger,et al.  Fast simulation of rare events in queueing and reliability models , 1993, TOMC.

[11]  F. Götze,et al.  The Berry-Esseen bound for student's statistic , 1996 .

[12]  Juan A. Carrasco Failure distance-based simulation of repairable fault-tolerant systems , 1992 .

[13]  J. Hammersley,et al.  Monte Carlo Methods , 1965 .

[14]  Gerardo Rubino,et al.  MTTF Estimation using importance sampling on Markov models , 2002, Monte Carlo Methods Appl..