On numerical problems in simulations of highly reliable Markovian systems

Simulation of highly reliable Markovian systems has been the subject of an extensive literature in recent years. Among all methods, simulation using importance sampling schemes gives the best results when the state space is large. In this paper, we highlight numerical problems that arise in rare events simulation, even when using importance sampling. The literature has up to now focused on variance reduction techniques, without any relation to the variance estimation for instance. The main contribution here is to relate the estimation of the considered parameter and of its variance to the bounded relative error and bounded normal approximation properties. We especially show that Bounded Normal Approximation implies that the variance is well-estimated, which implies Bounded Relative Error, implying itself that the parameter is well-estimated, but that no converse implication is true. This emphasizes the importance of Bounded Normal Approximation property, not frequently used in the literature yet.

[1]  B. Tuffin Bounded normal approximation in simulations of highly reliable Markovian systems , 1999 .

[2]  Elmer E Lewis,et al.  Monte Carlo simulation of Markov unreliability models , 1984 .

[3]  Perwez Shahabuddin,et al.  Importance sampling for the simulation of highly reliable Markovian systems , 1994 .

[4]  Philip Heidelberger,et al.  A Unified Framework for Simulating Markovian Models of Highly Dependable Systems , 1992, IEEE Trans. Computers.

[5]  M. Nakayama Asymptotics of likelihood ratio derivative estimators in simulations of highly reliable Markovian systems , 1995 .

[6]  Ronald L. Wasserstein,et al.  Monte Carlo: Concepts, Algorithms, and Applications , 1997 .

[7]  HeidelbergerPhilip Fast simulation of rare events in queueing and reliability models , 1995 .

[8]  Marvin K. Nakayama,et al.  General conditions for bounded relative error in simulations of highly reliable Markovian systems , 1996, Advances in Applied Probability.

[9]  Philip Heidelberger,et al.  Fast simulation of rare events in queueing and reliability models , 1993, TOMC.

[10]  R. S. Randhawa,et al.  Combining importance sampling and temporal difference control variates to simulate Markov Chains , 2004, TOMC.

[11]  Juan A. Carrasco Failure distance-based simulation of repairable fault-tolerant systems , 1992 .

[12]  F. Götze,et al.  The Berry-Esseen bound for student's statistic , 1996 .

[13]  J. Hammersley,et al.  Monte Carlo Methods , 1965 .

[14]  Sandeep Juneja,et al.  Fast Simulation of Markov Chains with Small Transition Probabilities , 2001, Manag. Sci..