Likelihood Ratio Sensitivity Analysis for Markovian Models of Highly Dependable Systems

This paper discusses the application of the likelihood ratio gradient estimator to simulations of large Markovian models of highly dependable systems. Extensive empirical work, as well as some mathematical analysis of small dependability models, suggests that in this model setting the gradient estimators are not significantly more noisy than the estimates of the performance measures themselves. The paper also discusses implementation issues associated with likelihood ratio gradient estimation, as well as some theoretical complements associated with application of the technique to continuous-time Markov chains.

[1]  Patrick Billingsley,et al.  Statistical inference for Markov processes , 1961 .

[2]  Michael A. Crane,et al.  Simulating Stable Stochastic Systems, II: Markov Chains , 1974, JACM.

[3]  D. Iglehart,et al.  Discrete time methods for simulating continuous time Markov chains , 1976, Advances in Applied Probability.

[4]  Donald E. Knuth,et al.  Big Omicron and big Omega and big Theta , 1976, SIGA.

[5]  Stephen S. Lavenberg,et al.  Concomitant Control Variables Applied to the Regenerative Simulation of Queuing Systems , 1979, Oper. Res..

[6]  Ing Rj Ser.  Approximation Theorems of Mathematical Statistics , 1980 .

[7]  Kishor S. Trivedi,et al.  Ultrahigh Reliability Prediction for Fault-Tolerant Computer Systems , 1983, IEEE Transactions on Computers.

[8]  Jean-Claude Laprie,et al.  Dependability Evaluation of Software Systems in Operation , 1984, IEEE Transactions on Software Engineering.

[9]  Elmer E Lewis,et al.  Monte Carlo simulation of Markov unreliability models , 1984 .

[10]  Peter W. Glynn,et al.  Proceedings of Ihe 1986 Winter Simulation , 2022 .

[11]  R Y Rubinstein,et al.  The score function approach for sensitivity analysis of computer simulation models , 1986 .

[12]  P. Glynn,et al.  Discrete-time conversion for simulating semi-Markov processes , 1986 .

[13]  Stephen S. Lavenberg,et al.  Modeling and Analysis of Computer System Availability , 1987, Computer Performance and Reliability.

[14]  Peter W. Glynn,et al.  Likelilood ratio gradient estimation: an overview , 1987, WSC '87.

[15]  Philip Heidelberger,et al.  Measure specific dynamic importance sampling for availability simulations , 1987, WSC '87.

[16]  Richard R. Muntz,et al.  Bounding Availability of Repairable Computer Systems , 1989, IEEE Trans. Computers.

[17]  Peter W. Glynn.  Likelihood Ratio Derivative Estimators For Stochastic Systems , 1989, 1989 Winter Simulation Conference Proceedings.

[18]  P. Glynn,et al.  Stochastic Optimization by Simulation: Some Experiments with a Simple Steady-State Queue , 1989 .

[19]  R. Suri,et al.  Perturbation analysis: the state of the art and research issues explained via the GI/G/1 queue , 1989, Proc. IEEE.

[20]  Donald L. Iglehart,et al.  Importance sampling for stochastic simulations , 1989 .

[21]  Reuven Y. Rubinstein,et al.  Sensitivity Analysis and Performance Extrapolation for Computer Simulation Models , 1989, Oper. Res..

[22]  Alan Weiss,et al.  Sensitivity Analysis for Simulations via Likelihood Ratios , 1989, Oper. Res..

[23]  P. L’Ecuyer,et al.  A Unified View of the IPA, SF, and LR Gradient Estimation Techniques , 1990 .

[24]  Peter W. Glynn,et al.  Likelihood ratio gradient estimation for stochastic systems , 1990, CACM.

[25]  Paul Glasserman,et al.  Derivative Estimates from Simulation of Continuous-Time Markov Chains , 1992, Oper. Res..

[26]  Philip Heidelberger,et al.  A Unified Framework for Simulating Markovian Models of Highly Dependable Systems , 1992, IEEE Trans. Computers.

[27]  P. Glynn,et al.  Stochastic optimization by simulation: numerical experiments with the M / M /1 queue in steady-state , 1994 .

[28]  P. Glynn.  LIKELIHOOD RATIO GRADIENT ESTIMATION : AN OVERVIEW by , 2022 .