Accelerated regeneration for markov chain simulations

This paper describes a generalization of the classical regenerative method of simulation output analysis. Instead of blocking a generated sample path on returns to a fixed return state, a more general scheme to randomly decompose the path is used. In some cases, this decomposition scheme results in regeneration times that are a supersequence of the classical regeneration times. This “accelerated” regeneration is advantageous in several simulation contexts. It is shown that when this decomposition scheme accelerates regeneration relative to the classical regenerative method, it also yields a smaller asymptotic variance of the regenerative variance estimator than the classical method. Several other contexts in which increased regeneration frequency is beneficial are also discussed.

[1]  P. Billingsley,et al.  Convergence of Probability Measures , 1969 .

[2]  A. A. Crane,et al.  An introduction to the regenerative method for simulation analysis , 1977 .

[3]  E. Nummelin,et al.  A splitting technique for Harris recurrent Markov chains , 1978 .

[4]  Donald L. Iglehart,et al.  Regenerative Simulation of Response Times in Networks of Queues , 1980, J. ACM.

[5]  K. Athreya,et al.  A New Approach to the Limit Theory of Recurrent Markov Chains , 1978 .

[6]  P. Heidelberger,et al.  A Renewal Theoretic Approach to Bias Reduction in Regenerative Simulations , 1982 .

[7]  P. Glynn,et al.  Simulation output analysis for general state space Markov chains , 1982 .

[8]  P. Glynn,et al.  Discrete-time conversion for simulating semi-Markov processes , 1986 .

[9]  P. Glynn,et al.  A joint central limit theorem for the sample mean and regenerative variance estimator , 1987 .

[10]  P. Glynn A GSMP formalism for discrete event systems , 1989, Proc. IEEE.

[11]  Philip Heidelberger,et al.  Analysis of parallel replicated simulations under a completion time constraint , 1991, TOMC.

[12]  T. Lindvall Lectures on the Coupling Method , 1992 .

[13]  H. Thorisson Construction of a stationary regenerative process , 1992 .

[14]  Richard L. Tweedie,et al.  Markov Chains and Stochastic Stability , 1993, Communications and Control Engineering Series.

[15]  Benjamin Melamed,et al.  Regenerative simulation of TES processes , 1994 .

[16]  James M. Calvin,et al.  Return-State Independent Quantities in Regenerative Simulation , 1994, Oper. Res..

[17]  P. Glynn Some topics in regenerative steady-state simulation , 1994 .

[18]  P. Glynn,et al.  Likelihood ratio gradient estimation for stochastic recursions , 1995, Advances in Applied Probability.

[19]  Bin Yu,et al.  Regeneration in Markov chain samplers , 1995 .

[20]  P. Glynn,et al.  Efficient Simulation via Coupling , 1996, Probability in the Engineering and Informational Sciences.