ON THE CONVERGENCE OF THE MARKOV CHAIN SIMULATION METHOD

The Markov chain simulation method has been successfully used in many problems, including some that arise in Bayesian statistics. We give a self-contained proof of the convergence of this method in general state spaces under conditions that are easy to verify.

[1]  B. Harshbarger.  An Introduction to Probability Theory and its Applications, Volume I , 1958 .

[2]  Charles J. Stone,et al.  On characteristic functions and renewal theory , 1965 .

[3]  Samuel Karlin,et al.  A First Course on Stochastic Processes , 1968 .

[4]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[5]  P. A. P. Moran,et al.  An introduction to probability theory , 1968 .

[6]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[7]  Frank E. Grubbs,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[8]  D. Vere-Jones.  Markov Chains , 1972, Nature.

[9]  J. Besag.  Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[10]  K. Athreya,et al.  A New Approach to the Limit Theory of Recurrent Markov Chains , 1978 .

[11]  Sheldon M. Ross,et al.  Stochastic Processes , 2018, Gauge Integral Structures for Stochastic Calculus and Quantum Electrodynamics.

[12]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  E. Nummelin.  General irreducible Markov chains and non-negative operators: Embedded renewal processes , 1984 .

[14]  W. Wong,et al.  The calculation of posterior distributions by data augmentation , 1987 .

[15]  Upendra Dave,et al.  Applied Probability and Queues , 1987 .

[16]  A. W. Kemp,et al.  Applied Probability and Queues , 1989 .

[17]  Goodman,et al.  Multigrid Monte Carlo method. Conceptual foundations. , 1989, Physical review. D, Particles and fields.

[18]  On Rates of Convergence of Stochastic Relaxation for Gaussian and Non-Gaussian Distributions* , 1991 .

[19]  Y. Amit.  On rates of convergence of stochastic relaxation for Gaussian and non-Gaussian distributions , 1991 .

[20]  B. Carlin,et al.  On the Convergence of Successive Substitution Sampling , 1992 .

[21]  J. Q. Smith,et al.  1. Bayesian Statistics 4 , 1993 .

[22]  Kung-Sik Chan.  Asymptotic behavior of the Gibbs sampler , 1993 .

[23]  Hani Doss.  Bayesian Nonparametric Estimation for Incomplete Data Via Successive Substitution Sampling , 1994 .

[24]  L. Tierney.  Markov Chains for Exploring Posterior Distributions , 1994 .

[25]  CLAS. Idcation Istrioution,et al.  A Proof of Convergence of the Markov Chain Simulation Method , 2022 .