MCMC convergence diagnosis via multivariate bounds on log-concave densities

We begin by showing how piecewise linear bounds may be devised, which bound both above and below any concave log-density in general dimensions. We then show how these bounds may be used to gain an upper bound to the volume in the tails outside the convex hull of the sample path in order to assess how well the sampler has explored the target distribution. This method can be used as a stand-alone diagnostic to determine when the sampler output provides a reliable basis for inference on the stationary density, or in conjunction with existing convergence diagnostics to ensure that they are based upon good sampler output. We provide an example and briefly discuss possible extensions to the method and alternative applications of the bounds. Ž. 1. Introduction. The use of Markov chain Monte Carlo MCMC methods has increased dramatically within the statistical community since their Ž.

[1]  P. McCullagh,et al.  Generalized Linear Models , 1972, Predictive Analytics.

[2]  R. W. Wedderburn,et al.  On the existence and uniqueness of the maximum likelihood estimates for certain generalized linear models , 1976 .

[3]  György Elekes,et al.  A geometric inequality and the complexity of computing volume , 1986, Discret. Comput. Geom..

[4]  Adrian F. M. Smith,et al.  Bayesian computation via the gibbs sampler and related markov chain monte carlo methods (with discus , 1993 .

[5]  P. McCullagh,et al.  Generalized Linear Models , 1992 .

[6]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[7]  W. Gilks,et al.  Adaptive Rejection Sampling for Gibbs Sampling , 1992 .

[8]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[9]  Peter W. Glynn,et al.  Stationarity detection in the initial transient problem , 1992, TOMC.

[10]  Adrian F. M. Smith,et al.  Bayesian Inference for Generalized Linear and Proportional Hazards Models Via Gibbs Sampling , 1993 .

[11]  Bradley P. Carlin,et al.  Markov Chain Monte Carlo conver-gence diagnostics: a comparative review , 1996 .

[12]  R. Tweedie,et al.  Rates of convergence of the Hastings and Metropolis algorithms , 1996 .

[13]  David P. Dobkin,et al.  The quickhull algorithm for convex hulls , 1996, TOMS.

[14]  Alison L. Gibbs,et al.  Convergence of Markov chain Monte Carlo algorithms with applications to image restoration , 2000 .