Using hierarchical centering to facilitate a reversible jump MCMC algorithm for random effects models

Hierarchical centering has been described as a reparameterization method applicable to random effects models. It has been shown to improve mixing of models in the context of Markov chain Monte Carlo (MCMC) methods. A hierarchical centering approach is proposed for reversible jump MCMC (RJMCMC) chains which builds upon the hierarchical centering methods for MCMC chains and uses them to reparameterize models in an RJMCMC algorithm. Although these methods may be applicable to models with other error distributions, the case is described for a log-linear Poisson model where the expected value λ includes fixed effect covariates and a random effect for which normality is assumed with a zero-mean and unknown standard deviation. For the proposed RJMCMC algorithm including hierarchical centering, the models are reparameterized by modeling the mean of the random effect coefficients as a function of the intercept of the λ model and one or more of the available fixed effect covariates depending on the model. The method is appropriate when fixed-effect covariates are constant within random effect groups. This has an effect on the dynamics of the RJMCMC algorithm and improves model mixing. The methods are applied to a case study of point transects of indigo buntings where, without hierarchical centering, the RJMCMC algorithm had poor mixing and the estimated posterior distribution depended on the starting model. With hierarchical centering on the other hand, the chain moved freely over model and parameter space. These results are confirmed with a simulation study. Hence, the proposed methods should be considered as a regular strategy for implementing models with random effects in RJMCMC algorithms; they facilitate convergence of these algorithms and help avoid false inference on model parameters. We consider a hierarchical centering approach for reversible jump MCMC algorithms.We describe the case for a log-linear Poisson model with mixed effects.The zero-mean of the random effect is replaced with part of the linear predictor.We apply the methods to point transect data of indigo buntings and simulated data.Our methods improve model mixing and inference on parameters.

[1]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[2]  G. Roberts,et al.  Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions , 2003 .

[3]  M. Hurn,et al.  Improving the acceptance rate of reversible jump MCMC proposals , 2004 .

[4]  Bayesian Methods for Hierarchical Distance Sampling Models , 2014 .

[5]  Jonathan J. Forster,et al.  Reversible jump methods for generalised linear models and generalised linear mixed models , 2012, Stat. Comput..

[6]  Joseph Hilbe,et al.  Bayesian Analysis for Population Ecology , 2009 .

[7]  Gareth O. Roberts,et al.  A General Framework for the Parametrization of Hierarchical Models , 2007, 0708.3797.

[8]  Emmanuel Lesaffre,et al.  Generalized linear mixed model with a penalized Gaussian mixture as a random effects distribution , 2008, Comput. Stat. Data Anal..

[9]  Petros Dellaportas,et al.  A novel reversible jump algorithm for generalized linear models , 2011 .

[10]  S. T. Buckland,et al.  Improving distance sampling: accounting for covariates and non‐independency between sampled sites , 2013 .

[11]  Fiona Steele,et al.  The use of simple reparameterizations to improve the efficiency of Markov chain Monte Carlo estimation for multilevel models with applications to discrete time survival models , 2009, Journal of the Royal Statistical Society. Series A,.

[12]  S. R. Searle,et al.  Generalized, Linear, and Mixed Models , 2005 .

[13]  A. Gelfand,et al.  Efficient parametrisations for normal linear mixed models , 1995 .

[14]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[15]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[16]  William J. Browne,et al.  An illustration of the use of reparameterisation methods for improving MCMC efficiency in crossed random effect models , 2004 .

[17]  P. Green,et al.  Delayed rejection in reversible jump Metropolis–Hastings , 2001 .