Covariance Decompositions for Accurate Computation in Bayesian Scale-Usage Models

Analyses of multivariate ordinal probit models typically use data augmentation to link the observed (discrete) data to latent (continuous) data via a censoring mechanism defined by a collection of “cutpoints.” Most standard models, for which effective Markov chain Monte Carlo (MCMC) sampling algorithms have been developed, use a separate (and independent) set of cutpoints for each element of the multivariate response. Motivated by the analysis of ratings data, we describe a particular class of multivariate ordinal probit models where it is desirable to use a common set of cutpoints. While this approach is attractive from a data-analytic perspective, we show that the existing efficient MCMC algorithms can no longer be accurately applied. Moreover, we show that attempts to implement these algorithms by numerically approximating required multivariate normal integrals over high-dimensional rectangular regions can result in severely degraded estimates of the posterior distribution. We propose a new data augmentation that is based on a covariance decomposition and that admits a simple and accurate MCMC algorithm. Our data augmentation requires only that univariate normal integrals be evaluated, which can be done quickly and with high accuracy. We provide theoretical results that suggest optimal decompositions within this class of data augmentations, and, based on the theory, recommend default decompositions that we demonstrate work well in practice. This article has supplementary material online.

[1]  A. Genz Numerical Computation of Multivariate Normal Probabilities , 1992 .

[2]  Peter E. Rossi,et al.  Bayesian Statistics and Marketing , 2005 .

[3]  John Geweke,et al.  Efficient Simulation from the Multivariate Normal and Student-t Distributions Subject to Linear Constraints and the Evaluation of Constraint Probabilities , 1991 .

[4]  Peter E. Rossi,et al.  A Bayesian analysis of the multinomial probit model with fully identified parameters , 2000 .

[5]  S. MacEachern Estimating normal means with a conjugate style dirichlet process prior , 1994 .

[6]  Robert M. Gray,et al.  Toeplitz and Circulant Matrices: A Review , 2005, Found. Trends Commun. Inf. Theory.

[7]  Michael Keane,et al.  A Computationally Practical Simulation Estimator for Panel Data , 1994 .

[8]  Siddhartha Chib,et al.  Inference in Semiparametric Dynamic Models for Binary Longitudinal Data , 2006 .

[9]  G. Roberts,et al.  Updating Schemes, Correlation Structure, Blocking and Parameterization for the Gibbs Sampler , 1997 .

[10]  Peter E. Rossi,et al.  Overcoming Scale Usage Heterogeneity , 2001 .

[11]  J. Hsu The Factor Analytic Approach to Simultaneous Inference in the General Linear Model , 1992 .

[12]  Jim Albert,et al.  Ordinal Data Modeling , 2000 .

[13]  Xiao-Li Meng,et al.  The Art of Data Augmentation , 2001 .

[14]  Peter E. Rossi,et al.  An exact likelihood analysis of the multinomial probit model , 1994 .

[15]  D. Dey,et al.  Bayesian analysis for correlated Ordinal Data Models , 2000 .

[16]  Peter E. Rossi,et al.  Bayesian Statistics and Marketing: Rossi/Bayesian Statistics and Marketing , 2006 .

[17]  S. Chib,et al.  Bayesian analysis of binary and polychotomous response data , 1993 .

[18]  Jonathan J. Forster,et al.  Bayesian model determination for multivariate ordinal and binary data , 2008, Comput. Stat. Data Anal..

[19]  Mary Kathryn Cowles,et al.  Accelerating Monte Carlo Markov chain convergence for cumulative-link generalized linear models , 1996, Stat. Comput..

[20]  Richard A. Davis,et al.  Introduction to time series and forecasting , 1998 .

[21]  S. MacEachern,et al.  Estimating mixture of dirichlet process models , 1998 .

[22]  Steven Stern,et al.  Simulation-based estimation , 1997 .

[23]  S. Walker,et al.  Sampling Truncated Normal, Beta, and Gamma Densities , 2001 .

[24]  P. Müller,et al.  Nonparametric Bayesian Modeling for Multivariate Ordinal Data , 2005 .

[25]  Merrill W. Liechty,et al.  Multivariate Normal Slice Sampling , 2010 .

[26]  Jun S. Liu,et al.  Covariance structure of the Gibbs sampler with applications to the comparisons of estimators and augmentation schemes , 1994 .

[27]  Steven Stern,et al.  A Method for Smoothing Simulated Moments of Discrete Probabilities in Multinomial Probit Models , 1992 .

[28]  R. Bhatia Matrix Analysis , 1996 .

[29]  B. Ripley,et al.  An “Unfolding” Latent Variable Model for Likert Attitude Data , 2007 .

[30]  Ming-Hui Chen,et al.  Reparameterizing the generalized linear model to accelerate gibbs sampler convergence , 1996 .

[31]  Paul A. Ruud,et al.  Simulation of multivariate normal rectangle probabilities and their derivatives theoretical and computational results , 1996 .

[32]  S. Chib,et al.  Analysis of multivariate probit models , 1998 .

[33]  Ivan Jeliazkov,et al.  FITTING AND COMPARISON OF MODELS FOR MULTIVARIATE ORDINAL OUTCOMES , 2008 .

[34]  Eric T. Bradlow,et al.  A hierarchical latent variable model for ordinal data from a customer satisfaction survey with no answer responses , 1999 .