Bayesian model determination for multivariate ordinal and binary data

Different conditional independence specifications for ordinal categorical data are compared by calculating a posterior distribution over classes of graphical models. The approach is based on the multivariate ordinal probit model where the data are considered to have arisen as truncated multivariate normal random vectors. By parameterising the precision matrix of the associated multivariate normal in Cholesky form, ordinal data models corresponding to directed acyclic conditional independence graphs for the latent variables can be specified and conveniently computed. Where one or more of the variables are binary this parameterisation is particularly compelling, as necessary constraints on the latent variable distribution can be imposed in such a way that a standard, fully normalised, prior can still be adopted. For comparing different directed graphical models a reversible jump Markov chain Monte Carlo (MCMC) approach is proposed. Where interest is focussed on undirected graphical models, this approach is augmented to allow switches in the orderings of variables of associated directed graphs, hence allowing the posterior distribution over decomposable undirected graphical models to be computed. The approach is illustrated with several examples, involving both binary and ordinal variables, and directed and undirected graphical model classes.

[1]  M W Knuiman,et al.  Incorporating prior information into the analysis of contingency tables. , 1988, Biometrics.

[2]  S. Chib,et al.  Analysis of multivariate probit models , 1998 .

[3]  J. Ashford,et al.  Multi-variate probit analysis. , 1970, Biometrics.

[4]  Paolo Giudici,et al.  Markov Chain Monte Carlo model selection for DAG models , 2004 .

[5]  R. Kohn,et al.  Parsimonious Covariance Matrix Estimation for Longitudinal Data , 2002 .

[6]  L. A. Goodman.  Simple Models for the Analysis of Association in Cross-Classifications Having Ordered Categories , 1979 .

[7]  D. Edwards.  Introduction to graphical modelling , 1995 .

[8]  S. Chib,et al.  Bayesian analysis of binary and polychotomous response data , 1993 .

[9]  A. Dawid,et al.  Hyper Markov Laws in the Statistical Analysis of Decomposable Graphical Models , 1993 .

[10]  D. K. Dey,et al.  BAYESIAN MODELING OF CORRELATED BINARY RESPONSES VIA SCALE MIXTURE OF MULTIVARIATE NORMAL LINK FUNCTIONS , 1998 .

[11]  L. Devroye.  Non-Uniform Random Variate Generation , 1986 .

[12]  N. Wermuth,et al.  On the Application of Conditional Independence to Ordinal Data , 1998 .

[13]  Ming-Hui Chen,et al.  Properties of Prior and Posterior Distributions for Multivariate Categorical Response Data Models , 1999 .

[14]  D. Madigan,et al.  Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window , 1994 .

[15]  Eva-Maria Fronk,et al.  Model Selection for Dags via RJMCMC for the Discrete and Mixed Case , 2002 .

[16]  Vern I. Paulsen,et al.  Schur Products and Matrix Completions , 1989 .

[17]  A. Roverato.  Cholesky decomposition of a hyper inverse Wishart matrix , 2000 .

[18]  P. Dellaportas,et al.  Markov chain Monte Carlo model determination for hierarchical and graphical log-linear models , 1999 .

[19]  P. Green.  Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[20]  Charles J. Geyer,et al.  Practical Markov Chain Monte Carlo , 1992 .

[21]  G. Roberts,et al.  Bayesian Inference For Nondecomposable Graphical Gaussian Models. , 2003 .

[22]  Petros Dellaportas,et al.  Model determination for categorical data with factor level merging , 2005 .

[23]  Louis Ibarra,et al.  Generating and characterizing the perfect elimination orderings of a chordal graph , 2003, Theor. Comput. Sci..

[24]  P. Müller,et al.  Nonparametric Bayesian Modeling for Multivariate Ordinal Data , 2005 .

[25]  John Geweke,et al.  Efficient Simulation from the Multivariate Normal and Student-t Distributions Subject to Linear Constraints and the Evaluation of Constraint Probabilities , 1991 .

[26]  Andrew Thomas,et al.  WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility , 2000, Stat. Comput..

[27]  J A Anderson,et al.  The grouped continuous model for multivariate ordered categorical variables and covariate adjustment. , 1985, Biometrics.

[28]  M. Pourahmadi,et al.  Bayesian analysis of covariance matrices and dynamic models for longitudinal data , 2002 .

[29]  Michael I. Jordan.  Graphical Models , 2003 .

[30]  D. Edwards,et al.  A fast procedure for model search in multidimensional contingency tables , 1985 .

[31]  D. Dunson,et al.  Bayesian Multivariate Logistic Regression , 2004, Biometrics.

[32]  A. Roverato.  Hyper Inverse Wishart Distribution for Non-decomposable Graphs and its Application to Bayesian Inference for Gaussian Graphical Models , 2002 .

[33]  Jeroen K. Vermunt,et al.  3. Log-Multiplicative Association Models as Latent Variable Models for Nominal and/or Ordinal Data , 2000 .