Bayesian analysis of non‐homogeneous Markov chains: Application to mental health data

In this paper we present a formal treatment of non-homogeneous Markov chains by introducing a hierarchical Bayesian framework. Our work is motivated by the analysis of correlated categorical data which arise in assessment of psychiatric treatment programs. In our development, we introduce a Markovian structure to describe the non-homogeneity of transition patterns. In doing so, we introduce a logistic regression set-up for Markov chains and incorporate covariates in our model. We present a Bayesian model using Markov chain Monte Carlo methods and develop inference procedures to address issues encountered in the analyses of data from psychiatric treatment programs. Our model and inference procedures are implemented to some real data from a psychiatric treatment study.

[1]  N. Shephard,et al.  The simulation smoother for time series models , 1995 .

[2]  A. Agresti,et al.  Categorical Data Analysis , 1991, International Encyclopedia of Statistical Science.

[3]  M. West,et al.  Dynamic Generalized Linear Models and Bayesian Forecasting , 1985 .

[4]  Pascal Wild,et al.  Fitting Bayesian multiple random effects models , 1996, Stat. Comput..

[5]  P. Diggle,et al.  Analysis of Longitudinal Data , 2003 .

[6]  A Erkanli,et al.  Bayesian analyses of longitudinal binary data using Markov regression models of unknown order , 2001, Statistics in medicine.

[7]  R. Maitra,et al.  Supplement to “ A k-mean-directions Algorithm for Fast Clustering of Data on the Sphere ” published in the Journal of Computational and Graphical Statistics , 2009 .

[8]  A. Raftery,et al.  Time Series of Continuous Proportions , 1993 .

[9]  C. Morris.  Parametric Empirical Bayes Inference: Theory and Applications , 1983 .

[10]  Andrew Gelman,et al.  General methods for monitoring convergence of iterative simulations , 1998 .

[11]  S. Chib,et al.  Bayesian analysis of binary and polychotomous response data , 1993 .

[12]  R. Fildes.  Journal of the American Statistical Association : William S. Cleveland, Marylyn E. McGill and Robert McGill, The shape parameter for a two variable graph 83 (1988) 289-300 , 1989 .

[13]  J Meredith.  Program evaluation in a hospital for mentally retarded persons. , 1974, American journal of mental deficiency.

[14]  Ming Tan,et al.  BAYESIAN HIERARCHICAL MODELS FOR MULTI-LEVEL REPEATED ORDINAL DATA USING WinBUGS , 2002, Journal of biopharmaceutical statistics.

[15]  G. Roberts,et al.  Updating Schemes, Correlation Structure, Blocking and Parameterization for the Gibbs Sampler , 1997 .

[16]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[17]  M. West,et al.  Bayesian forecasting and dynamic models , 1989 .

[18]  R. Pearl.  Biometrics , 1914, The American Naturalist.

[19]  P. Müller,et al.  Bayesian Forecasting of Multinomial Time Series through Conditionally Gaussian Dynamic Models , 1997 .

[20]  T. W. Anderson,et al.  Statistical Inference about Markov Chains , 1957 .

[21]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[22]  L. V. Rubinstein,et al.  Markov models for covariate dependence of binary sequences. , 1985, Biometrics.

[23]  Arnold Zellner,et al.  Estimating the parameters of the Markov probability model from aggregate time series data , 1971 .

[24]  S. Zeger,et al.  Markov regression models for time series: a quasi-likelihood approach. , 1988, Biometrics.