Bayesian Variable Selection for Latent Class Models

In this article, we develop a latent class model with class probabilities that depend on subject-specific covariates. One of our major goals is to identify important predictors of latent classes. We consider methodology that allows estimation of latent classes while allowing for variable selection uncertainty. We propose a Bayesian variable selection approach and implement a stochastic search Gibbs sampler for posterior computation to obtain model-averaged estimates of quantities of interest such as marginal inclusion probabilities of predictors. Our methods are illustrated through simulation studies and application to data on weight gain during pregnancy, where it is of interest to identify important predictors of latent weight gain classes.

[1]  Ajay Jasra,et al.  Markov Chain Monte Carlo Methods and the Label Switching Problem in Bayesian Mixture Modeling , 2005 .

[2]  E. Mammen,et al.  Backfitting and smooth backfitting for additive quantile models , 2010, 1011.2592.

[3]  D A Savitz,et al.  Determinants of participation in an epidemiological study of preterm delivery. , 1999, Paediatric and perinatal epidemiology.

[4]  I. Katz,et al.  Using a Bayesian latent growth curve model to identify trajectories of positive affect and negative events following myocardial infarction. , 2005, Biostatistics.

[5]  C. Robert,et al.  Deviance information criteria for missing data models , 2006 .

[6]  Ann L. Yaktine,et al.  Weight Gain During Pregnancy , 2009 .

[7]  James G. Scott,et al.  Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problem , 2010, 1011.2333.

[8]  D. Dunson,et al.  Bayesian Multivariate Logistic Regression , 2004, Biometrics.

[9]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[10]  M. Clyde,et al.  Flexible empirical Bayes estimation for wavelets , 2000 .

[11]  L. M. M.-T. Theory of Probability , 1929, Nature.

[12]  R. Pearl Biometrics , 1914, The American Naturalist.

[13]  S. Frühwirth-Schnatter,et al.  Data Augmentation and MCMC for Binary and Multinomial Logit Models , 2010 .

[14]  S. Chib,et al.  Bayesian analysis of binary and polychotomous response data , 1993 .

[15]  G. Berkowitz An epidemiologic study of preterm delivery. , 1981, American journal of epidemiology.

[16]  Ann L. Yaktine,et al.  Weight Gain During Pregnancy , 2009 .

[17]  S. Geisser,et al.  A Predictive Approach to Model Selection , 1979 .

[18]  Xiao-Li Meng,et al.  Simulating Normalizing Constants: From Importance Sampling to Bridge Sampling to Path Sampling , 1998 .

[19]  A. Siega-Riz,et al.  Dietary energy density but not glycemic load is associated with gestational weight gain. , 2008, The American journal of clinical nutrition.

[20]  P. Green,et al.  Corrigendum: On Bayesian analysis of mixtures with an unknown number of components , 1997 .

[21]  Dai-Gyoung Kim,et al.  Bayesian inference and model selection in latent class logit models with parameter constraints: An application to market segmentation , 2003 .

[22]  M. Escobar,et al.  Bayesian Density Estimation and Inference Using Mixtures , 1995 .

[23]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[24]  Sylvia Fr Data Augmentation and MCMC for Binary and Multinomial Logit Models , 2010 .

[25]  Meera Viswanathan,et al.  Outcomes of maternal weight gain. , 2008, Evidence report/technology assessment.

[26]  B. Luke Nutrition During Pregnancy: Part I, Weight Gain; Part II, Nutrient Supplements , 1991 .

[27]  C. Holmes,et al.  Bayesian auxiliary variable models for binary and multinomial regression , 2006 .

[28]  L. Devroye Non-Uniform Random Variate Generation , 1986 .

[29]  Paul Gustafson,et al.  Bayesian multinomial regression with class-specific predictor selection , 2009, 0901.4208.

[30]  A. Gelfand,et al.  Bayesian Model Choice: Asymptotics and Exact Calculations , 1994 .

[31]  E. George,et al.  Journal of the American Statistical Association is currently published by American Statistical Association. , 2007 .

[32]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[33]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[34]  P. Green,et al.  On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion) , 1997 .

[35]  G. Casella,et al.  The Bayesian Lasso , 2008 .

[36]  Luisa Scaccia,et al.  Bayesian Growth Curves Using Normal Mixtures With Nonparametric Weights , 2003 .

[37]  David B. Dunson,et al.  Bayesian Inference on Changes in Response Densities Over Predictor Clusters , 2008, Journal of the American Statistical Association.

[38]  Satkartar K. Kinney,et al.  Fixed and Random Effects Selection in Linear and Logistic Models , 2007, Biometrics.