Semiparametric Bayes hierarchical models with mean and variance constraints

In parametric hierarchical models, it is standard practice to place mean and variance constraints on the latent variable distributions for the sake of identifiability and interpretability. Because incorporation of such constraints is challenging in semiparametric models that allow latent variable distributions to be unknown, previous methods either constrain the median or avoid constraints. In this article, we propose a centered stick-breaking process (CSBP), which induces mean and variance constraints on an unknown distribution in a hierarchical model. This is accomplished by viewing an unconstrained stick-breaking process as a parameter-expanded version of a CSBP. An efficient blocked Gibbs sampler is developed for approximate posterior computation. The methods are illustrated through a simulated example and an epidemiologic application.

[1]  Jack A. Taylor,et al.  Bayesian Latent Variable Models for Median Regression on Multiple Outcomes , 2003, Biometrics.

[2]  Lancelot F. James Functionals of dirichlet processes, the cifarelli-regazzini identity and beta-gamma processes , 2005, math/0505606.

[3]  P. Rousseeuw,et al.  Robust factor analysis , 2003 .

[4]  T. Ferguson Prior Distributions on Spaces of Probability Measures , 1974 .

[5]  J G Ibrahim,et al.  A semiparametric Bayesian approach to the random effects model. , 1998, Biometrics.

[6]  Audris Mockus,et al.  A nonparametric Bayes method for isotonic regression , 1995 .

[7]  Michael A. West,et al.  BAYESIAN MODEL ASSESSMENT IN FACTOR ANALYSIS , 2004 .

[8]  Hani Doss Bayesian Nonparametric Estimation of the Median; Part I: Computation of the Estimates , 1985 .

[9]  D. Dunson,et al.  Sparse Bayesian infinite factor models. , 2011, Biometrika.

[10]  D. Dunson,et al.  Bayesian latent variable models for clustered mixed outcomes , 2000 .

[11]  M. Knott,et al.  Generalized latent trait models , 2000 .

[12]  A. Gelman Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper) , 2004 .

[13]  Peter D. Hoff,et al.  Nonparametric estimation of convex models via mixtures , 2003 .

[14]  H. Ishwaran,et al.  Markov chain Monte Carlo in approximate Dirichlet and beta two-parameter process hierarchical models , 2000 .

[15]  A. Gelfand,et al.  Bayesian Semiparametric Median Regression Modeling , 2001 .

[16]  M. Lavine On an approximate likelihood for quantiles , 1995 .

[17]  E. Regazzini,et al.  Theory and numerical analysis for exact distributions of functionals of a Dirichlet process , 2002 .

[18]  P. Gustafson,et al.  Conservative prior distributions for variance parameters in hierarchical models , 2006 .

[19]  M. Escobar Estimating Normal Means with a Dirichlet Process Prior , 1994 .

[20]  Greet Pison,et al.  Diagnostic Plots for Robust Multivariate Methods , 2004 .

[21]  David B Dunson,et al.  High cumulative incidence of uterine leiomyoma in black and white women: ultrasound evidence. , 2003, American journal of obstetrics and gynecology.

[22]  Glen Takahara,et al.  Independent and Identically Distributed Monte Carlo Algorithms for Semiparametric Linear Mixed Models , 2002 .

[23]  Albert Y. Lo,et al.  Bayes Methods for a Symmetric Unimodal Density and its Mode , 1989 .

[24]  Irva Hertz-Picciotto,et al.  Self‐Reported Heavy Bleeding Associated With Uterine Leiomyomata , 2003, Obstetrics and gynecology.

[25]  W. Johnson,et al.  Modeling Regression Error With a Mixture of Polya Trees , 2002 .

[26]  Haibo Zhou,et al.  Association between maternal serum concentration of the DDT metabolite DDE and preterm and small-for-gestational-age babies at birth , 2001, The Lancet.

[27]  A. Gelfand,et al.  Dirichlet Process Mixed Generalized Linear Models , 1997 .

[28]  M. Escobar,et al.  Bayesian Density Estimation and Inference Using Mixtures , 1995 .

[29]  Jun S. Liu,et al.  Parameter Expansion for Data Augmentation , 1999 .

[30]  Peter Müller,et al.  A Bayesian Population Model with Hierarchical Mixture Priors Applied to Blood Count Data , 1997 .

[31]  Matthew West,et al.  Bayesian factor regression models in the''large p , 2003 .

[32]  A. Gelman Parameterization and Bayesian Modeling , 2004 .

[33]  S. MacEachern,et al.  A semiparametric Bayesian model for randomised block designs , 1996 .

[34]  Lancelot F. James,et al.  Gibbs Sampling Methods for Stick-Breaking Priors , 2001 .

[35]  T. Ferguson A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[36]  D. Burr,et al.  A Bayesian Semiparametric Model for Random-Effects Meta-Analysis , 2005 .

[37]  P. Müller,et al.  Bayesian Inference in Semiparametric Mixed Models for Longitudinal Data , 2010, Biometrics.