Bayesian Model Selection in Factor Analytic Models

Factor analytic models are widely used in social science applications to study latent traits, such as intelligence, creativity, stress, and depression, that cannot be accurately measured with a single variable. In recent years, there has been a rise in the popularity of factor models due to their flexibility in characterizing multivari-ate data. For example, latent factor regression models have been used as a dimensionality reduction tool for modeling of sparse covariance structures in genomic applications (West, 2003; Carvalho et al. 2008). In addition, structural equation models and other generalizations of factor analysis are widely useful in epidemi-ologic studies involving complex health outcomes and exposures (Sanchez et al., 2005). Improvements in Bayesian computation permit the routine implementation of latent factor models via Markov chain Monte Carlo (MCMC) algorithms, and a very broad class of models can be fitted easily using the freely available software package WinBUGS. The literature on methods for fitting and inferences in latent factor models is vast (for recent books, see Loehlin, 2004; Thompson, 2004).

[1]  Xiao-Li Meng,et al.  SIMULATING RATIOS OF NORMALIZING CONSTANTS VIA A SIMPLE IDENTITY: A THEORETICAL EXPLORATION , 1996 .

[2]  Wolfgang Polasek,et al.  Factor analysis and outliers: A Bayesian approach , 1999 .

[3]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[4]  A. Gelman,et al.  Using Redundant Parameterizations to Fit Hierarchical Models , 2008 .

[5]  L. Wasserman,et al.  Computing Bayes Factors by Combining Simulation and Asymptotic Approximations , 1997 .

[6]  A. Gelfand,et al.  Bayesian Model Choice: Asymptotics and Exact Calculations , 1994 .

[7]  Jun S. Liu,et al.  Parameter Expansion for Data Augmentation , 1999 .

[8]  H. Akaike Factor analysis and AIC , 1987 .

[9]  David B Dunson,et al.  Default Prior Distributions and Efficient Posterior Computation in Bayesian Factor Analysis , 2009, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America.

[10]  S. J. Press,et al.  A note on choosing the number of factors , 1999 .

[11]  S. Sisson,et al.  Reversible jump Markov chain Monte Carlo , 2010, 1001.2055.

[12]  James O. Berger,et al.  Objective Bayesian Methods for Model Selection: Introduction and Comparison , 2001 .

[13]  M. West,et al.  High-Dimensional Sparse Factor Modeling: Applications in Gene Expression Genomics , 2008, Journal of the American Statistical Association.

[14]  B. Thompson Exploratory and Confirmatory Factor Analysis: Understanding Concepts and Applications , 2004 .

[15]  Tomas Kocka,et al.  Effective Dimensions of Hierarchical Latent Class Models , 2011, J. Artif. Intell. Res..

[16]  Sik-Yum Lee,et al.  Bayesian Selection on the Number of Factors in a Factor Analysis Model , 2002 .

[17]  J. Ghosh,et al.  Approximations and consistency of Bayes factors as model dimension grows , 2003 .

[18]  A. Gelfand,et al.  Efficient parametrisations for normal linear mixed models , 1995 .

[19]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[20]  Matthew West,et al.  Bayesian factor regression models in the''large p , 2003 .

[21]  Default Priors and Effcient Posterior Computation in Bayesian Factor Analysis , 2010 .

[22]  B. Muthén,et al.  A Bayesian approach to nonlinear latent variable models using the Gibbs sampler and the metropolis-hastings algorithm , 1998 .

[23]  J. Berger,et al.  The Intrinsic Bayes Factor for Model Selection and Prediction , 1996 .

[24]  Michael A. West,et al.  BAYESIAN MODEL ASSESSMENT IN FACTOR ANALYSIS , 2004 .

[25]  S Y Lee,et al.  Bayesian estimation and test for factor analysis model with continuous and polytomous data in several populations. , 2001, The British journal of mathematical and statistical psychology.

[26]  A. Gelman Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper) , 2004 .

[27]  Weixiong Zhang,et al.  Configuration landscape analysis and backbone guided local search: Part I: Satisfiability and maximum satisfiability , 2004, Artif. Intell..

[28]  S. Chib Marginal Likelihood from the Gibbs Output , 1995 .

[29]  Esben Budtz-Jørgensen,et al.  Structural Equation Models , 2005 .

[30]  Xiao-Li Meng,et al.  Simulating Normalizing Constants: From Importance Sampling to Bridge Sampling to Path Sampling , 1998 .

[31]  C Loehlin John,et al.  Latent variable models: an introduction to factor, path, and structural analysis , 1986 .