Bayesian inference for graphical factor analysis models

We generalize factor analysis models by allowing the concentration matrix of the residuals to have nonzero off-diagonal elements. The resulting model is named graphical factor analysis model. Allowing a structure of associations gives information about the correlation left unexplained by the unobserved variables, which can be used both in the confirmatory and exploratory context. We first present a sufficient condition for global identifiability of this class of models with a generic number of factors, thereby extending the results in Stanghellini (1997) and Vicard (2000). We then consider the issue of model comparison and show that fast local computations are possible for this purpose, if the conditional independence graphs on the residuals are restricted to be decomposable and a Bayesian approach is adopted. To achieve this aim, we propose a new reversible jump MCMC method to approximate the posterior probabilities of the considered models. We then study the evolution of political democracy in 75 developing countries based on eight measures of democracy in two different years.

[1]  M. Frydenberg,et al.  Decomposition of maximum likelihood in mixed graphical interaction models , 1989 .

[2]  S. Wright.  The Method of Path Coefficients , 1934 .

[3]  S. J. Press,et al.  Bayesian Inference in Factor Analysis , 1989 .

[4]  P. Green,et al.  On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion) , 1997 .

[5]  Kenneth A. Bollen,et al.  Structural Equations with Latent Variables , 1989 .

[6]  M. Browne.  Factor analysis of multiple batteries by maximum likelihood , 1980 .

[7]  J. Pearl.  Graphs, Causality, and Structural Equation Models , 1998 .

[8]  Paola Vicard,et al.  On the identification of a single-factor model with correlated residuals , 2000 .

[9]  N. Wermuth,et al.  Linear Dependencies Represented by Chain Graphs , 1993 .

[10]  P. Green,et al.  Decomposable graphical Gaussian model determination , 1999 .

[11]  A. Dawid,et al.  Hyper Markov Laws in the Statistical Analysis of Decomposable Graphical Models , 1993 .

[12]  Elena Stanghellini,et al.  Identification of a single-factor model using graphical Gaussian rules , 1997 .

[13]  Nanny Wermuth,et al.  Multivariate Dependencies: Models, Analysis and Interpretation , 1996 .

[14]  D. Edwards.  Introduction to graphical modelling , 1995 .

[15]  S. Wright,et al.  The Theory of Path Coefficients a Reply to Niles's Criticism. , 1923, Genetics.

[16]  P. Green,et al.  Corrigendum: On Bayesian analysis of mixtures with an unknown number of components , 1997 .

[17]  N. Wermuth,et al.  Tests of Linearity, Multivariate Normality and the Adequacy of Linear Scores , 1994 .

[18]  H. Bozdogan,et al.  Bayesian Factor Analysis Model and Choosing the Number of Factors Using a New Informational Complexity Criterion , 1998 .

[19]  P. Green.  Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .