Factor analysis and AIC

The information criterion AIC was introduced to extend the method of maximum likelihood to the multimodel situation. It was obtained by relating the successful experience of the order determination of an autoregressive model to the determination of the number of factors in the maximum likelihood factor analysis. The use of the AIC criterion in the factor analysis is particularly interesting when it is viewed as the choice of a Bayesian model. This observation shows that the area of application of AIC can be much wider than the conventional i.i.d. type models on which the original derivation of the criterion was based. The observation of the Bayesian structure of the factor analysis model leads us to the handling of the problem of improper solution by introducing a natural prior distribution of factor loadings.

[1]  Calyampudi R. Rao.  Estimation and tests of significance in factor analysis , 1955 .

[2]  A. E. Maxwell.  Recent Trends in Factor Analysis , 1961 .

[3]  A. Basilevsky,et al.  Factor Analysis as a Statistical Method. , 1964 .

[4]  K. Jöreskog.  Some contributions to maximum likelihood factor analysis , 1967 .

[5]  E. B. Andersen,et al.  Modern factor analysis , 1961 .

[6]  H. Akaike.  Fitting autoregressive models for prediction , 1969 .

[7]  Stephen M. Robinson,et al.  A Newton-Raphson algorithm for maximum likelihood factor analysis , 1969 .

[8]  H. Akaike.  Statistical predictor identification , 1970 .

[9]  J. C. Gower,et al.  Factor Analysis as a Statistical Method. 2nd ed. , 1972 .

[10]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[11]  A. E. Maxwell,et al.  Factor Analysis as a Statistical Method. , 1964 .

[12]  H. Akaike.  A new look at the statistical model identification , 1974 .

[13]  R. P. McDonald,et al.  Bayesian estimation in unrestricted factor analysis: A treatment for heywood cases , 1975 .

[14]  K. Jöreskog.  Structural analysis of covariance and correlation matrices , 1978 .

[15]  Hirotugu Akaike,et al.  Likelihood and the Bayes procedure , 1980 .

[16]  D. Bartholomew.  Posterior analysis of the factor model , 1981 .

[17]  Stephen E. Fienberg,et al.  A Celebration of Statistics , 1985 .

[18]  H. Akaike.  Prediction and Entropy , 1985 .

[19]  Donald E. Ramirez,et al.  An Expert Model Selection Approach to Determine the “Best” Pattern Structure in Factor Analysis Models , 1987 .