Some contributions to maximum likelihood factor analysis

A new computational method for the maximum likelihood solution in factor analysis is presented. This method takes into account the fact that the likelihood function may not have a maximum in a point of the parameter space where all unique variances are positive. Instead, the maximum may be attained on the boundary of the parameter space where one or more of the unique variances are zero. It is demonstrated that suchimproper (Heywood) solutions occur more often than is usually expected. A general procedure to deal with such improper solutions is proposed. The proposed methods are illustrated using two small sets of empirical data, and results obtained from the analyses of many other sets of data are reported. These analyses verify that the new computational method converges rapidly and that the maximum likelihood solution can be determined very accurately. A by-product obtained by the method is a large sample estimate of the variance-covariance matrix of the estimated unique variances. This can be used to set up approximate confidence intervals for communalities and unique variances.

[1]  E. S. Pearson,et al.  ON THE USE AND INTERPRETATION OF CERTAIN TEST CRITERIA FOR PURPOSES OF STATISTICAL INFERENCE PART I , 1928 .

[2]  S. S. Wilks The Large-Sample Distribution of the Likelihood Ratio for Testing Composite Hypotheses , 1938 .

[3]  D. Lawley VI.—The Estimation of Factor Loadings by the Method of Maximum Likelihood , 1940 .

[4]  D. Lawley,et al.  XIV.—Further Investigations in Factor Estimation , 1942, Proceedings of the Royal Society of Edinburgh. Section A. Mathematical and Physical Sciences.

[5]  D. Lawley,et al.  THE APPLICATION OF THE MAXIMUM LIKELIHOOD METHOD TO FACTOR ANALYSIS , 1943 .

[6]  Frederick B. Davis,et al.  Fundamental factors of comprehension in reading , 1944 .

[7]  G. Box,et al.  A general distribution theory for a class of likelihood criteria. , 1949, Biometrika.

[8]  W. G. Emmett FACTOR ANALYSIS BY LAWLEY'S METHOD OF MAXIMUM LIKELIHOOD , 1949 .

[9]  Dayle D. Rippe Application of a large sampling criterion to some sampling problems in factor analysis , 1953 .

[10]  D. Lawley XIII.—A Statistical Examination of the Centroid Method , 1954, Proceedings of the Royal Society of Edinburgh. Section A. Mathematical and Physical Sciences.

[11]  W. G. Howe SOME CONTRIBUTIONS TO FACTOR ANALYSIS , 1955 .

[12]  Calyampudi R. Rao Estimation and tests of significance in factor analysis , 1955 .

[13]  F. Lord A study of speed factors in tests and academic grades , 1956 .

[14]  James Hardy Wilkinson,et al.  The Calculation of the Eigenvectors of Codiagonal Matrices , 1958, Comput. J..

[15]  Friedrich L. Bauer,et al.  On certain methods for expanding the characteristic polynomial , 1959, Numerische Mathematik.

[16]  T. W. Anderson,et al.  An Introduction to Multivariate Statistical Analysis , 1959 .

[17]  T. W. Anderson An Introduction to Multivariate Statistical Analysis , 1959 .

[18]  S. D. Silvey,et al.  Maximum-Likelihood Estimation Procedures and Associated Tests of Significance , 1960 .

[19]  James Hardy Wilkinson,et al.  Householder's Method for the Solution of the Algebraic Eigenproblem , 1960, Comput. J..

[20]  James M. Ortega,et al.  On Sturm Sequences for Tridiagonal Matrices , 1960, JACM.

[21]  H. Harman Modern factor analysis , 1961 .

[22]  Richard Bellman,et al.  Introduction to Matrix Analysis , 1972 .

[23]  R. Bellman Introduction To Matrix Analysis By Richard Bellman, New York, 1960 , 1960 .

[24]  Harold P. Bechtoldt,et al.  An empirical study of the factor analysis stability hypothesis , 1961 .

[25]  A. E. Maxwell Recent Trends in Factor Analysis , 1961 .

[26]  M. Kendall,et al.  The advanced theory of statistics , 1945 .

[27]  Roger Fletcher,et al.  A Rapidly Convergent Descent Method for Minimization , 1963, Comput. J..

[28]  James M. Ortega,et al.  The LLT and QR methods for symmetric tridiagonal matrices , 1963, Comput. J..

[29]  A. E. Maxwell,et al.  Factor Analysis as a Statistical Method. , 1964 .

[30]  W. Hemmerle Obtaining maximum-likelihood estimates of factor loadings and communalities using an easily implemented iterative computer procedure , 1965, Psychometrika.

[31]  K. Jöreskog Testing a simple structure hypothesis in factor analysis , 1966, Psychometrika.

[32]  D. Lawley,et al.  XX.—Some New Results in Maximum Likelihood Factor Analysis , 1967, Proceedings of the Royal Society of Edinburgh. Section A. Mathematical and Physical Sciences.

[33]  M. Browne A comparison of factor analytic techniques , 1968, Psychometrika.