Factor analysis regression

In the presence of multicollinearity the literature points to principal component regression (PCR) as an estimation method for the regression coefficients of a multiple regression model. Due to ambiguities in the interpretation, involved by the orthogonal transformation of the set of explanatory variables, the method could not yet gain wide acceptance. Factor analysis regression (FAR) provides a model-based estimation method which is particularly tailored to overcome multicollinearity in an errors-in-variables setting. In this paper two feasible versions of a FAR estimator are compared with the OLS estimator and the PCR estimator by means of Monte Carlo simulation. While the PCR estimator performs best in cases of strong and high multicollinearity, the Thomson-based FAR estimator proves to be superior when the regressors are moderately correlated.

[1]  Robert J. Wherry,et al.  Multiple Factor Analysis: A Development and Expansion of "The Vectors of the Mind" , 1948 .

[2]  A. E. Maxwell,et al.  Factor Analysis as a Statistical Method. , 1964 .

[3]  E. J. Burr,et al.  A comparison of four methods of constructing factor scores , 1967 .

[4]  A. Basilevsky.  Factor analysis regression , 1981 .

[5]  A. E. Maxwell,et al.  Factor Analysis as a Statistical Method. , 1964 .

[6]  Stanley R. Johnson,et al.  Advanced Econometric Methods , 1984 .

[7]  Anthony Ralston,et al.  Statistical Methods for Digital Computers. , 1980 .

[8]  L. Fahrmeir,et al.  Multivariate statistische Verfahren , 1984 .

[9]  A. E. Maxwell,et al.  Regression ana factor analysis , 1973 .

[10]  J. Tukey,et al.  Multiple-Factor Analysis , 1947 .

[11]  Benjamin King.  Comment on "Factor Analysis and Regression." , 1969 .

[12]  D. Bartholomew.  Latent Variable Models And Factor Analysis , 1987 .

[13]  E. Ziegel.  Introduction to the Theory and Practice of Econometrics , 1989 .

[14]  John T. Scott.  Factor Analysis and Regression , 1966 .

[15]  J. Overall,et al.  Applied multivariate analysis , 1983 .

[16]  Herman Rubin,et al.  Statistical Inference in Factor Analysis , 1956 .

[17]  Gautam Tripathi,et al.  ECONOMETRIC METHODS , 2000, Econometric Theory.

[18]  Richard D. DeVeaux.  Statistical Factor Analysis and Related Methods , 1996 .

[19]  A. E. Maxwell,et al.  Regression and factor analysis , 1973 .

[20]  John DiNardo,et al.  Econometric methods. 4th ed. , 1997 .

[21]  Yutaka Kano,et al.  CONSISTENCY OF ESTIMATORS IN FACTOR ANALYSIS , 1983 .

[22]  K. Jöreskog.  Factor analysis by least squares and maximum likelihood methods , 1977 .

[23]  N. N. Chan.  On an unbiased predictor in factor analysis , 1977 .

[24]  M. Okamoto,et al.  Linear prediction in the factor analysis model , 1980 .

[25]  John T. Scott.  Factor Analysis Regression Revisited , 1969 .