Theoretical properties of Cook’s PFC dimension reduction algorithm for linear regression

We analyse the properties of the Principal Fitted Components (PFC) algorithm proposed by Cook. We derive theoretical properties of the resulting estimators, including sufficient conditions under which they are $\sqrt{n}$-consistent, and explain some of the simulation results given in Cook's paper. We use techniques from random matrix theory and perturbation theory. We argue that, under Cook's model at least, the PFC algorithm should outperform the Principal Components algorithm.

[1]  H. Zha,et al.  Contour regression: A general approach to dimension reduction , 2005, math/0508277.

[2]  I. Johnstone On the distribution of the largest eigenvalue in principal components analysis , 2001 .

[3]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[4]  H. Tong,et al.  Article: 2 , 2002, European Financial Services Law.

[5]  F. Critchley Influence in principal components analysis , 1985 .

[6]  Ker-Chau Li,et al.  Sliced Inverse Regression for Dimension Reduction , 1991 .

[7]  S. Szarek,et al.  Chapter 8 - Local Operator Theory, Random Matrices and Banach Spaces , 2001 .

[8]  W. Fulton Eigenvalues, invariant factors, highest weights, and Schubert calculus , 1999, math/9908012.

[9]  H. Weyl Das asymptotische Verteilungsgesetz der Eigenwerte linearer partieller Differentialgleichungen (mit einer Anwendung auf die Theorie der Hohlraumstrahlung) , 1912 .

[10]  S. Geman A Limit Theorem for the Norm of Random Matrices , 1980 .

[11]  Ker-Chau Li Sliced inverse regression for dimension reduction (with discussion) , 1991 .

[12]  S. Oman Random calibration with many measurements: an application of Stein estimation , 1991 .

[13]  R. Fisher,et al.  On the Mathematical Foundations of Theoretical Statistics , 1922 .

[14]  R. Sibson Studies in the Robustness of Multidimensional Scaling: Perturbational Analysis of Classical Scaling , 1979 .

[15]  R. Christensen,et al.  Fisher Lecture: Dimension Reduction in Regression , 2007, 0708.3774.