ASYMPTOTICS OF SAMPLE EIGENSTRUCTURE FOR A LARGE DIMENSIONAL SPIKED COVARIANCE MODEL

This paper deals with a multivariate Gaussian observation model where the eigenvalues of the covariance matrix are all one, except for a finite number which are larger. Of interest is the asymptotic behavior of the eigenvalues of the sample covariance matrix when the sample size and the dimension of the obser- vations both grow to infinity so that their ratio converges to a positive constant. When a population eigenvalue is above a certain threshold and of multiplicity one, the corresponding sample eigenvalue has a Gaussian limiting distribution. There is a "phase transition" of the sample eigenvectors in the same setting. Another contribution here is a study of the second order asymptotics of sample eigenvectors when corresponding eigenvalues are simple and sufficiently l arge.

[1]  S. N. Roy.  On a Heuristic Method of Test Construction and its use in Multivariate Analysis , 1953 .

[2]  T. W. Anderson.  ASYMPTOTIC THEORY FOR PRINCIPAL COMPONENT ANALYSIS , 1963 .

[3]  Calyampudi R. Rao,et al.  Linear statistical inference and its applications , 1965 .

[4]  Tosio Kato.  Perturbation theory for linear operators , 1966 .

[5]  Calyampudi R. Rao,et al.  Linear Statistical Inference and Its Applications. , 1975 .

[6]  C. Waternaux.  Asymptotic distribution of the sample roots for a nonnormal population , 1976 .

[7]  R. Muirhead.  Aspects of Multivariate Statistical Theory , 1982, Wiley Series in Probability and Statistics.

[8]  李幼升,et al.  Ph , 1989 .

[9]  J. W. Silverstein.  Weak Convergence of random functions defined by the eigenvectors of sample covariance matrices , 1990 .

[10]  Z. Bai,et al.  Limit of the smallest eigenvalue of a large dimensional sample covariance matrix , 1993 .

[11]  Z. Bai,et al.  Convergence rate of expected spectral distributions of large random matrices , 2008 .

[12]  Z. Bai,et al.  Convergence Rate of Expected Spectral Distributions of Large Random Matrices. Part I. Wigner Matrices , 1993 .

[13]  J. W. Silverstein,et al.  Analysis of the limiting spectral distribution of large dimensional random matrices , 1995 .

[14]  R. Tibshirani,et al.  Penalized Discriminant Analysis , 1995 .

[15]  Emre Telatar,et al.  Capacity of Multi-antenna Gaussian Channels , 1999, Eur. Trans. Telecommun..

[16]  Z. Bai.  METHODOLOGIES IN SPECTRAL ANALYSIS OF LARGE DIMENSIONAL RANDOM MATRICES , A REVIEW , 1999 .

[17]  B. Silverman,et al.  Functional Data Analysis , 1997 .

[18]  A. Guionnet,et al.  CONCENTRATION OF THE SPECTRAL MEASURE FOR LARGE MATRICES , 2000 .

[19]  I. Johnstone.  On the distribution of the largest principal component , 2000 .

[20]  K. J. Utikal,et al.  Inference for Density Families Using Functional Principal Component Analysis , 2001 .

[21]  A. Soshnikov.  A Note on Universality of the Distribution of the Largest Eigenvalues in Certain Sample Covariance Matrices , 2001, math/0104113.

[22]  S. Szarek,et al.  Chapter 8 - Local Operator Theory, Random Matrices and Banach Spaces , 2001 .

[23]  Magnus Rattray,et al.  Limiting Form of the Sample Covariance Eigenspectrum in PCA and Kernel PCA , 2003, NIPS.

[24]  S. Péché,et al.  Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices , 2004, math/0403022.

[25]  J. W. Silverstein,et al.  Eigenvalues of large sample covariance matrices of spiked population models , 2004, math/0408165.

[26]  Z. Bai,et al.  CLT for linear spectral statistics of large dimensional sample covariance matrices with dependent data , 2017, Statistical Papers.

[27]  D. Paul,et al.  Asymptotics of the leading sample eigenvalues for a spiked covariance model , 2004 .

[28]  M. Rattray,et al.  Principal-component-analysis eigenvalue spectra from data with symmetry-breaking structure. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[29]  S. Péché,et al.  Universality of local eigenvalue statistics for some sample covariance matrices , 2005 .

[30]  R. Tibshirani,et al.  Sparse Principal Component Analysis , 2006 .

[31]  V. Bogachev.  Gaussian Measures on a , 2022 .

[32]  Zhidong Bai,et al.  CONVERGENCE RATE OF EXPECTED SPECTRAL DISTRIBUTIONS OF LARGE RANDOM MATRICES PART II: SAMPLE COVARIANCE MATRICES , 2008 .

[33]  I. Johnstone,et al.  Sparse Principal Components Analysis , 2009, 0901.4392.