The eigenvalues and eigenvectors of finite, low rank perturbations of large random matrices

We consider the eigenvalues and eigenvectors of finite, low rank perturbations of random matrices. Specifically, we prove almost sure convergence of the extreme eigenvalues and appropriate projections of the corresponding eigenvectors of the perturbed matrix for additive and multiplicative perturbation models. The limiting non-random value is shown to depend explicitly on the limiting eigenvalue distribution of the unperturbed random matrix and the assumed perturbation model via integral transforms that correspond to very well known objects in free probability theory that linearize non-commutative free additive and multiplicative convolution. Furthermore, we uncover a phase transition phenomenon whereby the large matrix limit of the extreme eigenvalues of the perturbed matrix differs from that of the original matrix if and only if the eigenvalues of the perturbing matrix are above a certain critical threshold. Square root decay of the eigenvalue density at the edge is sufficient to ensure that this threshold is finite. This critical threshold is intimately related to the same aforementioned integral transforms and our proof techniques bring this connection and the origin of the phase transition into focus. Consequently, our results extend the class of `spiked' random matrix models about which such predictions (called the BBP phase transition) can be made well beyond the Wigner, Wishart and Jacobi random ensembles found in the literature. We examine the impact of this eigenvalue phase transition on the associated eigenvectors and observe an analogous phase transition in the eigenvectors. Various extensions of our results to the problem of non-extreme eigenvalues are discussed.

[1]  B. Collins,et al.  Integration with Respect to the Haar Measure on Unitary, Orthogonal and Symplectic Group , 2004, math-ph/0402073.

[2]  Benoit Collins Product of random projections, Jacobi ensembles and universality problems arising from free probability , 2005 .

[3]  Jack W. Silverstein Some limit theorems on the eigenvectors of large dimensional sample covariance matrices , 1984 .

[4]  Alexandru Nica,et al.  Lectures on the Combinatorics of Free Probability , 2006 .

[5]  A. Guionnet,et al.  Fluctuations of the Extreme Eigenvalues of Finite Rank Deformations of Random Matrices , 2010, 1009.0145.

[6]  Ilse C. F. Ipsen,et al.  Refined Perturbation Bounds for Eigenvalues of Hermitian and Non-Hermitian Matrices , 2009, SIAM J. Matrix Anal. Appl..

[7]  F. Benaych-Georges Rectangular R-Transform as the Limit of Rectangular Spherical Integrals , 2009, 0909.0178.

[8]  O. Johnson Free Random Variables , 2004 .

[9]  D. Féral,et al.  The Largest Eigenvalue of Rank One Deformation of Large Wigner Matrices , 2006, math/0605624.

[10]  B. Nadler Finite sample approximation results for principal component analysis: a matrix perturbation approach , 2009, 0901.3245.

[11]  Alice Guionnet,et al.  Character expansion method for the first order asymptotics of a matrix integral , 2005 .

[12]  J. W. Silverstein,et al.  Spectral Analysis of Large Dimensional Random Matrices , 2009 .

[13]  J. W. Silverstein On the eigenvectors of large dimensional sample covariance matrices , 1989 .

[14]  W. Gander,et al.  Restricted rank modification of the symmetric eigenvalue problem: Theoretical considerations , 1988 .

[15]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[16]  F. Benaych-Georges Infinitely divisible distributions for rectangular free convolution: classification and matricial interpretation , 2005, math/0512080.

[17]  Stephanos Venakides,et al.  UNIFORM ASYMPTOTICS FOR POLYNOMIALS ORTHOGONAL WITH RESPECT TO VARYING EXPONENTIAL WEIGHTS AND APPLICATIONS TO UNIVERSALITY QUESTIONS IN RANDOM MATRIX THEORY , 1999 .

[18]  S. Geman A Limit Theorem for the Norm of Random Matrices , 1980 .

[19]  E. Wigner On the Distribution of the Roots of Certain Symmetric Matrices , 1958 .

[20]  Kevin E. Bassler,et al.  Eigenvalue separation in some random matrix models , 2008, 0810.1554.

[21]  F. Benaych-Georges,et al.  On a surprising relation between the Marchenko-Pastur law, rectangular and square free convolutions , 2008, 0808.3938.

[22]  M. Ledoux The concentration of measure phenomenon , 2001 .

[23]  J. W. Silverstein,et al.  Analysis of the limiting spectral distribution of large dimensional random matrices , 1995 .

[24]  C. Tracy,et al.  Introduction to Random Matrices , 1992, hep-th/9210073.

[25]  Alexandru Nica,et al.  Free random variables : a noncommutative probability approach to free products with applications to random matrices, operator algebras, and harmonic analysis on free groups , 1992 .

[26]  V. N. Bogaevski,et al.  Matrix Perturbation Theory , 1991 .

[27]  F. Benaych-Georges,et al.  Rectangular random matrices, related convolution , 2005 .

[28]  J. Bunch,et al.  Rank-one modification of the symmetric eigenproblem , 1978 .

[29]  S. Péché,et al.  Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices , 2004, math/0403022.

[30]  M. Taniguchi Third order asymptotic properties of maximum likelihood estimators for gaussian ARMA processes , 1986 .

[31]  Noureddine El Karoui Tracy–Widom limit for the largest eigenvalue of a large class of complex sample covariance matrices , 2005, math/0503109.

[32]  F. Hiai,et al.  The semicircle law, free random variables, and entropy , 2006 .

[33]  D. Paul ASYMPTOTICS OF SAMPLE EIGENSTRUCTURE FOR A LARGE DIMENSIONAL SPIKED COVARIANCE MODEL , 2007 .

[34]  Philippe Biane,et al.  Processes with free increments , 1998 .

[35]  M. Rattray,et al.  Statistical mechanics of learning multiple orthogonal signals: asymptotic theory and fluctuation effects. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  J. W. Silverstein Weak Convergence of random functions defined by the eigenvectors of sample covariance matrices , 1990 .

[37]  S. Péché The largest eigenvalue of small rank perturbations of Hermitian random matrices , 2004, math/0411487.

[38]  Raj Rao Nadakuditi,et al.  Fundamental Limit of Sample Generalized Eigenvalue Based Detection of Signals in Noise Using Relatively Few Signal-Bearing and Noise-Only Samples , 2009, IEEE Journal of Selected Topics in Signal Processing.

[39]  C. Donati-Martin,et al.  The largest eigenvalues of finite rank deformation of large Wigner matrices: Convergence and nonuniversality of the fluctuations. , 2007, 0706.0136.

[40]  A. Guionnet,et al.  A Fourier view on the R-transform and related asymptotics of spherical integrals , 2005 .

[41]  Arno B. J. Kuijlaars,et al.  Generic behavior of the density of states in random matrix theory and equilibrium problems in the presence of real analytic external fields , 2000 .

[42]  Alan Edelman,et al.  The Polynomial Method for Random Matrices , 2008, Found. Comput. Math..

[43]  J. W. Silverstein,et al.  Eigenvalues of large sample covariance matrices of spiked population models , 2004, math/0408165.