A CG-type method for computing the dominant subspace of a symmetric matrix

Computing the subspace spanned by the eigenvectors corresponding to the r largest eigenvalues of a symmetric matrix is an important subtask in many signal processing applications and statistics. Here, from the application side, we focus on subspace based algorithms for sensor node localization in wireless sensor networks. A conjugate gradient method on the Grassmann manifold is proposed to compute the r-dimensional dominant subspace of an (n × n)-symmetric matrix. This leads to new subspace algorithms which avoid the time consuming eigendecomposition of the data matrix, but rather compute the signal and the noise space in O(n2r3) flops. Some convergence aspects are discussed and numerical simulations are presented to illustrate the performance of the proposed algorithm. When applied to the problem of sensor positions estimation with M sensors, the full-set subspace algorithm is reduced from order O(M6) to O(M4) without loosing accuracy.

[1]  E. M. Dowling,et al.  Conjugate gradient eigenstructure tracking for adaptive spectral estimation , 1995, IEEE Trans. Signal Process..

[2]  Robert E. Mahony,et al.  A Grassmann-Rayleigh Quotient Iteration for Computing Invariant Subspaces , 2002, SIAM Rev..

[3]  Y. Feng,et al.  CONJUGATE GRADIENT METHODS FOR SOLVING THE SMALLEST EIGENPAIR OF LARGE SYMMETRIC EIGENVALUE PROBLEMS , 1996 .

[4]  Yingning Peng,et al.  Mobile localization method based on multidimensional similarity analysis [cellular radio applications] , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[5]  Ying Zhang,et al.  Localization from connectivity in sensor networks , 2004, IEEE Transactions on Parallel and Distributed Systems.

[6]  Wing-Kin Ma,et al.  A Novel Subspace Approach for Cooperative Localization in Wireless Sensor Networks Using Range Measurements , 2009, IEEE Transactions on Signal Processing.

[7]  Knut Hüper,et al.  An Intrinsic CG Algorithm for Computing Dominant Subspaces , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[8]  U. Helmke,et al.  Optimization and Dynamical Systems , 1994, Proceedings of the IEEE.

[9]  D. Gabay Minimizing a differentiable function over a differential manifold , 1982 .

[10]  Frankie K. W. Chan,et al.  A Generalized Subspace Approach for Mobile Positioning With Time-of-Arrival Measurements , 2007, IEEE Transactions on Signal Processing.

[11]  Tapan K. Sarkar,et al.  A survey of conjugate gradient algorithms for solution of extreme eigen-problems of a symmetric matrix , 1989, IEEE Trans. Acoust. Speech Signal Process..

[12]  B. Parlett The Rayleigh Quotient Iteration and Some Generalizations for Nonnormal Matrices , 1974 .

[13]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[14]  U. Helmke,et al.  Newton's method on Gra{\ss}mann manifolds , 2007, 0709.2205.