Plane rotation-based EVD updating schemes for efficient subspace tracking

We present new algorithms based on plane rotations for tracking the eigenvalue decomposition (EVD) of a time-varying data covariance matrix. These algorithms directly produce eigenvectors in orthonormal form and are well suited for the application of subspace methods to nonstationary data. After recasting EVD tracking as a simplified rank-one EVD update problem, computationally efficient solutions are obtained in two steps. First, a new kind of parametric perturbation approach is used to express the eigenvector update as an unimodular orthogonal transform, which is represented in exponential matrix form in terms of a reduced set of small, unconstrained parameters. Second, two approximate decompositions of this exponential matrix into products of plane (or Givens) rotations are derived, one of which being previously unknown. These decompositions lead to new plane rotation-based EVD-updating schemes (PROTEUS), whose main feature is the use of plane rotations for updating the eigenvectors, thereby preserving orthonormality. Finally, the PROTEUS schemes are used to derive new EVD trackers whose convergence and numerical stability are investigated via simulations. One algorithm can track all the signal subspace EVD components in only O(LM) operations, where L and M, respectively, denote the data vector and signal subspace dimensions while achieving a performance comparable to an exact EVD approach and maintaining perfect orthonormality of the eigenvectors. The new algorithms show no signs of error buildup.

[1]  Benoît Champagne,et al.  Accurate subspace tracking algorithms based on cross-space properties , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[2]  Benoît Champagne,et al.  A new family of EVD tracking algorithms using Givens rotations , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[3]  Soura Dasgupta,et al.  Adaptive estimation of eigensubspace , 1995, IEEE Trans. Signal Process..

[4]  Georges Bienvenu,et al.  Adaptivity to background noise spatial coherence for high resolution passive methods , 1980, ICASSP.

[5]  R. D. DeGroat,et al.  Efficient, numerically stabilized rank-one eigenstructure updating [signal processing] , 1990, IEEE Trans. Acoust. Speech Signal Process..

[6]  Manuel Duarte Ortigueira,et al.  Eigendecomposition versus singular value decomposition in adaptive array signal processing , 1991, Signal Process..

[7]  Joos Vandewalle,et al.  A Singular Value Decomposition Updating Algorithm for Subspace Tracking , 1992, SIAM J. Matrix Anal. Appl..

[8]  Arthur Jay Barabell,et al.  Improving the resolution performance of eigenstructure-based direction-finding algorithms , 1983, ICASSP.

[9]  F. Gersemsky,et al.  Adaptive direction-of-arrival estimation based on rank and subspace tracking , 1995 .

[10]  Bede Liu,et al.  Rotational search methods for adaptive Pisarenko harmonic retrieval , 1986, IEEE Trans. Acoust. Speech Signal Process..

[11]  Ilkka Karasalo,et al.  Estimating the covariance matrix by signal subspace averaging , 1986, IEEE Trans. Acoust. Speech Signal Process..

[12]  Richard J. Vaccaro,et al.  Tracking directions-of-arrival with invariant subspace updating , 1996, Signal Process..

[13]  R. O. Schmidt,et al.  Multiple emitter location and signal Parameter estimation , 1986 .

[14]  Ronald D. Degroat,et al.  Efficient, Numerically Stabilized Rank-One Eigenstructure Up.dating , 1990 .

[15]  Juha Karhunen,et al.  Adaptive algorithms for estimating eigenvectors of correlation type matrices , 1984, ICASSP.

[16]  Dr. M. G. Worster Methods of Mathematical Physics , 1947, Nature.

[17]  Thomas Kailath,et al.  Detection of signals by information theoretic criteria , 1985, IEEE Trans. Acoust. Speech Signal Process..

[18]  Norman L. Owsley,et al.  Adaptive data orthogonalization , 1978, ICASSP.

[19]  Ken Sharman,et al.  Adaptive algorithms for estimating the complete covariance eigenstructure , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[20]  Franz Rellich,et al.  Perturbation Theory of Eigenvalue Problems , 1969 .

[21]  G. W. Stewart,et al.  An updating algorithm for subspace tracking , 1992, IEEE Trans. Signal Process..

[22]  Ronald D. DeGroat,et al.  Noniterative subspace tracking , 1992, IEEE Trans. Signal Process..

[23]  Hao Ye,et al.  Spherical subspace tracking for efficient, high performance adaptive signal processing applications , 1996, Signal Process..

[24]  Bin Yang,et al.  Projection approximation subspace tracking , 1995, IEEE Trans. Signal Process..

[25]  George Mathew,et al.  A quasi-Newton adaptive algorithm for generalized symmetric eigenvalue problem , 1996, IEEE Trans. Signal Process..

[26]  Phillip A. Regalia,et al.  An adaptive unit norm filter with applications to signal analysis and Karhunen-Loeve transformations , 1990 .

[27]  B. Champagne SVD-updating via constrained perturbations with application to subspace tracking , 1996, Conference Record of The Thirtieth Asilomar Conference on Signals, Systems and Computers.

[28]  Daniel J. Rabideau,et al.  Fast, rank adaptive subspace tracking and applications , 1996, IEEE Trans. Signal Process..

[29]  Robert Schreiber,et al.  Implementation of adaptive array algorithms , 1986, IEEE Trans. Acoust. Speech Signal Process..

[30]  Kai-Bor Yu,et al.  Recursive updating the eigenvalue decomposition of a covariance matrix , 1991, IEEE Trans. Signal Process..

[31]  T. Kailath,et al.  Least squares type algorithm for adaptive implementation of Pisarenko's harmonic retrieval method , 1982 .

[32]  Ann K. Stehney,et al.  Geometrical Methods of Mathematical Physics: Connections for Riemannian manifolds and gauge theories , 1980 .

[33]  G. Golub,et al.  Tracking a few extreme singular values and vectors in signal processing , 1990, Proc. IEEE.

[34]  Bin Yang,et al.  Subspace tracking with adaptive threshold rank estimation , 1996, J. VLSI Signal Process..

[35]  Steven Thomas Smith Linear and nonlinear conjugate gradient methods for adaptive processing , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[36]  J. Bunch,et al.  Rank-one modification of the symmetric eigenproblem , 1978 .

[37]  Benoît Champagne,et al.  Adaptive eigendecomposition of data covariance matrices based on first-order perturbations , 1994, IEEE Trans. Signal Process..

[38]  Tapan K. Sarkar,et al.  Adaptive spectral estimation by the conjugate gradient method , 1986, IEEE Trans. Acoust. Speech Signal Process..

[39]  Marc Moonen,et al.  Factored spherical subspace tracking , 1995, Integr..

[40]  M. Simaan,et al.  IN ThE PRESENCE OF WHITE NOISE , 1985 .

[41]  Gene H. Golub,et al.  Fast algorithms for updating signal subspaces , 1994 .

[42]  Eric M. Dowling,et al.  A TQR-iteration based adaptive SVD for real time angle and frequency tracking , 1994, IEEE Trans. Signal Process..

[43]  Pierre Priouret,et al.  Adaptive Algorithms and Stochastic Approximations , 1990, Applications of Mathematics.

[44]  P. Strobach Low-rank adaptive filters , 1996, IEEE Trans. Signal Process..

[45]  Jar-Ferr Yang,et al.  Adaptive eigensubspace algorithms for direction or frequency estimation and tracking , 1988, IEEE Trans. Acoust. Speech Signal Process..

[46]  Christian H. Bischof,et al.  On updating signal subspaces , 1992, IEEE Trans. Signal Process..

[47]  John G. Proakis,et al.  Adaptive SVD algorithm for covariance matrix eigenstructure computation , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[48]  Joos Vandewalle,et al.  A note on 'Efficient numerically stabilized rank-one eigenstructure updating' [and reply] , 1991, IEEE Trans. Signal Process..

[49]  Richard J. Vaccaro On adaptive implementations of Pisarenko's harmonic retrieval method , 1984, ICASSP.

[50]  E. M. Dowling,et al.  Conjugate gradient eigenstructure tracking for adaptive spectral estimation , 1995, IEEE Trans. Signal Process..