Efficient, high performance, subspace tracking for time-domain data

This paper describes two new algorithms for tracking the subspace spanned by the principal eigenvectors of the correlation matrix associated with time-domain (i.e., time series) data. The algorithms track the d principal N-dimensional eigenvectors of the data covariance matrix with a complexity of O(Nd/sup 2/), yet they have performance comparable with algorithms having O(N/sup 2/d) complexity. The computation reduction is achieved by exploiting the shift-invariance property of temporal data covariance matrices. Experiments are used to compare our algorithms with other well-known approaches of similar and/or lower complexity. Our new algorithms are shown to outperform the subset of the general approaches having the same complexity. The new algorithms are useful for applications such as subspace-based speech enhancement and low-rank adaptive filtering.

[1]  Bin Yang,et al.  Projection approximation subspace tracking , 1995, IEEE Trans. Signal Process..

[2]  Jar-Ferr Yang,et al.  Adaptive eigensubspace algorithms for direction or frequency estimation and tracking , 1988, IEEE Trans. Acoust. Speech Signal Process..

[3]  Srinath Hosur,et al.  ULV and generalized ULV subspace tracking adaptive algorithms , 1998, IEEE Trans. Signal Process..

[4]  Yariv Ephraim,et al.  A signal subspace approach for speech enhancement , 1995, IEEE Trans. Speech Audio Process..

[5]  C. E. Davila,et al.  Efficient tracking of time-varying signal subspaces , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Eric M. Dowling,et al.  A TQR-iteration based adaptive SVD for real time angle and frequency tracking , 1994, IEEE Trans. Signal Process..

[7]  Petre Stoica,et al.  On-line subspace algorithms for tracking moving sources , 1994, IEEE Trans. Signal Process..

[8]  P. Strobach.  Low-rank adaptive filters , 1996, IEEE Trans. Signal Process..

[9]  G. W. Stewart,et al.  An updating algorithm for subspace tracking , 1992, IEEE Trans. Signal Process..

[10]  Benoît Champagne,et al.  Plane rotation-based EVD updating schemes for efficient subspace tracking , 1998, IEEE Trans. Signal Process..

[11]  E. M. Dowling,et al.  Conjugate gradient eigenstructure tracking for adaptive spectral estimation , 1995, IEEE Trans. Signal Process..

[12]  L. Ljung,et al.  Fast calculation of gain matrices for recursive estimation schemes , 1978 .

[13]  Benoît Champagne,et al.  Adaptive eigendecomposition of data covariance matrices based on first-order perturbations , 1994, IEEE Trans. Signal Process..

[14]  Donald W. Tufts,et al.  Two algorithms for fast approximate subspace tracking , 1999, IEEE Trans. Signal Process..

[15]  D. Fuhrmann.  An algorithm for subspace computation, with applications in signal processing , 1988 .

[16]  M. Simaan,et al.  IN ThE PRESENCE OF WHITE NOISE , 1985 .

[17]  G. Golub,et al.  Tracking a few extreme singular values and vectors in signal processing , 1990, Proc. IEEE.

[18]  Ronald D. DeGroat,et al.  Noniterative subspace tracking , 1992, IEEE Trans. Signal Process..

[19]  Chien-Chung Yeh,et al.  Simple computation of projection matrix for bearing estimations , 1987 .

[20]  Peter Strobach.  Square hankel SVD subspace tracking algorithms , 1997, Signal Process..

[21]  Peter Strobach,et al.  Bi-iteration SVD subspace tracking algorithms , 1997, IEEE Trans. Signal Process..

[22]  R.C. Johnson,et al.  Introduction to adaptive arrays , 1982, Proceedings of the IEEE.

[23]  Norman L. Owsley,et al.  Adaptive data orthogonalization , 1978, ICASSP.

[24]  Jun Huang,et al.  An energy-constrained signal subspace method for speech enhancement and recognition in white and colored noises , 1998, Speech Commun..

[25]  D. Begusic,et al.  Low rank transform domain adaptive filtering , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[26]  Gene H. Golub,et al.  Matrix computations , 1983 .

[27]  G. Stewart.  Introduction to matrix computations , 1973 .

[28]  C.E. Davila,et al.  Line search algorithms for adaptive filtering , 1993, IEEE Trans. Signal Process..

[29]  Avinash C. Kak,et al.  Array signal processing , 1985 .

[30]  Thomas Kailath,et al.  Fast subspace decomposition , 1994, IEEE Trans. Signal Process..

[31]  C. Burrus,et al.  Array Signal Processing , 1989 .

[32]  Michael L. Honig.  Adaptive linear interference suppression for packet DS-CDMA , 1998, Eur. Trans. Telecommun..

[33]  J. Scott Goldstein,et al.  Reduced-rank adaptive filtering , 1997, IEEE Trans. Signal Process..

[34]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[35]  David G. Long,et al.  Array signal processing , 1985, IEEE Trans. Acoust. Speech Signal Process..

[36]  Ilkka Karasalo,et al.  Estimating the covariance matrix by signal subspace averaging , 1986, IEEE Trans. Acoust. Speech Signal Process..

[37]  Daniel J. Rabideau,et al.  Fast, rank adaptive subspace tracking and applications , 1996, IEEE Trans. Signal Process..

[38]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .