A new method for low-rank transform domain adaptive filtering

This paper introduces a least squares, matrix-based framework for adaptive filtering that includes normalized least mean squares (NLMS), affine projection (AP) and recursive least squares (RLS) as special cases. We then introduce a method for extracting a low-rank underdetermined solution from an overdetermined or a high-rank underdetermined least squares problem using a part of a unitary transformation. We show how to create optimal, low-rank transformations within this framework. For obtaining computationally competitive versions of our approach, we use the discrete Fourier transform (DFT). We convert the complex-valued DFT-based solution into a real solution. The most significant bottleneck in the optimal version of the algorithm lies in having to calculate the full-length transform domain error vector. We overcome this difficulty by using a statistical approach involving the transform of the signal rather than that of the error to estimate the best low-rank transform at each iteration. We also employ an innovative mixed domain approach, in which we jointly solve time and frequency domain equations. This allows us to achieve very good performance using a transform order that is lower than the length of the filter. Thus, we are able to achieve very fast convergence at low complexity. Using the acoustic echo cancellation problem, we show that our algorithm performs better than NLMS and AP and competes well with FTF-RLS for low SNR conditions. The algorithm lies in between affine projection and FTF-RLS, both in terms of its complexity and its performance.

[1]  A. Peterson,et al.  Transform domain LMS algorithm , 1983 .

[2]  J. Scott Goldstein,et al.  Reduced-rank adaptive filtering , 1997, IEEE Trans. Signal Process..

[3]  Inbar Fijalkow,et al.  Fractionally spaced equalizers , 1996, IEEE Signal Process. Mag..

[4]  J. Shynk Frequency-domain and multirate adaptive filtering , 1992, IEEE Signal Processing Magazine.

[5]  D. Begusic,et al.  Low rank transform domain adaptive filtering , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[6]  Nicholas Kalouptsidis,et al.  Adaptive system identification and signal processing algorithms , 1993 .

[7]  Bernard Widrow,et al.  Adaptive design of digital filters , 1981, ICASSP.

[8]  Martin Vetterli,et al.  Adaptive filtering in sub-bands , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[9]  Masashi Tanaka,et al.  Fast projection algorithm and its step size control , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[10]  Louis L. Scharf,et al.  Rank reduction for modeling stationary signals , 1987, IEEE Trans. Acoust. Speech Signal Process..

[11]  Sadaoki Furui,et al.  Advances in Speech Signal Processing , 1991 .

[12]  Anthony G. Constantinides,et al.  Order-recursive underdetermined recursive least-squares adaptive algorithms , 1997, Signal Process..

[13]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[14]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .

[15]  Dominique Godard,et al.  Channel equalization using a Kalman filter for fast data transmission , 1974 .

[16]  Allen Gersho,et al.  Adaptive Cancellation of Nonlinear Intersymbol Interference for Voiceband Data Transmission , 1984, IEEE Journal on Selected Areas in Communications.

[17]  T. Kailath,et al.  Fast, recursive-least-squares transversal filters for adaptive filtering , 1984 .

[18]  Pierre Duhamel,et al.  A set of algorithms linking NLMS and block RLS algorithms , 1995, IEEE Trans. Signal Process..

[19]  Steven L. Gay,et al.  The fast affine projection algorithm , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[20]  Simon Haykin,et al.  Adaptive filter theory (2nd ed.) , 1991 .

[21]  R. E. Kalman,et al.  Aspects of network and system theory , 1971 .

[22]  J. G. Proakis Adaptive equalization for TDMA digital mobile radio , 1991 .

[23]  N. Ahmed,et al.  Discrete Cosine Transform , 1996 .

[24]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[25]  Anthony G. Constantinides,et al.  Underdetermined-order recursive least-squares adaptive filtering: the concept and algorithms , 1997, IEEE Trans. Signal Process..

[26]  Walter Kellermann,et al.  Analysis and design of multirate systems for cancellation of acoustical echoes , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.

[27]  Martin Vetterli,et al.  Adaptive filtering in subbands with critical sampling: analysis, experiments, and application to acoustic echo cancellation , 1992, IEEE Trans. Signal Process..

[28]  B. Widrow,et al.  Adaptive noise cancelling: Principles and applications , 1975 .

[29]  Dennis R. Morgan,et al.  On a class of computationally efficient, rapidly converging, generalized NLMS algorithms , 1996, IEEE Signal Processing Letters.

[30]  S. Thomas Alexander,et al.  Adaptive Signal Processing , 1986, Texts and Monographs in Computer Science.

[31]  R. Kumaresan,et al.  Data adaptive signal estimation by singular value decomposition of a data matrix , 1982, Proceedings of the IEEE.

[32]  Scott C. Douglas Efficient approximate implementations of the fast affine projection algorithm using orthogonal transforms , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[33]  B. Farhang-Boroujeny,et al.  Adaptive Filters: Theory and Applications , 1999 .

[34]  A. Gersho,et al.  Adaptive cancellation of intersymbol interference for data transmission , 1981, The Bell System Technical Journal.

[35]  L. J. Griffiths,et al.  An alternative approach to linearly constrained adaptive beamforming , 1982 .

[36]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[37]  F. Ling,et al.  New forms of LS lattice algorithms and an analysis of their round-off error characteristics , 1985, ICASSP '85. IEEE International Conference on Acoustics, Speech, and Signal Processing.