Fast LMS/Newton algorithms based on autoregressive modeling and their application to acoustic echo cancellation

We propose two new implementations of the LMS/Newton algorithm for efficient realization of long adaptive filters. We assume that the input sequence to the adaptive filter can be modeled as an autoregressive (AR) process whose order may be kept much lower than the adaptive filter length. The two algorithms differ in their structural complexity. The first algorithm, which will be an exact implementation of the LMS/Newton algorithm if the AR modeling assumption is accurate, is structurally complicated and fits best into a digital signal processing (DSP)-based implementation. On the other hand, the second algorithm is structurally simple and is tailored more toward very large-scale integrated (VLSI) custom chip design. Analyses of the proposed algorithms are given. It is found that for long filters, both algorithms perform about the same. However for short filters, a noticeable difference between the two may be observed. Simulation results that confirm our theoretical findings are given. Moreover, experiments with speech signals for modeling the acoustics of an office room show the superior convergence of the proposed algorithms when compared with the normalized LMS algorithm.

[1]  Chong Kwan Un,et al.  Performance analysis of frequency-domain block LMS adaptive digital filters , 1989 .

[2]  Odile Macchi,et al.  Adaptive recovery of a chirped sinusoid in noise. I. Performance of the RLS algorithm , 1991, IEEE Trans. Signal Process..

[3]  Bernard Widrow,et al.  On the statistical efficiency of the LMS algorithm with nonstationary inputs , 1984, IEEE Trans. Inf. Theory.

[4]  David G. Messerschmitt,et al.  Adaptive Filters: Structures, Algorithms and Applications , 1984 .

[5]  Behrouz Farhang-Boroujeny Application of orthonormal transforms to implementation of quasi-LMS/Newton algorithm , 1993, IEEE Trans. Signal Process..

[6]  A. Gilloire,et al.  The fast Newton transversal filter: an efficient scheme for acoustic echo cancellation in mobile radio , 1994, IEEE Trans. Signal Process..

[7]  Fuyun Ling,et al.  The LMS algorithm with delayed coefficient adaptation , 1989, IEEE Trans. Acoust. Speech Signal Process..

[8]  Héctor M. Pérez Meana,et al.  A multirate acoustic echo canceler structure , 1995, IEEE Trans. Commun..

[9]  Sergios Theodoridis,et al.  Fast Newton transversal filters-a new class of adaptive estimation algorithms , 1991, IEEE Trans. Signal Process..

[10]  Robert M. Gray,et al.  On the asymptotic eigenvalue distribution of Toeplitz matrices , 1972, IEEE Trans. Inf. Theory.

[11]  Odile Macchi,et al.  Adaptive recovery of a chirped sinusoid in noise. II. Performance of the LMS algorithm , 1991, IEEE Trans. Signal Process..

[12]  M. R. Spiegel Mathematical handbook of formulas and tables , 1968 .

[13]  Richard W. Harris,et al.  A variable step (VS) adaptive filter algorithm , 1986, IEEE Trans. Acoust. Speech Signal Process..

[14]  A. Peterson,et al.  Transform domain LMS algorithm , 1983 .

[15]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[16]  Fuyun Ling,et al.  Nonstationary learning characteristics of least squares adaptive estimation algorithms , 1984, ICASSP.

[17]  Saeed Gazor,et al.  Performance of LMS-based adaptive filters in tracking a time-varying plant , 1996, IEEE Trans. Signal Process..

[18]  Eweda Eweda,et al.  Tracking error bounds of adaptive nonstationary filtering , 1985, Autom..

[19]  S. Thomas Alexander,et al.  Adaptive Signal Processing , 1986, Texts and Monographs in Computer Science.

[20]  W. Kenneth Jenkins,et al.  A fast quasi-Newton adaptive filtering algorithm , 1988, ICASSP-88., International Conference on Acoustics, Speech, and Signal Processing.