A set of algorithms linking NLMS and block RLS algorithms

This paper describes a set of block processing algorithms which contains as extremal cases the normalized least mean squares (NLMS) and the block recursive least squares (BRLS) algorithms. All these algorithms use small block lengths, thus allowing easy implementation and small input-output delay. It is shown that these algorithms require a lower number of arithmetic operations than the classical least mean squares (LMS) algorithm, while converging much faster. A precise evaluation of the arithmetic complexity is provided, and the adaptive behavior of the algorithm is analyzed. Simulations illustrate that the tracking characteristics of the new algorithm are also improved compared to those of the NLMS algorithm. The conclusions of the theoretical analysis are checked by simulations, illustrating that, even in the case where noise is added to the reference signal, the proposed algorithm allows altogether a faster convergence and a lower residual error than the NLMS algorithm. Finally, a sample-by-sample version of this algorithm is outlined, which is the link between the NLMS and recursive least squares (RLS) algorithms. >

[1]  A. Gray,et al.  Unconstrained frequency-domain adaptive filter , 1982 .

[2]  L. Ljung,et al.  Fast calculation of gain matrices for recursive estimation schemes , 1978 .

[3]  Shigeo Tsujii,et al.  The orthogonal projection algorithm for block adaptive signal processing , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[4]  Jin Jiang,et al.  Fast parameter tracking RLS algorithm with high noise immunity , 1992 .

[5]  Sergios Theodoridis,et al.  Fast Newton transversal filters-a new class of adaptive estimation algorithms , 1991, IEEE Trans. Signal Process..

[6]  Martin Vetterli,et al.  Adaptive filtering in subbands with critical sampling: analysis, experiments, and application to acoustic echo cancellation , 1992, IEEE Trans. Signal Process..

[7]  George Carayannis,et al.  A fast sequential algorithm for least-squares filtering and prediction , 1983 .

[8]  A. Benallal,et al.  Improvement of the tracking capability of the numerically stable fast RLS algorithms for adaptive filtering , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[9]  T. Kailath,et al.  Fast, recursive-least-squares transversal filters for adaptive filtering , 1984 .

[10]  Raymond H. Kwong,et al.  A variable step size LMS algorithm , 1992, IEEE Trans. Signal Process..

[11]  Gene H. Golub,et al.  Matrix computations , 1983 .

[12]  Jacob Benesty,et al.  A fast exact least mean square adaptive algorithm , 1992, IEEE Trans. Signal Process..

[13]  Sanjit K. Mitra,et al.  Block implementation of adaptive digital filters , 1981 .

[14]  L. Ljung,et al.  New inversion formulas for matrices classified in terms of their distance from Toeplitz matrices , 1979 .