Fast Approximate Inverse Power Iteration Algorithm for Adaptive Total Least-Squares FIR Filtering

The presence of contaminating noises at both the input and the output of an finite-impulse-response (FIR) system constitutes a major impediment to unbiased parameter estimation. The total least-squares (TLS) method is known to be effective in achieving unbiased estimation. In this correspondence, we develop a fast recursive algorithm with a view to finding the TLS solution for adaptive FIR filtering. Given the fact that the TLS solution is obtainable via inverse power iteration, we introduce a novel but approximate inverse power iteration in combination with Galerkin method so that the TLS solution can be updated adaptively at a lower computational cost. We also take advantage of the regular form of the TLS solution to constrain the last element of the filter parameter vector to the negative one. We further reduce the computational complexity of the developed algorithm by making efficient computation of the fast gain vector defined in and using rank-one update of the augmented autocorrelation matrix. The developed algorithm saves seven M MAD's (number of multiplies, divides, and square roots) when compared with the recursive TLS algorithm in . Moreover, unlike the algorithms given in and , the developed algorithm does not deal with the solution to a one-variable quadratic equation and it avoids square root operation. Therefore, it has the simpler structure and may be more easily implemented. We then make a careful investigation into global convergence of the developed algorithm. Simulation results are provided that clearly illustrate appealing performance of the developed algorithm, including its good long-term numerical stability

[1]  Deniz Erdogmus,et al.  Error whitening criterion for adaptive filtering: theory and algorithms , 2005, IEEE Transactions on Signal Processing.

[2]  Geoffrey A. Williamson,et al.  Analysis of gradient algorithms for TLS-based adaptive IIR filters , 2004, IEEE Transactions on Signal Processing.

[3]  Simon Haykin,et al.  Adaptive filter theory (2nd ed.) , 1991 .

[4]  T. Kailath,et al.  Least squares type algorithm for adaptive implementation of Pisarenko's harmonic retrieval method , 1982 .

[5]  C.E. Davila,et al.  Line search algorithms for adaptive filtering , 1993, IEEE Trans. Signal Process..

[6]  Richard J. Vaccaro On adaptive implementations of Pisarenko's harmonic retrieval method , 1984, ICASSP.

[7]  Tapan K. Sarkar,et al.  Adaptive spectral estimation by the conjugate gradient method , 1986, IEEE Trans. Acoust. Speech Signal Process..

[8]  Carlos E. Davila,et al.  An efficient recursive total least squares algorithm for FIR adaptive filtering , 1994, IEEE Trans. Signal Process..

[9]  L. Ljung,et al.  Fast calculation of gain matrices for recursive estimation schemes , 1978 .

[10]  G. Williamson,et al.  QR-based TLS and mixed LS-TLS algorithms with applications to adaptive IIR filtering , 2003, IEEE Trans. Signal Process..

[11]  Arie Yeredor,et al.  The extended least squares criterion: minimization algorithms and applications , 2001, IEEE Trans. Signal Process..

[12]  Wei Xing Zheng,et al.  A fast recursive total least squares algorithm for adaptive FIR filtering , 2004, IEEE Trans. Signal Process..

[13]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[14]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[15]  George V. Moustakides,et al.  Stabilizing the fast Kalman algorithms , 1989, IEEE Trans. Acoust. Speech Signal Process..

[16]  T. Kailath,et al.  Numerically stable fast transversal filters for recursive least squares adaptive filtering , 1991, IEEE Trans. Signal Process..

[17]  K. Huebner The finite element method for engineers , 1975 .

[18]  Lennart Ljung,et al.  Error propagation properties of recursive least-squares adaptation algorithms , 1985, Autom..