Stochastic Modeling of the Transform-Domain $\varepsilon {\rm LMS}$ Algorithm

This paper presents a statistical analysis of the transform-domain least-mean-square (TDLMS) algorithm, resulting in a more accurate model than those discussed in the current open literature. The motivation to analyze such an algorithm comes from the fact that the TDLMS presents a higher convergence speed for correlated input signals, as compared with other adaptive algorithms possessing a similar computational complexity. Such a fact makes it a highly competitive alternative to some applications. Approximate analytical models for the first and second moments of the filter weight vector are obtained. The TDLMS algorithm has an orthonormal transformation stage, accomplishing a decomposition of the input signal into distinct frequency bands, in which the interband samples are practically uncorrelated. On the other hand, the intraband samples are correlated; the larger the number of bands, the higher their correlation. The model is then derived taking into account such a correlation, requiring that a high-order hyperelliptic integral be computed. In addition to the proposed model, an approximate procedure for computing high-order hyperelliptic integrals is presented. A regularization parameter is also considered in the model expressions, permitting to assess its impact on the adaptive algorithm behavior. An upper bound for the step-size control parameter is also obtained. Through simulation results, the accuracy of the proposed model is assessed.

[1]  S. Attallah,et al.  Analysis of DCTLMS algorithm with a selective coefficient updating , 2001 .

[2]  Dirk T. M. Slock,et al.  On the convergence behavior of the LMS and the normalized LMS algorithms , 1993, IEEE Trans. Signal Process..

[3]  Ehud Weinstein,et al.  Convergence analysis of LMS filters with uncorrelated Gaussian data , 1985, IEEE Trans. Acoust. Speech Signal Process..

[4]  V. Umapathi Reddy,et al.  Fixed point error analysis of the normalized ladder algorithm , 1982, ICASSP.

[5]  Kazuhiko Ozeki,et al.  An adaptive filtering algorithm using an orthogonal projection to an affine subspace and its properties , 1984 .

[6]  José Carlos M. Bermudez,et al.  Mean weight behavior of the filtered-X LMS algorithm , 2000, IEEE Trans. Signal Process..

[7]  W. K. Jenkins,et al.  The use of orthogonal transforms for improving performance of adaptive filters , 1989 .

[8]  Samir Attallah The wavelet transform-domain LMS adaptive filter with partial subband-coefficient updating , 2006, IEEE Transactions on Circuits and Systems II: Express Briefs.

[9]  Françoise Beaufays,et al.  Transform-domain adaptive filters: an analytical approach , 1995, IEEE Trans. Signal Process..

[10]  Shiunn-Jang Chern,et al.  The performance of the hybrid LMS adaptive algorithm , 1995, Signal Process..

[11]  Rui Seara,et al.  A stochastic model for the transform-domain LMS algorithm , 2004, 2004 12th European Signal Processing Conference.

[12]  A. Z. Baraniecki,et al.  The use of the modified escalator algorithm to improve the performance of transform-domain LMS adaptive filters , 1998, IEEE Trans. Signal Process..

[13]  B. Farhang-Boroujeny,et al.  Adaptive Filters: Theory and Applications , 1999 .

[14]  A. Peterson,et al.  Transform domain LMS algorithm , 1983 .

[15]  B. Farhang-Boroujeny,et al.  Performance analysis of transform domain normalized LMS algorithm , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[16]  Samir Attallah,et al.  The wavelet transform-domain LMS algorithm: a more practical approach , 2000 .

[17]  R. Seara,et al.  Stochastic modeling of the transform-domain εLMS algorithm for correlated Gaussian data , 2006, 2006 International Telecommunications Symposium.

[18]  I. S. Gradshteyn,et al.  Table of Integrals, Series, and Products , 1976 .

[19]  Srinath Hosur,et al.  Wavelet transform domain adaptive FIR filtering , 1997, IEEE Trans. Signal Process..

[20]  Arie Feuer,et al.  Convergence and performance analysis of the normalized LMS algorithm with uncorrelated Gaussian data , 1988, IEEE Trans. Inf. Theory.

[21]  Jae Chon Lee,et al.  Performance of transform-domain LMS adaptive digital filters , 1986, IEEE Trans. Acoust. Speech Signal Process..

[22]  Chong Un,et al.  On the convergence behaviour of frequency-domain LMS adaptive digital filters , 1984, ICASSP.

[23]  Rui Seara,et al.  Second moment analysis of the filtered-X LMS algorithm , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[24]  I. Miller Probability, Random Variables, and Stochastic Processes , 1966 .

[25]  Neil J. Bershad,et al.  Analysis of the normalized LMS algorithm with Gaussian inputs , 1986, IEEE Trans. Acoust. Speech Signal Process..

[26]  S. Thomas Alexander,et al.  Adaptive Signal Processing , 1986, Texts and Monographs in Computer Science.

[27]  Philippe De Wilde,et al.  Performance analysis of the DCT-LMS adaptive filtering algorithm , 2000, Signal Process..

[28]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .