Stochastic analysis of the modified DNLMS algorithm for Gaussian data

This paper proposes a stochastic model for the modified delayed normalized least-mean-square (MDNLMS) algorithm. This algorithm uses the a posteriori error to perform the adaptation and a normalized step-size parameter. The MDNLMS algorithm is an alternative to the standard delayed LMS (DLMS) one to obtain a faster and delay-independent convergence speed. Analytical models for the first moment of the adaptive filter weight vector and the learning curve are obtained. Furthermore, the time-varying nature of normalized step size is considered in the models. The proposed approach is derived without invoking the simplifying assumption of an independent input signal. Without considering such an assumption, a high-order hyperelliptic integral has to be computed. The proposed model is based on tackling the solution of such an integral. Numerical simulation results permit to assess the accuracy of the proposed analytical models.

[1]  G. David Forney,et al.  Maximum-likelihood sequence estimation of digital sequences in the presence of intersymbol interference , 1972, IEEE Trans. Inf. Theory.

[2]  R.D. Poltmann,et al.  Conversion of the delayed LMS algorithm into the LMS algorithm , 1995, IEEE Signal Processing Letters.

[3]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[4]  Sang-Sik Ahn,et al.  Almost-sure convergence of the non-homogeneous DNLMS algorithm with decreasing step size , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Chin-Liang Wang,et al.  Delayed least-mean-square algorithm , 1995 .

[6]  Wen-Shyong Yu,et al.  Adaptive pole-placement control of MIMO stochastic systems , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[7]  Neeraj Magotra,et al.  Comparative study of wideband single reference active noise cancellation algorithms on a fixed-point DSP , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[8]  Fuyun Ling,et al.  The LMS algorithm with delayed coefficient adaptation , 1989, IEEE Trans. Acoust. Speech Signal Process..

[9]  Neil J. Bershad,et al.  Analysis of the normalized LMS algorithm with Gaussian inputs , 1986, IEEE Trans. Acoust. Speech Signal Process..

[10]  Sang-Sik Ahn,et al.  Convergence of the delayed normalized LMS algorithm with decreasing step size , 1996, IEEE Trans. Signal Process..

[11]  B. Widrow,et al.  Stationary and nonstationary learning characteristics of the LMS adaptive filter , 1976, Proceedings of the IEEE.

[12]  Fuyun Ling,et al.  Corrections to 'The LMS algorithm with delayed coefficient adaptation' , 1992, IEEE Trans. Signal Process..

[13]  Claude Samson,et al.  Fixed point error analysis of the normalized ladder algorithm , 1983 .

[14]  Simon Haykin,et al.  Adaptive Filter Theory 4th Edition , 2002 .

[15]  Thomas N. Morrissey Analysis of decoders for convolutional codes by stochastic sequential machine methods , 1970, IEEE Trans. Inf. Theory.