A Novel Convergence Accelerator for the LMS Adaptive Algorithm

Abstract—The least mean square (LMS) algorithm is one of the most well-known algorithms for mobile communication systems due to its implementation simplicity. However, the main limitation is its relatively slow convergence rate. In this paper, a booster using the concept of Markov chains is proposed to speed up the convergence rate of LMS algorithms. The nature of Markov chains makes it possible to exploit the past information in the updating process. Moreover, since the transition matrix has a smaller variance than that of the weight itself by the central limit theorem, the weight transition matrix converges faster than the weight itself. Accordingly, the proposed Markov-chain based booster thus has the ability to track variations in signal characteristics, and meanwhile, it can accelerate the rate of convergence for LMS algorithms. Simulation results show that the LMS algorithm can effectively increase the convergence rate and meantime further approach the Wiener solution, if the Markov-chain based booster is applied. The mean square error is also remarkably reduced, while the convergence rate is improved.

[1]  T. Aboulnasr,et al.  A robust variable step size LMS-type algorithm: analysis and simulations , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[2]  Nurgun Erdol,et al.  Performance of wavelet transform based adaptive filters , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  R. H. Kent,et al.  The Mean Square Successive Difference , 1941 .

[4]  Xuan Kong,et al.  Adaptive Signal Processing Algorithms: Stability and Performance , 1994 .

[5]  Saeed Gazor Prediction in LMS-type adaptive algorithms for smoothly time varying environments , 1999, IEEE Trans. Signal Process..

[6]  Srinath Hosur,et al.  Wavelet transform domain LMS algorithm , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  A. Peterson,et al.  Transform domain LMS algorithm , 1983 .

[8]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[9]  Malay Ghosh,et al.  On the Non-attainability of Chebyshev Bounds , 1977 .

[10]  B. Widrow,et al.  Fundamental relations between the LMS algorithm and the DFT , 1987 .

[11]  Ping Xue,et al.  Analysis and implementation of variable step size adaptive algorithms , 1993, IEEE Trans. Signal Process..