Mean-square-deviation analysis of probabilistic LMS algorithm

Abstract A stochastic analysis of the probabilistic least-mean-square (Prob-LMS) algorithm would be a useful guideline for designing the adaptive filter. However, no analytical expressions for the stochastic analysis of the Prob-LMS algorithm have been reported in the literature. Hence, this paper analyzes the mean-deviation and mean-square-deviation (MSD) behavior of the Prob-LMS algorithm for the general case of an unknown Gauss-Markov channel. Analytical expressions are derived for the transient and steady-state MSD of the Prob-LMS algorithm. Monte Carlo simulations for fixed and time varying channels show excellent agreement between the simulated and theoretical MSD for a wide range of parameters such as SNR, filter length and input signal statistics. Monte Carlo MSD simulation results are presented for the Prob-LMS algorithm which compare favorably to several well-known VSS algorithms.

[1]  Rui Seara,et al.  A VSSLMS algorithm based on error autocorrelation , 2008, 2008 16th European Signal Processing Conference.

[2]  Victor Elvira,et al.  A probabilistic least-mean-squares filter , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Wei Xing Zheng,et al.  A new combined-step-size normalized least mean square algorithm for cyclostationary inputs , 2017, Signal Process..

[4]  Roland Maas,et al.  The NLMS Algorithm with Time-Variant Optimum Stepsize Derived from a Bayesian Network Perspective , 2014, IEEE Signal Processing Letters.

[5]  Ali H. Sayed,et al.  Mean-square performance of a family of affine projection algorithms , 2004, IEEE Transactions on Signal Processing.

[6]  Yi Yu,et al.  A new normalized LMAT algorithm and its performance analysis , 2014, Signal Process..

[7]  Dirk T. M. Slock,et al.  On the convergence behavior of the LMS and the normalized LMS algorithms , 1993, IEEE Trans. Signal Process..

[8]  Junghsi Lee,et al.  A New Variable Step-Size NLMS Algorithm and Its Performance Analysis , 2012, IEEE Transactions on Signal Processing.

[9]  Chang Hee Lee,et al.  Mean-Square Deviation Analysis of Affine Projection Algorithm , 2011, IEEE Transactions on Signal Processing.

[10]  T. Kailath,et al.  A state-space approach to adaptive RLS filtering , 1994, IEEE Signal Processing Magazine.

[11]  Ehud Weinstein,et al.  Convergence analysis of LMS filters with uncorrelated Gaussian data , 1985, IEEE Trans. Acoust. Speech Signal Process..

[12]  Sheng Zhang,et al.  Affine Projection Versoria Algorithm for Robust Adaptive Echo Cancellation in Hands-Free Voice Communications , 2018, IEEE Transactions on Vehicular Technology.

[13]  Miguel Lázaro-Gredilla,et al.  Kernel Recursive Least-Squares Tracker for Time-Varying Regression , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Seung Hun Kim,et al.  Mean-Square Deviation Analysis of Multiband-Structured Subband Adaptive Filter Algorithm , 2016, IEEE Transactions on Signal Processing.

[15]  Sheng Zhang,et al.  A family of robust adaptive filtering algorithms based on sigmoid cost , 2018, Signal Process..

[16]  Khaled Mayyas,et al.  An LMS adaptive algorithm with a new step-size control equation , 2011, J. Frankl. Inst..

[17]  James R. Zeidler,et al.  Adaptive tracking of linear time-variant systems by extended RLS algorithms , 1997, IEEE Trans. Signal Process..

[18]  Markus Rupp,et al.  The behavior of LMS and NLMS algorithms in the presence of spherically invariant processes , 1993, IEEE Trans. Signal Process..

[19]  Wei Xing Zheng,et al.  Mean-Square Analysis of Multi-Sampled Multiband-Structured Subband Filtering Algorithm , 2019, IEEE Transactions on Circuits and Systems I: Regular Papers.

[20]  Eduardo Vinicius Kuhn,et al.  On the stochastic modeling of a VSS-NLMS algorithm with high immunity against measurement noise , 2018, Signal Process..

[21]  Sheng Zhang,et al.  Mean square deviation analysis of LMS and NLMS algorithms with white reference inputs , 2017, Signal Process..

[22]  Jianchang Liu,et al.  A nonparametric variable step-size NLMS algorithm for transversal filters , 2011, Appl. Math. Comput..

[23]  Yonggang Zhang,et al.  NEW GRADIENT BASED VARIABLE STEP-SIZE LMS ALGORITHM , 2006, 2006 8th international Conference on Signal Processing.

[24]  C. K. Michael Tse,et al.  A class of improved least sum of exponentials algorithms , 2016, Signal Process..

[25]  Zhihong Man,et al.  Variable step-size LMS algorithm with a quotient form , 2009, Signal Process..

[26]  José Carlos M. Bermudez,et al.  A noise resilient variable step-size LMS algorithm , 2008, Signal Process..

[27]  Jacob Benesty,et al.  An optimized NLMS algorithm for system identification , 2016, Signal Process..

[28]  Jiashu Zhang,et al.  Combined-Step-Size Normalized Subband Adaptive Filter With a Variable-Parametric Step-Size Scaler Against Impulsive Interferences , 2018, IEEE Transactions on Circuits and Systems II: Express Briefs.

[29]  Behrouz Farhang-Boroujeny,et al.  A new class of gradient adaptive step-size LMS algorithms , 2001, IEEE Trans. Signal Process..

[30]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[31]  Jacob Benesty,et al.  Adaptive Signal Processing: Applications to Real-World Problems , 2003 .

[32]  Yahong Rosa Zheng,et al.  Two variable step-size adaptive algorithms for non-Gaussian interference environment using fractionally lower-order moment minimization , 2013, Digit. Signal Process..

[33]  Ali H. Sayed,et al.  Fundamentals Of Adaptive Filtering , 2003 .

[34]  V. John Mathews,et al.  A stochastic gradient adaptive filter with gradient adaptive step size , 1993, IEEE Trans. Signal Process..

[35]  Raymond H. Kwong,et al.  A variable step size LMS algorithm , 1992, IEEE Trans. Signal Process..

[36]  Yanyan Wang,et al.  A variable step-size diffusion LMS algorithm over networks with noisy links , 2018, Signal Process..

[37]  Tyseer Aboulnasr,et al.  A robust variable step-size LMS-type algorithm: analysis and simulations , 1997, IEEE Trans. Signal Process..

[38]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[39]  Nanning Zheng,et al.  Steady-State Mean-Square Error Analysis for Adaptive Filtering under the Maximum Correntropy Criterion , 2014, IEEE Signal Processing Letters.

[40]  Sheng Zhang,et al.  Transient analysis of zero attracting NLMS algorithm without Gaussian inputs assumption , 2014, Signal Process..

[41]  Sohan Seth,et al.  Probabilistic kernel least mean squares algorithms , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).