A probabilistic least-mean-squares filter

We introduce a probabilistic approach to the LMS filter. By means of an efficient approximation, this approach provides an adaptable step-size LMS algorithm together with a measure of uncertainty about the estimation. In addition, the proposed approximation preserves the linear complexity of the standard LMS. Numerical results show the improved performance of the algorithm with respect to standard LMS and state-of-the-art algorithms with similar complexity. The goal of this work, therefore, is to open the door to bring somemore Bayesian machine learning techniques to adaptive filtering.

[1]  Miguel Lázaro-Gredilla,et al.  Kernel Recursive Least-Squares Tracker for Time-Varying Regression , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[3]  David Falconer,et al.  Frequency domain equalization for single-carrier broadband wireless systems , 2002, IEEE Commun. Mag..

[4]  Ali H. Sayed,et al.  Variable step-size NLMS and affine projection algorithms , 2004, IEEE Signal Processing Letters.

[5]  David Barber,et al.  Graphical Models for Time-Series , 2010, IEEE Signal Processing Magazine.

[6]  James R. Zeidler,et al.  Adaptive tracking of linear time-variant systems by extended RLS algorithms , 1997, IEEE Trans. Signal Process..

[7]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[8]  Ignacio Santamaría,et al.  Frequency-Domain Methodology for Measuring MIMO Channels Using a Generic Test Bed , 2011, IEEE Transactions on Instrumentation and Measurement.

[9]  David Barber,et al.  Bayesian reasoning and machine learning , 2012 .

[10]  T. Kailath,et al.  A state-space approach to adaptive RLS filtering , 1994, IEEE Signal Processing Magazine.

[11]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[12]  Philip A. Nelson,et al.  Active Control of Sound , 1992 .

[13]  Zhang Jingjing,et al.  Variable Step Size LMS Algorithm , 2012 .

[14]  Ali H. Sayed,et al.  Adaptive Filters , 2008 .

[15]  Tyseer Aboulnasr,et al.  A robust variable step-size LMS-type algorithm: analysis and simulations , 1997, IEEE Trans. Signal Process..

[16]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[17]  Martin Vetterli,et al.  Adaptive filtering in subbands with critical sampling: analysis, experiments, and application to acoustic echo cancellation , 1992, IEEE Trans. Signal Process..

[18]  Sohan Seth,et al.  Probabilistic kernel least mean squares algorithms , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Jesús Cid-Sueiro,et al.  Recurrent radial basis function networks for optimal symbol-by-symbol equalization , 1994, Signal Process..