An optimal adaptive filtering algorithm with a polynomial prediction model

A new approach to the optimal adaptive filtering is proposed in this paper. In this approach, a polynomial prediction model is used to describe the time-variant/invariant impulse response coefficients of an identified system. When the polynomial prediction model is viewed as the state equations of the identified impulse response coefficients and the relationships between the inputs and outputs of the system are regarded as the measurements of the states, our adaptive filtering can be achieved in the framework of the Kalman filter. It is understood that Kalman filter is optimal in the sense of the MAP (maximum a posteriori), ML (most likelihood) and MMSE (minimum mean square error) under the linear and Gaussian white noise conditions. As a result, our algorithm is also optimal in the statistical senses as Kalman filter does, provided that the impulse response coefficients can be modeled by a polynomial. Not only do the analytical results of the algorithm but also the simulation results show that our algorithm outperforms the traditional known algorithms.

[1]  Rudolph van der Merwe,et al.  Sigma-point kalman filters for probabilistic inference in dynamic state-space models , 2004 .

[2]  Paul J. Gendron,et al.  An empirical Bayes estimator for in-scale adaptive filtering , 2005, IEEE Transactions on Signal Processing.

[3]  Guanrong Chen,et al.  Kalman Filtering with Real-time Applications , 1987 .

[4]  Anthony G. Constantinides,et al.  A novel kurtosis driven variable step-size adaptive algorithm , 1999, IEEE Trans. Signal Process..

[5]  Greg Welch,et al.  An Introduction to Kalman Filter , 1995, SIGGRAPH 2001.

[6]  Sailes K. Sengijpta Fundamentals of Statistical Signal Processing: Estimation Theory , 1995 .

[7]  T. Aboulnasr,et al.  A robust variable step size LMS-type algorithm: analysis and simulations , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[8]  Bernard Widrow,et al.  Adaptive Signal Processing , 1985 .

[9]  Yrjö Neuvo,et al.  FIR-median hybrid filters with predictive FIR substructures , 1988, IEEE Trans. Acoust. Speech Signal Process..

[10]  A. Laub,et al.  Generalized eigenproblem algorithms and software for algebraic Riccati equations , 1984, Proceedings of the IEEE.

[11]  S. Paszkowski,et al.  On the Weierstrass approximation theorem , 1957 .

[12]  Shirish Nagaraj,et al.  Set-membership filtering and a set-membership normalized LMS algorithm with an adaptive step size , 1998, IEEE Signal Processing Letters.

[13]  Jacob Benesty,et al.  A Nonparametric VSS NLMS Algorithm , 2006, IEEE Signal Processing Letters.

[14]  Dong-Yan Huang,et al.  Maximum a Posteriori based Adaptive Algorithms , 2007, 2007 Conference Record of the Forty-First Asilomar Conference on Signals, Systems and Computers.

[15]  Jacob Benesty,et al.  Adaptive Signal Processing: Applications to Real-World Problems , 2003 .

[16]  Ali H. Sayed,et al.  Fundamentals Of Adaptive Filtering , 2003 .

[17]  Ping Xue,et al.  Analysis and implementation of variable step size adaptive algorithms , 1993, IEEE Trans. Signal Process..

[18]  Ali H. Sayed,et al.  Variable step-size NLMS and affine projection algorithms , 2004, IEEE Signal Processing Letters.

[19]  Dennis R. Morgan,et al.  On a class of computationally efficient, rapidly converging, generalized NLMS algorithms , 1996, IEEE Signal Processing Letters.

[20]  George-Othon Glentis,et al.  Efficient least squares adaptive algorithms for FIR transversal filtering , 1999, IEEE Signal Process. Mag..

[21]  Yong Yan,et al.  A wavelet-based multisensor data fusion algorithm , 2004, IEEE Transactions on Instrumentation and Measurement.

[22]  Henning Puder,et al.  Step-size control for acoustic echo cancellation filters - an overview , 2000, Signal Process..

[23]  L. Ljung,et al.  Necessary and sufficient conditions for stability of LMS , 1997, IEEE Trans. Autom. Control..

[24]  N. F. Toda,et al.  Divergence in the Kalman Filter , 1967 .

[25]  Ali H. Sayed,et al.  H∞ optimality of the LMS algorithm , 1996, IEEE Trans. Signal Process..

[26]  Emmanuel Ifeachor,et al.  Digital Signal Processing: A Practical Approach , 1993 .

[27]  S. Kay Fundamentals of statistical signal processing: estimation theory , 1993 .

[28]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[29]  Jingdong Chen,et al.  Acoustic MIMO Signal Processing , 2006 .