A unified view of adaptive algorithms for finite impulse response filters using the H∞ framework

The normalized least mean squares (NLMS) and recursive least squares (RLS) algorithms are widely used for adaptive filtering. Interestingly, the NLMS algorithm has been shown to be strictly optimal in the sense of H ∞ filtering, whereas the forgetting factor RLS algorithm has not been clearly related to a solution to the H ∞ filtering problem. This paper describes a method for further optimizing the solutions to the ordinary H ∞ filtering problem over an assumed system model set and a predetermined norm weight set. The extended H ∞ filtering problem offers a framework for constructing a unified view of adaptive algorithms for finite impulse response (FIR) filters. The framework enables a discussion of the relationships among the NLMS algorithm, the forgetting factor RLS algorithm, and the H ∞ filter over the common parameter space, and facilitates the development of new fast adaptive algorithms that outperform the existing algorithms, such as the NLMS and the fast RLS algorithms. The validity of the discussion based on the H ∞ framework is verified using numerical examples. HighlightsThe proposed H ∞ framework establishes a unified view of adaptive FIR filtering algorithms.The unified view facilitated the development of new fast adaptive algorithms.The resulting fast H ∞ filter was able to effectively balance the tracking speed and the robustness.

[1]  Kiyoshi Nishiyama Computational Improvement of the Fast ${\rm H}_{\infty}$ Filter Based on Information of Input Predictor , 2007, IEEE Transactions on Signal Processing.

[2]  Ganapati Panda,et al.  A robust filtered-s LMS algorithm for nonlinear active noise control , 2012 .

[3]  Georgios B. Giannakis,et al.  Robust RLS in the Presence of Correlated Noise Using Outlier Sparsity , 2012, IEEE Transactions on Signal Processing.

[4]  George Carayannis,et al.  A unifed view of parametric processing algorithms for prewindowed signals , 1986 .

[5]  Feng Ding,et al.  A finite-data-window least squares algorithm with a forgetting factor for dynamical modeling , 2007, Appl. Math. Comput..

[6]  Kiyoshi Nishiyama Fast J-Unitary Array Form of the Hyper Hinfinity Filter , 2005, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[7]  Junghsi Lee,et al.  A New Variable Step-Size NLMS Algorithm and Its Performance Analysis , 2012, IEEE Transactions on Signal Processing.

[8]  Babak Hassibi,et al.  Indefinite-Quadratic Estimation And Control , 1987 .

[9]  Shu Hung Leung,et al.  Gradient-based variable forgetting factor RLS algorithm in time-varying environments , 2005, IEEE Transactions on Signal Processing.

[10]  Jacob Benesty,et al.  A Robust Variable Forgetting Factor Recursive Least-Squares Algorithm for System Identification , 2008, IEEE Signal Processing Letters.

[11]  Dan Simon,et al.  Optimal State Estimation: Kalman, H∞, and Nonlinear Approaches , 2006 .

[12]  Ali H. Sayed,et al.  Adaptive Filters , 2008 .

[13]  T. Kailath,et al.  A state-space approach to adaptive RLS filtering , 1994, IEEE Signal Processing Magazine.

[14]  Ali H. Sayed,et al.  H∞ optimality of the LMS algorithm , 1996, IEEE Trans. Signal Process..

[15]  Jacob Benesty,et al.  A New Robust Variable Step-Size NLMS Algorithm , 2008, IEEE Transactions on Signal Processing.

[16]  T. Kailath,et al.  Indefinite-quadratic estimation and control: a unified approach to H 2 and H ∞ theories , 1999 .

[17]  Kiyoshi Nishiyama,et al.  An H/sub /spl infin// optimization and its fast algorithm for time-variant system identification , 2004, IEEE Transactions on Signal Processing.

[18]  Andreas Antoniou,et al.  Robust Recursive Least-Squares Adaptive-Filtering Algorithm for Impulsive-Noise Environments , 2011, IEEE Signal Processing Letters.

[19]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[20]  Kiyoshi Nishiyama Algorithm Understanding of the J-Fast H∞ Filter Based on Linear Prediction of Input Signal , 2012, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..