On the robustness, convergence, and minimax performance of instantaneous-gradient adaptive filters

The paper establishes several robustness, optimality, and convergence properties of the widely used class of instantaneous-gradient adaptive algorithms. The analysis is carried out in a purely deterministic framework and assumes no apriori statistical information. It starts with a simple Cauchy-Schwarz inequality for vectors in an Euclidean space and proceeds to derive local and global energy bounds that are shown here to highlight, as well as explain, several relevant aspects of this important class of algorithms.<<ETX>>

[1]  Victor Solo,et al.  The limiting behavior of LMS , 1989, IEEE Trans. Acoust. Speech Signal Process..

[2]  N. Bershad Behavior of the ε-normalized LMS algorithm with Gaussian inputs , 1987, IEEE Trans. Acoust. Speech Signal Process..

[3]  T. Kailath,et al.  A state-space approach to adaptive RLS filtering , 1994, IEEE Signal Processing Magazine.

[4]  Ali H. Sayed,et al.  LMS is H/sup /spl infin// optimal , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[5]  Pramod P. Khargonekar,et al.  FILTERING AND SMOOTHING IN AN H" SETTING , 1991 .

[6]  Ali H. Sayed,et al.  On the stability and convergence of Feintuch's algorithm for adaptive IIR filtering , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[7]  Ali H. Sayed,et al.  LMS is H∞ Optimal , 1995 .

[8]  P. Khargonekar,et al.  State-space solutions to standard H2 and H∞ control problems , 1988, 1988 American Control Conference.

[9]  P. Khargonekar,et al.  State-space solutions to standard H/sub 2/ and H/sub infinity / control problems , 1989 .

[10]  Bernard Widrow,et al.  Adaptive Signal Processing , 1985 .

[11]  William A. Gardner Nonstationary learning characteristics of the LMS algorithm , 1987 .