Nonlinear System Identification using a New Sliding-Window Kernel RLS Algorithm

In this paper we discuss in detail a recently proposed kernel-based version of the recursive least-squares (RLS) algorithm for fast adaptive nonlinear filtering. Unlike other previous approaches, the studied method combines a sliding-window approach (to fix the dimensions of the kernel matrix) with conventional ridge regression (to improve generalization). The resulting kernel RLS algorithm is applied to several nonlinear system identification problems. Experiments show that the proposed algorithm is able to operate in a time-varying environment and to adjust to abrupt changes in either the linear filter or the nonlinearity.

[1]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[2]  Paulo Sergio Ramirez,et al.  Fundamentals of Adaptive Filtering , 2002 .

[3]  Shie Mannor,et al.  The kernel recursive least-squares algorithm , 2004, IEEE Transactions on Signal Processing.

[4]  P. Holland,et al.  Robust regression using iteratively reweighted least-squares , 1977 .

[5]  Ignacio Santamaría,et al.  A Sliding-Window Kernel RLS Algorithm and Its Application to Nonlinear Channel Identification , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[6]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[7]  Johan A. K. Suykens,et al.  Efficiently updating and tracking the dominant kernel principal components , 2007, Neural Networks.

[8]  D. Erdogmus,et al.  Nonlinear channel equalization using multilayer perceptrons with information-theoretic criterion , 2001, Neural Networks for Signal Processing XI: Proceedings of the 2001 IEEE Signal Processing Society Workshop (IEEE Cat. No.01TH8584).

[9]  Michael I. Jordan,et al.  Kernel independent component analysis , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[10]  John Shawe-Taylor,et al.  Canonical Correlation Analysis: An Overview with Application to Learning Methods , 2004, Neural Computation.

[11]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[12]  John M. Cioffi,et al.  Nonlinear channel models for digital magnetic recording , 1993 .

[13]  Ignacio Santamaría,et al.  Online Kernel Canonical Correlation Analysis for Supervised Equalization of Wiener Systems , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[14]  Andreas Wendemuth,et al.  Kernel Least-Squares Models Using Updates of the Pseudoinverse , 2006, Neural Computation.

[15]  Xiao Liu,et al.  Canonical piecewise linear network for nonlinear filtering and its application to blind equalization , 1997, Signal Process..

[16]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[17]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[18]  Elias S. Manolakos,et al.  Using recurrent neural networks for adaptive communication channel equalization , 1994, IEEE Trans. Neural Networks.