Design and comparative study of online kernel methods identification of nonlinear system in RKHS space

This paper proposes the design and a comparative study of two proposed online kernel methods identification in the reproducing kernel Hilbert space and other two kernel method existing in the literature. The two proposed methods, titled SVD-KPCA, online RKPCA. The two other techniques named Sliding Window Kernel Recursive Least Square and the Kernel Recursive Least Square. The considered performances are the Normalized Means Square Error, the consumed time and the numerical complexity. All methods are evaluated by handling a chemical process known as the Continuous Stirred Tank Reactor and Wiener-Hammerstein benchmark.

[1]  Vladimir Vovk,et al.  Leading strategies in competitive on-line prediction , 2006, Theor. Comput. Sci..

[2]  Roman Rosipal,et al.  Kernel Partial Least Squares Regression in Reproducing Kernel Hilbert Space , 2002, J. Mach. Learn. Res..

[3]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[4]  Hassani Messaoud,et al.  Online identification of nonlinear system using reduced kernel principal component analysis , 2010, Neural Computing and Applications.

[5]  Manfred K. Warmuth,et al.  Online kernel PCA with entropic matrix updates , 2007, ICML '07.

[6]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[7]  S. V. N. Vishwanathan,et al.  Fast Iterative Kernel Principal Component Analysis , 2007, J. Mach. Learn. Res..

[8]  Vladimir Vovk,et al.  On-Line Regression Competitive with Reproducing Kernel Hilbert Spaces , 2005, TAMC.

[9]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[10]  Nathalie Villa-Vialaneix,et al.  Identification of non linear multivariable processes modelled on reproducing Kernel Hilbert space: Application to Tennessee process , 2009, ICONS.

[11]  Ignacio Santamaría,et al.  Nonlinear System Identification using a New Sliding-Window Kernel RLS Algorithm , 2007, J. Commun..

[12]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[13]  Paul Honeine,et al.  Online Prediction of Time Series Data With Kernels , 2009, IEEE Transactions on Signal Processing.

[14]  Wenjian Wang,et al.  Online prediction model based on support vector machine , 2008, Neurocomputing.

[15]  Michael I. Jordan,et al.  Dimensionality Reduction for Supervised Learning with Reproducing Kernel Hilbert Spaces , 2004, J. Mach. Learn. Res..

[16]  Shie Mannor,et al.  The kernel recursive least-squares algorithm , 2004, IEEE Transactions on Signal Processing.

[17]  Nello Cristianini,et al.  The Application of Support Vector Machines to Medical decision Support: A Case Study , 1999 .

[18]  S. V. Dudul,et al.  Induction machine fault detection using support vector machine based classifier , 2009 .

[19]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[20]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[21]  Ming-Hsuan Yang,et al.  Kernel Eigenfaces vs. Kernel Fisherfaces: Face recognition using kernel methods , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[22]  Johan A. K. Suykens,et al.  Efficiently updating and tracking the dominant kernel principal components , 2007, Neural Networks.

[23]  H. Messaoud,et al.  Online prediction model based on Reduced Kernel Principal Component Analysis , 2009, 2009 3rd International Conference on Signals, Circuits and Systems (SCS).

[24]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[25]  Tat-Jun Chin,et al.  Incremental kernel SVD for face recognition with image sets , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).