Revised online learning with kernels for classification and regression

Revised algorithm for online learning with kernels (OLK) in classification and regression is proposed in a reproducing kernel hilbert space (RKHS). Compared with the original OLK, the revised algorithm allows that the new data points arrive either one by one or two by two.

[1]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[2]  Li Cheng,et al.  Online Identification of Nonlinear Spatiotemporal Systems Using Kernel Learning Approach , 2011, IEEE Transactions on Neural Networks.

[3]  Yan Chen,et al.  Error tolerance based support vector machine for regression , 2011, Neurocomputing.

[4]  Daoqiang Zhang,et al.  Semisupervised Kernel Matrix Learning by Kernel Propagation , 2010, IEEE Transactions on Neural Networks.

[5]  Guoqi Li,et al.  Identification of Wiener Systems With Clipped Observations , 2012, IEEE Trans. Signal Process..

[6]  James A. Bucklew,et al.  Support vector machine techniques for nonlinear equalization , 2000, IEEE Trans. Signal Process..

[7]  Zhengguo Li,et al.  Model-Based Online Learning With Kernels , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Barbara Caputo,et al.  Bounded Kernel-Based Online Learning , 2009, J. Mach. Learn. Res..

[9]  Yoram Singer,et al.  The Forgetron: A Kernel-Based Perceptron on a Budget , 2008, SIAM J. Comput..

[10]  Alexander J. Smola,et al.  Online learning with kernels , 2001, IEEE Transactions on Signal Processing.

[11]  Wei Xing Zheng,et al.  Identification of a Class of Nonlinear Autoregressive Models With Exogenous Inputs Based on Kernel Machines , 2011, IEEE Transactions on Signal Processing.

[12]  Yoav Freund,et al.  Large Margin Classification Using the Perceptron Algorithm , 1998, COLT' 98.

[13]  Hidemitsu Ogawa,et al.  RKHS-based functional analysis for exact incremental learning , 1999, Neurocomputing.

[14]  Gaël Richard,et al.  Multiclass Feature Selection With Kernel Gram-Matrix-Based Criteria , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Shie Mannor,et al.  The kernel recursive least-squares algorithm , 2004, IEEE Transactions on Signal Processing.

[16]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[17]  Hongwei Sun,et al.  Mercer theorem for RKHS on noncompact sets , 2005, J. Complex..

[18]  FreundYoav,et al.  Large Margin Classification Using the Perceptron Algorithm , 1999 .