A Fast Training Algorithm for Least Squares SVM

A fast training algorithm for Least Squares SVM (LS-SVM) classifiers was proposed, which is based on incremental and decremental learning theory. When a SV (Support Vector) is added or removed, computation based on previous training result replaces large-scale matrix inverse, thus the computation cost is reduced. The innovation is that by reasonable use of incremental and decremental learning the proposed algorithm can adaptively adjust the size of training sets (number of SVs) according to the specific classification problem. Finally several experiments show the validity of proposed algorithm.

[1]  JianghuaLiu,et al.  Online LS-SVM for function estimation and classification , 2003 .

[2]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[3]  Gert Cauwenberghs,et al.  Incremental and Decremental Support Vector Machine Learning , 2000, NIPS.

[4]  Theo J. A. de Vries,et al.  Pruning error minimization in least squares support vector machines , 2003, IEEE Trans. Neural Networks.

[5]  A. A. Rodríguez,et al.  Support Vector Method for Robust ARMA System Identification , 2009 .

[6]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[7]  José Luis Rojo-Álvarez,et al.  Support vector method for robust ARMA system identification , 2004, IEEE Transactions on Signal Processing.

[8]  Luc Van Gool,et al.  SVM-based nonparametric discriminant analysis, an application to face detection , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  Giles M. Foody,et al.  A relative evaluation of multiclass image classification by support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.