An Approach to Incremental SVM Learning Algorithm

Support vector machine (SVM) is an algorithm based on structure risk minimizing principle and has high generalization ability, but sometimes we prefer to incremental learning algorithms to handle very vast data for training SVM is very costly in time and memory consumption or because the data available are obtained at different intervals. SVM works well for incremental learning model with impressive performance for its outstanding power to summarize the data space in a concise way. This paper proposes an intercross iterative approach for training SVM to incremental learning taking the possible impact of new training data to history data each other into account. The objective is to maintain an updated representation of training dataset and new incremental dataset, and use respective hyperplane to classify each other crossed to find more possible support vectors. The experiment results show that this approach has more satisfying accuracy in classification precision.

[1]  Joel Ratsaby,et al.  Incremental Learning With Sample Queries , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Manuela M. Veloso,et al.  Learning strategy knowledge incrementally , 1994, Proceedings Sixth International Conference on Tools with Artificial Intelligence. TAI 94.

[3]  Yuh-Jye Lee,et al.  SSVM: A Smooth Support Vector Machine for Classification , 2001, Comput. Optim. Appl..

[4]  Rong Xiao,et al.  An approach to incremental SVM learning algorithm , 2000, Proceedings 12th IEEE Internationals Conference on Tools with Artificial Intelligence. ICTAI 2000.

[5]  Yuh-Jye Lee,et al.  RSVM: Reduced Support Vector Machines , 2001, SDM.

[6]  Naohiro Ishii,et al.  Incremental learning methods with retrieving of interfered patterns , 1999, IEEE Trans. Neural Networks.

[7]  A. Kuh,et al.  A smart algorithm for incremental learning , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[8]  Zeng Wen-hua A Novel Approach to Incremental SVM Learning Algorithm , 2002 .

[9]  Stefan Rüping,et al.  Incremental Learning with Support Vector Machines , 2001, ICDM.

[10]  David R. Musicant,et al.  Lagrangian Support Vector Machines , 2001, J. Mach. Learn. Res..

[11]  An Jin A Fast Iteration Algorithm Suitable for Incremental Learning for Training Support Vector Machine , 2003 .

[12]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[13]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[14]  Foster J. Provost,et al.  A Survey of Methods for Scaling Up Inductive Algorithms , 1999, Data Mining and Knowledge Discovery.