An incremental learning algorithm based on Support Vector Machine for pattern recognition

With the advent of information age, especially with the rapid development of network, "information explosion" problem has emerged. How to improve the classifier's training precision steadily with accumulation of the samples is the original idea of the incremental learning. Support Vector Machine (SVM) has been successfully applied in many pattern recognition fields. While its complex computation is the bottle-neck to deal with large-scale data. It's important to do researches on the SVM's incremental learning. This article proposes a SVM's incremental learning algorithm based on the filtering fixed partition of the data set. This article firstly presents "Two-class problem"s algorithm and then generalizes it to the "Multiclass problem" algorithm by the One-vs-One method. The experimental results on three types of data sets' classification show that the proposed incremental learning technique can greatly improve the efficiency of SVM learning. SVM Incremental learning can not only ensure the correct identification rate but also speedup the training process.

[1]  Wenjie Hu,et al.  Robust support vector machine with bullet hole image classification , 2002 .

[2]  Dana Ron,et al.  Algorithmic Stability and Sanity-Check Bounds for Leave-one-Out Cross-Validation , 1997, COLT.

[3]  Thorsten Joachims,et al.  Estimating the Generalization Performance of an SVM Efficiently , 2000, ICML.

[4]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[5]  Stefan Rüping,et al.  Incremental Learning with Support Vector Machines , 2001, ICDM.

[6]  Gert Cauwenberghs,et al.  Incremental and Decremental Support Vector Machine Learning , 2000, NIPS.

[7]  Nobuyuki Otsu,et al.  Feature extraction algorithm for beef marbling , 1999, 1999 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM 1999). Conference Proceedings (Cat. No.99CH36368).

[8]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[9]  Hua Li,et al.  Region feature extraction and classification , 1994, Other Conferences.

[10]  Hyung-Jin Son,et al.  Determination of the optimal batch size in incremental approaches: an application to tornado detection , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[11]  Dimitrios Gunopulos,et al.  Incremental support vector machine construction , 2001, Proceedings 2001 IEEE International Conference on Data Mining.

[12]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[13]  Joel Ratsaby,et al.  Incremental Learning With Sample Queries , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Nicolás García-Pedrajas,et al.  Improving multiclass pattern recognition by the combination of two strategies , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.