Multi-class Classification of Support Vector Machines Based on Double Binary Tree

To solve the problems of 'irreversibility', 'error accumulation' and randomicity of classification order in multi-class classification of support vector machines based on binary tree (BT-SVM), the paper proposes a multi-class classification method of support vector machines based on double binary tree (DBT-SVM). According to the method, each sub-classifier of BT-SVM is modified. After unknown samples are classified by the modified BT-SVM, the negative output of its final sub-classifier can be classified again by adding an Auxiliary BT-SVM so that the misclassified samples mixed in the negative output can be classified correctly. Experiment results show that the classification accuracy of earlier classified samples can be improved using DBT-SVM method, while the general classification accuracy does not decrease.

[1]  Daewon Lee,et al.  An improved cluster labeling method for support vector clustering , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Lipo Wang,et al.  Data Mining With Computational Intelligence , 2006, IEEE Transactions on Neural Networks.

[3]  Soo-Young Lee,et al.  Support Vector Machines with Binary Tree Architecture for Multi-Class Classification , 2004 .

[4]  S. Abe,et al.  Decision-tree-based multiclass support vector machines , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[5]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[6]  Isabelle Guyon,et al.  Comparison of classifier methods: a case study in handwritten digit recognition , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[8]  Nello Cristianini,et al.  Large Margin DAGs for Multiclass Classification , 1999, NIPS.

[9]  Lipo Wang Support vector machines : theory and applications , 2005 .

[10]  Nelson G. Durdle,et al.  A support vector machines classifier to assess the severity of idiopathic scoliosis from surface topography , 2006, IEEE Transactions on Information Technology in Biomedicine.

[11]  B. Fei,et al.  Binary tree of SVM: a new fast multiclass training and classification algorithm , 2006, IEEE Transactions on Neural Networks.