Support Vector Machines with Huffman Tree Architecture for Multiclass Classification

This paper proposes a novel multiclass support vector machine with Huffman tree architecture to quicken decision-making speed in pattern recognition. Huffman tree is an optimal binary tree, so the introduced architecture can minimize the number of support vector machines for binary decisions. Performances of the introduced approach are compared with those of the existing 6 multiclass classification methods using U.S. Postal Service Database and an application example of radar emitter signal recognition. The 6 methods includes one-against-one, one-against-all, bottom-up binary tree, two types of binary trees and directed acyclic graph. Experimental results show that the proposed approach is superior to the 6 methods in recognition speed greatly instead of decreasing classification performance.

[1]  David J. Slate,et al.  Letter Recognition Using Holland-Style Adaptive Classifiers , 1991, Machine Learning.

[2]  Mihai Mitrea,et al.  Two frequency-rank law for letters printed in Romanian , 2000 .

[3]  Gao Daqi,et al.  Adaptive task decomposition and modular multilayer perceptrons for letter recognition , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[4]  Adriana Vlad,et al.  STATISTICAL METHODS FOR VERIFYING THE NATURAL LANGUAGE STATIONARITY BASED ON THE FIRST APPROXIMATION. CASE STUDY: PRINTED ROMANIAN , 1999 .

[5]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[6]  Kristin P. Bennett,et al.  Multicategory Classification by Support Vector Machines , 1999, Comput. Optim. Appl..

[7]  Guodong Guo,et al.  Support vector machines for face recognition , 2001, Image Vis. Comput..

[8]  Nello Cristianini,et al.  Large Margin DAGs for Multiclass Classification , 1999, NIPS.

[9]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Johannes Fürnkranz,et al.  Round Robin Classification , 2002, J. Mach. Learn. Res..

[11]  Yuxi Fu,et al.  Computational and Information Science, First International Symposium, CIS 2004, Shanghai, China, December 16-18, 2004, Proceedings , 2004, CIS.

[12]  Ryan M. Rifkin,et al.  In Defense of One-Vs-All Classification , 2004, J. Mach. Learn. Res..

[13]  Yuan-Cheng Lai,et al.  Reverse Huffman tree for nonuniform traffic pattern , 1991 .

[14]  Guodong Guo,et al.  Content-based audio classification and retrieval by support vector machines , 2003, IEEE Trans. Neural Networks.

[15]  Zhang Ge-Xiang,et al.  INTRA-PULSE FEATURE ANALYSIS OF RADAR EMITTER SIGNALS , 2005 .

[16]  Gexiang Zhang,et al.  A Novel Feature Selection Approach and Its Application , 2004, CIS.

[17]  John Platt,et al.  Large Margin DAG's for Multiclass Classification , 1999 .

[18]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[19]  Mark Allen Weiss,et al.  Data structures and algorithm analysis in Ada , 1993 .