A Novel SVM Decision Tree and its application to Face Detection

In order to speed up support vector classification, a novel algorithm by the names of SVM Decision Tree is proposed in this paper. In the decision tree, several linear SVM are constructed which can achieve the highest detection rate on the negative samples, the negative samples which can be correctly classified by the hyperplane are removed from the original samples, and train one nonlinear SVM using the rest samples. In the test step, the root of tree is used as the first classification. We apply this algorithm to face detection, experiment results show that the speed up factor is large and with no loss in generalization performance.

[1]  Lindsay I. Smith,et al.  A tutorial on Principal Components Analysis , 2002 .

[2]  Christoph F. Eick,et al.  Supervised clustering - algorithms and benefits , 2004, 16th IEEE International Conference on Tools with Artificial Intelligence.

[3]  Sam T. Roweis,et al.  EM Algorithms for PCA and SPCA , 1997, NIPS.

[4]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[5]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[6]  Nello Cristianini,et al.  Enlarging the Margins in Perceptron Decision Trees , 2000, Machine Learning.

[7]  Aidong Zhang,et al.  ClusterTree: Integration of Cluster Representation and Nearest-Neighbor Search for Large Data Sets with High Dimensions , 2003, IEEE Trans. Knowl. Data Eng..

[8]  Zhou Zhihua,et al.  Bagging-Based Selective Clusterer Ensemble , 2005 .

[9]  Christopher J. C. Burges,et al.  Simplified Support Vector Decision Rules , 1996, ICML.

[10]  Marti A. Hearst.  Trends & Controversies: Support Vector Machines , 1998, IEEE Intell. Syst..

[11]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[12]  Joshua Zhexue Huang,et al.  Extensions to the k-Means Algorithm for Clustering Large Data Sets with Categorical Values , 1998, Data Mining and Knowledge Discovery.

[13]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[14]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Larry S. Davis,et al.  Efficient Kernel Machines Using the Improved Fast Gauss Transform , 2004, NIPS.

[16]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .