Learning TWSVM using Privilege Information

Expert’s knowledge can be used to improve classification performance of the algorithm or to reduce the requirement of data for training the algorithm. However, in the field of machine learning, the knowledge offered by the expert is rarely used. Recently, Qi et al. [1] proposed a fast learning model for TWSVM using privilege information termed as FTWSVMPI where privilege information is acquired by Oracle function. Oracle function needs to solve two additional TWSVM based Quadratic Programming Problems (QPPs) which leads to higher computational cost. Therefore, to avoid to solve two additional TWSVM based QPPs, in this paper, we propose a novel method to extract privilege information from the dataset itself. Using this privilege information, we further introduce an improved version of Twin Support Vector Machine termed as I-TWSVMPI. The proposed I-TWSVMPI incorporates privilege information using correcting function so as to obtain two nonparallel hyperplanes. We also perform experiments for pedestrian detection as an application to proposed I-TWSVMPI. The experimental results on several benchmark UCI datasets and pedestrian detection prove the efficacy of our proposed formulation to that of other state-of-the-art classification algorithms with comparatively lesser computational time.

[1]  Olvi L. Mangasarian,et al.  Multisurface proximal support vector machine classification via generalized eigenvalues , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Yong Shi,et al.  A new classification model using privileged information and its application , 2014, Neurocomputing.

[3]  齐志泉,et al.  Pedestrian detection based on the privileged information , 2016 .

[4]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Pietro Perona,et al.  Pedestrian detection: A benchmark , 2009, CVPR.

[6]  Vladimir Vapnik,et al.  A new learning paradigm: Learning using privileged information , 2009, Neural Networks.

[7]  Bernt Schiele,et al.  Learning using privileged information: SV M+ and weighted SVM , 2013, Neural Networks.

[8]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[9]  B. Schiele,et al.  How Far are We from Solving Pedestrian Detection? , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Lindsay I. Smith,et al.  A tutorial on Principal Components Analysis , 2002 .

[13]  H. Abdi,et al.  Principal component analysis , 2010 .

[14]  R. Vidal,et al.  Histograms of oriented optical flow and Binet-Cauchy kernels on nonlinear dynamical systems for the recognition of human actions , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.