Multi-class Support Vector Machine classifiers using intrinsic and penalty graphs

In this paper, a new multi-class classification framework incorporating geometric data relationships described in both intrinsic and penalty graphs in multi-class Support Vector Machine is proposed. Direct solutions are derived for the proposed optimization problem in both the input and arbitrary-dimensional Hilbert spaces for linear and non-linear multi-class classification, respectively. In addition, it is shown that the proposed approach constitutes a general framework for SVM-based multi-class classification exploiting geometric data relationships, which includes several SVM-based classification schemes as special cases. The power of the proposed approach is demonstrated in the problem of human action recognition in unconstrained environments, as well as in facial image and standard classification problems. Experiments indicate that by exploiting geometric data relationships described in both intrinsic and penalty graphs the SVM classification performance can be enhanced. HighlightsWe propose a general class of multiclass SVM classifiers.We use generic intrinsic and penalty graphs for multiclass SVM regularization.A new direct solution of the regularized multiclass SVM problem is proposed.

[1]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[2]  Daniel D. Lee,et al.  Multiplicative Updates for Nonnegative Quadratic Programming , 2007, Neural Computation.

[3]  Anastasios Tefas,et al.  Using Support Vector Machines to Enhance the Performance of Elastic Graph Matching for Frontal Face Authentication , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Cordelia Schmid,et al.  Actions in context , 2009, CVPR.

[5]  Richard Bowden,et al.  Hollywood 3D: Recognizing Actions in 3D Natural Scenes , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Philip H. S. Torr,et al.  Feature sampling and partitioning for visual vocabulary generation on large action classification datasets , 2014, ArXiv.

[7]  Marcin Luckner Multiclass SVM Classification Using Graphs Calibrated by Similarity between Classes , 2011, KES.

[8]  Ling Guan,et al.  Covariance-guided One-Class Support Vector Machine , 2014, Pattern Recognit..

[9]  Jason Weston,et al.  Multi-Class Support Vector Machines , 1998 .

[10]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[11]  Boonserm Kijsirikul,et al.  Multiclass support vector machines using adaptive directed acyclic graph , 2002, Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290).

[12]  Anastasios Tefas,et al.  Maximum Margin Projection Subspace Learning for Visual Data Analysis , 2014, IEEE Transactions on Image Processing.

[13]  Patrick Bouthemy,et al.  Better Exploiting Motion for Better Action Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Dacheng Tao,et al.  Multi-task proximal support vector machine , 2015, Pattern Recognit..

[15]  Cordelia Schmid,et al.  Activity representation with motion hierarchies , 2013, International Journal of Computer Vision.

[16]  Alexandros Iosifidis,et al.  Class-Specific Reference Discriminant Analysis With Application in Human Behavior Analysis , 2015, IEEE Transactions on Human-Machine Systems.

[17]  Xiangyang Xue,et al.  A simplified multi-class support vector machine with reduced dual optimization , 2012, Pattern Recognit. Lett..

[18]  Tieniu Tan,et al.  Feature Coding in Image Classification: A Comprehensive Study , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  C. Schmid,et al.  Recognizing activities with cluster-trees of tracklets , 2012, BMVC.

[20]  Michael Dorr,et al.  Space-Variant Descriptor Sampling for Action Recognition Based on Saliency and Eye Movements , 2012, ECCV.

[21]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[22]  Alexandros Iosifidis,et al.  Graph Embedded Extreme Learning Machine , 2016, IEEE Transactions on Cybernetics.

[23]  Julio López,et al.  A multi-class SVM approach based on the l1-norm minimization of the distances between the reduced convex hulls , 2015, Pattern Recognit..

[24]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[25]  Yann Guermeur,et al.  MSVMpack: A Multi-Class Support Vector Machine Package , 2011, J. Mach. Learn. Res..

[26]  Liwei Wang,et al.  Smoothness, Disagreement Coefficient, and the Label Complexity of Agnostic Active Learning , 2011, J. Mach. Learn. Res..

[27]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[28]  Richard Bowden,et al.  Natural Action Recognition Using Invariant 3D Motion Encoding , 2014, ECCV.

[29]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[30]  Alexandros Iosifidis,et al.  Human action recognition in stereoscopic videos based on bag of features and disparity pyramids , 2014, 2014 22nd European Signal Processing Conference (EUSIPCO).

[31]  Francisco Herrera,et al.  An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes , 2011, Pattern Recognit..

[32]  Richard Bowden,et al.  Hollywood 3 D : Recognizing Actions in 3 D Natural Scenes , 2013 .

[33]  YanShuicheng,et al.  Graph Embedding and Extensions , 2007 .

[34]  Anastasios Tefas,et al.  Exploiting graph embedding in support vector machines , 2012, 2012 IEEE International Workshop on Machine Learning for Signal Processing.

[35]  Ioannis Pitas,et al.  Facial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector Machines , 2007, IEEE Transactions on Image Processing.

[36]  Cordelia Schmid,et al.  Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[37]  HerreraFrancisco,et al.  An overview of ensemble methods for binary classifiers in multi-class problems , 2011 .

[38]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[39]  Jianwu Dang,et al.  Improved support vector machine algorithm for heterogeneous data , 2015, Pattern Recognit..

[40]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[41]  Anastasios Tefas,et al.  Using robust dispersion estimation in support vector machines , 2013, Pattern Recognit..

[42]  Cordelia Schmid,et al.  Action Recognition with Improved Trajectories , 2013, 2013 IEEE International Conference on Computer Vision.

[43]  Cordelia Schmid,et al.  Action and Event Recognition with Fisher Vectors on a Compact Feature Set , 2013, 2013 IEEE International Conference on Computer Vision.

[44]  Cheng-Lin Liu,et al.  Error-correcting output codes based ensemble feature extraction , 2013, Pattern Recognit..

[45]  Mohamed Cheriet,et al.  Adaptive Error-Correcting Output Codes , 2013, IJCAI.

[46]  Ekta Vats,et al.  Fuzzy human motion analysis: A review , 2014, Pattern Recognit..

[47]  Chong-Wah Ngo,et al.  Trajectory-Based Modeling of Human Actions with Motion Reference Points , 2012, ECCV.

[48]  Ioannis Pitas,et al.  Novel Multiclass Classifiers Based on the Minimization of the Within-Class Variance , 2009, IEEE Transactions on Neural Networks.

[49]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  ZhangJ.,et al.  Local Features and Kernels for Classification of Texture and Object Categories , 2007 .

[51]  Alexandros Iosifidis,et al.  Discriminant Bag of Words based representation for human action recognition , 2014, Pattern Recognit. Lett..

[52]  Cordelia Schmid,et al.  Learning realistic human actions from movies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[53]  Shuang Gao,et al.  A locality correlation preserving support vector machine , 2014, Pattern Recognit..

[54]  Anastasios Tefas,et al.  Minimum Class Variance Support Vector Machines , 2007, IEEE Transactions on Image Processing.

[55]  Lin Sun,et al.  DL-SFA: Deeply-Learned Slow Feature Analysis for Action Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[56]  Juan Carlos Niebles,et al.  Modeling Temporal Structure of Decomposable Motion Segments for Activity Classification , 2010, ECCV.

[57]  Anastasios Tefas,et al.  Exploiting subclass information in Support Vector Machines , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[58]  Alexandros Iosifidis,et al.  Multi-view Regularized Extreme Learning Machine for Human Action Recognition , 2014, SETN.