A novel method for classification of matrix data using Twin Multiple Rank SMMs

Graphical abstractDisplay Omitted HighlightsIn order to classify multiple rank matrix data the novel Twin Multiple Rank Support Matrix Machine method is proposed.A new matrix kernel function is introduced.The nonlinear version of the new method is presented.Experiment results show that the presented methods are effective and efficient. It is known that most high-order tensor data are linear inseparable and all of them can be transformed into matrix data through tucker tensor decomposition and the matrices involved are always multiple rank. Hence, how to effectively and efficiently classify matrix data becomes an important research topic. However, up to now most known classifiers for matrix data are linear and a few nonlinear classifiers are only for rank-one matrices. In order to classify multiple rank matrix data, in this paper, a novel supervised classification method called Linear Twin Multiple Rank Support Matrix Machine (LTMRSMM) is developed, which is also an improvement of TSVM and an extension of MRMLSVM. For linear inseparable matrix data, a nonlinear classification method named Nonlinear Twin Multiple Rank Support Matrix Machine (NTMRSMM) is provided by means of a new matrix kernel function introduced recently by authors of the paper. Experimental results show that the presented methods are effective and competitive classification methods for multiple rank matrix data.

[1]  Jianqiang Gao,et al.  A spectral–textural kernel-based classification method of remotely sensed images , 2015, Neural Computing and Applications.

[2]  Tommy W. S. Chow,et al.  Maximum Margin Multisurface Support Tensor Machines with application to image classification and segmentation , 2012, Expert Syst. Appl..

[3]  Glenn Fung,et al.  Proximal support vector machine classifiers , 2001, KDD '01.

[4]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[5]  Jianqiang Gao,et al.  A Novel Spatial Analysis Method for Remote Sensing Image Classification , 2015, Neural Processing Letters.

[6]  Jianqiang Gao,et al.  A kernel-based block matrix decomposition approach for the classification of remotely sensed images , 2014, Appl. Math. Comput..

[7]  Anuj Karpatne,et al.  Proximal support tensor machines , 2013, Int. J. Mach. Learn. Cybern..

[8]  Xiaowei Yang,et al.  A Linear Support Higher-Order Tensor Machine for Classification , 2013, IEEE Transactions on Image Processing.

[9]  Johan A. K. Suykens,et al.  Least squares support vector machine classifiers: a large scale algorithm , 1999 .

[10]  Philip S. Yu,et al.  Incremental tensor analysis: Theory and applications , 2008, TKDD.

[11]  Xuelong Li,et al.  Bayesian Tensor Approach for 3-D Face Modeling , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Yuan-Hai Shao,et al.  Improvements on Twin Support Vector Machines , 2011, IEEE Transactions on Neural Networks.

[13]  Feiping Nie,et al.  Multiple rank multi-linear SVM for matrix data classification , 2014, Pattern Recognit..

[14]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[15]  Xiaoyun Wu,et al.  Support vector machines for text categorization , 2004 .

[16]  Ying Wang,et al.  TWin support tensor machines for MCs detection , 2009 .

[17]  Lizhong Xu,et al.  An efficient method to solve the classification problem for remote sensing image , 2015 .

[18]  Xuelong Li,et al.  Supervised Tensor Learning , 2005, ICDM.

[19]  Xuelong Li,et al.  General Tensor Discriminant Analysis and Gabor Features for Gait Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[21]  Ming Li,et al.  2D-LDA: A statistical linear discriminant analysis for image matrix , 2005, Pattern Recognit. Lett..

[22]  Daoqiang Zhang,et al.  Pattern Representation in Feature Extraction and Classifier Design: Matrix Versus Vector , 2008, IEEE Transactions on Neural Networks.

[23]  Irene Kotsia,et al.  Support tucker machines , 2011, CVPR 2011.

[24]  Jianqiang Gao,et al.  A novel information transferring approach for the classification of remote sensing images , 2015, EURASIP J. Adv. Signal Process..

[25]  Xuelong Li,et al.  Tensor Rank One Discriminant Analysis - A convergent method for discriminative multilinear subspace selection , 2008, Neurocomputing.

[26]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[27]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Madan Gopal,et al.  Least squares twin support vector machines for pattern classification , 2009, Expert Syst. Appl..

[29]  Haitao Xu,et al.  Projection twin SMMs for 2d image data classification , 2014, Neural Computing and Applications.