Nonparallel support vector machine with large margin distribution for pattern classification

Abstract The large margin distribution machine (LDM) combines the working principle of support vector machine (SVM) and the margin distribution to directly improve the algorithm's generalization. The margin distribution can be expressed with the margin mean and margin variance. It has been proved to be an efficient algorithm for binary classification. Inspired by the LDM, a novel classifier termed as LMD-NPSVM is proposed to improve the generalization performance of the nonparallel support vector machine (NPSVM) in this paper. Firstly, to meet the structure of NPSVM, the large margin distribution is reconstructed. Then, the linear LMD-NPSVM is built by introducing the reconstructed margin distribution into NPSVM. In addition, the linear case is extended to the nonlinear case with a kernel trick. All experiments show that our LMD-NPSVM is superior to the state-of-the-art algorithms in generalization performance.

[1]  Yong Shi,et al.  ν-Nonparallel support vector machine for pattern classification , 2014, Neural Computing and Applications.

[2]  Bin Gu,et al.  Chunk incremental learning for cost-sensitive hinge loss support vector machine , 2018, Pattern Recognit..

[3]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[5]  Alexandros Iosifidis,et al.  Semi-supervised subclass support vector data description for image and video classification , 2018, Neurocomputing.

[6]  Xiaojun Wu,et al.  A novel projection twin support vector machine for binary classification , 2019, Soft Comput..

[7]  Nai-Yang Deng,et al.  Support Vector Machines: Optimization Based Theory, Algorithms, and Extensions , 2012 .

[8]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[9]  Olvi L. Mangasarian,et al.  Multisurface proximal support vector machine classification via generalized eigenvalues , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Bin Gu,et al.  Accelerating Sequential Minimal Optimization via Stochastic Subgradient Descent , 2019, IEEE Transactions on Cybernetics.

[11]  Hong-Jie Xing,et al.  Robust one-class support vector machine with rescaled hinge loss function , 2018, Pattern Recognit..

[12]  He Yan,et al.  Least squares twin bounded support vector machines based on L1-norm distance metric for classification , 2018, Pattern Recognit..

[13]  Yuan-Hai Shao,et al.  Sparse Lq-norm least squares support vector machine with feature selection , 2018, Pattern Recognit..

[14]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[15]  Yao Feng,et al.  A multi-class classifier based on support vector hyper-spheres for steel plate surface defects , 2019, Chemometrics and Intelligent Laboratory Systems.

[16]  Brendan McCane,et al.  Twin Bounded Large Margin Distribution Machine , 2018, Australasian Conference on Artificial Intelligence.

[17]  Hong Jiang,et al.  A Fast Asymmetric Extremum Content Defined Chunking Algorithm for Data Deduplication in Backup Storage Systems , 2017, IEEE Transactions on Computers.

[18]  Jing Zhang,et al.  Double distribution support vector machine , 2017, Pattern Recognit. Lett..

[19]  Sanjay Mehrotra,et al.  Decomposition Algorithm for Distributionally Robust Optimization using Wasserstein Metric , 2017, 1704.03920.

[20]  Zhi-Hua Zhou,et al.  Optimal Margin Distribution Machine , 2016, IEEE Transactions on Knowledge and Data Engineering.

[21]  Jing Zhang,et al.  Large cost-sensitive margin distribution machine for imbalanced data classification , 2017, Neurocomputing.

[22]  Suresh Chandra,et al.  Large-margin Distribution Machine-based regression , 2018, Neural Computing and Applications.

[23]  Zhi-Hua Zhou,et al.  Large margin distribution machine , 2013, KDD.

[24]  Leena Mary Francis,et al.  Robust scene text recognition: Using manifold regularized Twin-Support Vector Machine , 2019, J. King Saud Univ. Comput. Inf. Sci..

[25]  Qi Shaowei,et al.  Weighted Least Squares Twin Large Margin Distribution Machine , 2017, ICNCC 2017.

[26]  Pheng-Ann Heng,et al.  Sparse Support Matrix Machine , 2018, Pattern Recognit..

[27]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[28]  Yitian Xu,et al.  A safe sample screening rule for Laplacian twin parametric-margin support vector machine , 2018, Pattern Recognit..

[29]  Yuan-Hai Shao,et al.  MLTSVM: A novel twin support vector machine to multi-label learning , 2016, Pattern Recognit..

[30]  Yitian Xu,et al.  Maximum Margin of Twin Spheres Support Vector Machine for Imbalanced Data Classification , 2017, IEEE Transactions on Cybernetics.

[31]  Shigeo Abe,et al.  Unconstrained large margin distribution machines , 2017, Pattern Recognit. Lett..