Multi-view generalized support vector machine via mining the inherent relationship between views with applications to face and fire smoke recognition

Abstract Multiview Generalized Eigenvalue Proximal Support Vector Machines (MvGSVMs) is an effective multi-view classification algorithm, which effectively combines multi-view learning and classification. Then it was found that in the classification learning task, the classifier combined with multi-view learning has a better classification effect than considering only a single view. In order to utilize the multi-view learning framework more fully and accurately, we further research this. We explore the internal relationship between different views between samples to replace the method of connecting different views through distance combinations. We propose a new method named Multi-view Generalized Support Vector Machine via Mining the Inherent Relationship between Views (MRMvGSVM). At the same time, we use the L2,1-norm constraint relationship matrix as a multi-view regularization term to select the most relevant sample data from different views. It not only helps to improve the accuracy of classification but also reduces the influence of extraneous factors to a certain extent and improves the robustness of the algorithm. The effectiveness of the algorithm is proved by theory and experiments on UCI, and Face and Fire Smoke image datasets.

[1]  Gerardo Severino,et al.  On the regularization of generalized eigenvalues classifiers , 2016 .

[2]  Gao Xu,et al.  Deep Domain Adaptation Based Video Smoke Detection using Synthetic Smoke Images , 2017, ArXiv.

[3]  Ling Shao,et al.  Action Recognition Using 3D Histograms of Texture and A Multi-Class Boosting Classifier , 2017, IEEE Transactions on Image Processing.

[4]  Reshma Khemchandani,et al.  Generalized eigenvalue proximal support vector regressor for the simultaneous learning of a function and its derivatives , 2017, International Journal of Machine Learning and Cybernetics.

[5]  Yuan Yan Tang,et al.  High-Order Distance-Based Multiview Stochastic Learning in Image Classification , 2014, IEEE Transactions on Cybernetics.

[6]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[7]  Shiliang Sun,et al.  Multiview Uncorrelated Discriminant Analysis , 2016, IEEE Transactions on Cybernetics.

[8]  Yong Shi,et al.  Recent advances on support vector machines research , 2012 .

[9]  Hao Gao,et al.  A SVM Method Trained by Improved Particle Swarm Optimization for Image Classification , 2014, CCPR.

[10]  Shiguang Shan,et al.  Multi-View Discriminant Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Yuan-Hai Shao,et al.  MLTSVM: A novel twin support vector machine to multi-label learning , 2016, Pattern Recognit..

[12]  Tao Liu,et al.  Deep convolutional neural network training enrichment using multi-view object-based analysis of Unmanned Aerial systems imagery for wetlands classification , 2018 .

[13]  Akin Tanatmis,et al.  Mathematical Programming Decoding of Binary Linear Codes: Theory and Algorithms , 2011, IEEE Transactions on Information Theory.

[14]  Yuan-Hai Shao,et al.  Manifold proximal support vector machine for semi-supervised classification , 2013, Applied Intelligence.

[15]  Zhangjing Yang,et al.  Improved multi-view GEPSVM via Inter-View Difference Maximization and Intra-view Agreement Minimization , 2020, Neural Networks.

[16]  Ning Ye,et al.  Multi-weight vector projection support vector machines , 2010, Pattern Recognit. Lett..

[17]  William W. Hsieh,et al.  Machine Learning Methods in the Environmental Sciences: Neural Networks and Kernels , 2009 .

[18]  Wenjie Hu,et al.  Robust support vector machine with bullet hole image classification , 2002 .

[19]  M. H. Marghny,et al.  Differential Search Algorithm-based Parametric Optimization of Fuzzy Generalized Eigenvalue Proximal Support Vector Machine , 2014, ArXiv.

[20]  J T Guillen-Bonilla,et al.  Algorithm for training the minimum error one-class classifier of images. , 2008, Applied optics.

[21]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[22]  Lunke Fei,et al.  Robust Sparse Linear Discriminant Analysis , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  D. Donoho.  For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[24]  Xuelong Li,et al.  Block-Row Sparse Multiview Multilabel Learning for Image Classification , 2016, IEEE Transactions on Cybernetics.

[25]  Jingjing Tang,et al.  Multiview Privileged Support Vector Machines , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Shiliang Sun,et al.  Multi-view twin support vector machines , 2015, Intell. Data Anal..

[27]  Jing Liu,et al.  Robust Structured Subspace Learning for Data Representation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  John Shawe-Taylor,et al.  Two view learning: SVM-2K, Theory and Practice , 2005, NIPS.

[29]  Shiliang Sun,et al.  A survey of multi-view machine learning , 2013, Neural Computing and Applications.

[30]  Feiping Nie,et al.  Effective Discriminative Feature Selection With Nontrivial Solution , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[31]  Long Chen,et al.  Manifold Regularized Proximal Support Vector Machine via Generalized Eigenvalue , 2016, Int. J. Comput. Intell. Syst..

[32]  Shiliang Sun,et al.  Multiview Learning With Generalized Eigenvalue Proximal Support Vector Machines , 2019, IEEE Transactions on Cybernetics.

[33]  Feiping Nie,et al.  Discriminative Least Squares Regression for Multiclass Classification and Feature Selection , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[34]  LinLin Shen,et al.  A SVM Face Recognition Method Based on Optimized Gabor Features , 2007, VISUAL.

[35]  Reshma Khemchandani,et al.  Fuzzy multi-category proximal support vector classification via generalized eigenvalues , 2007, Soft Comput..

[36]  Yuan-Hai Shao,et al.  Improved Generalized Eigenvalue Proximal Support Vector Machine , 2013, IEEE Signal Processing Letters.

[37]  Trevor J. Hastie,et al.  Sparse Discriminant Analysis , 2011, Technometrics.

[38]  Nai-Yang Deng,et al.  Support Vector Machines: Optimization Based Theory, Algorithms, and Extensions , 2012 .

[39]  Olvi L. Mangasarian,et al.  Multisurface proximal support vector machine classification via generalized eigenvalues , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.