KM ^3 SVM: A Efficient Min-Max Modular Support Vector Machine Based on Clustering

In recent years, more and more scholars have begun to study the problem of multi-label learning. In this paper, we propose a multi-label learning method called KM\(^{3}\)SVM based on Clustering idea. First, for each label, KM\(^{3}\)SVM method selects positive samples and negative samples, then uses clustering method to gain a number of training subsets. By using these relatively smaller and more balanced training subsets, we can get a group of classifiers. Given an unseen sample, we can obtain a series of outputs and combine them by two simple principles. Experimental results on two datasets demonstrate the superiority of the proposed method KM\(^{3}\)SVM over several state-of-the-art multi-label learning algorithms.

[1]  Pingzeng Liu,et al.  Research on Hybrid Model of Garlic Short-term Price Forecasting based on Big Data , 2018 .

[2]  Zhi-Hua Zhou,et al.  ML-KNN: A lazy learning approach to multi-label learning , 2007, Pattern Recognit..

[3]  Masami Ito,et al.  Task decomposition and module combination based on class relations: a modular neural network for pattern classification , 1999, IEEE Trans. Neural Networks.

[4]  Rong Jin,et al.  Correlated Label Propagation with Application to Multi-label Learning , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[5]  Min-Ling Zhang,et al.  A Review on Multi-Label Learning Algorithms , 2014, IEEE Transactions on Knowledge and Data Engineering.

[6]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[7]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[8]  Yoram Singer,et al.  BoosTexter: A Boosting-based System for Text Categorization , 2000, Machine Learning.

[9]  Juxia Ma,et al.  Based on the fourier transform and the wavelet transformation of the digital image processing , 2012, 2012 International Conference on Computer Science and Information Processing (CSIP).

[10]  Robert E. Schapire,et al.  Hierarchical multi-label prediction of gene function , 2006, Bioinform..

[11]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[12]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[13]  Volker Tresp,et al.  Multi-label informed latent semantic indexing , 2005, SIGIR '05.

[14]  Baoyu Ma,et al.  New Method for Computer Identification Through Electromagnetic Radiation , 2018 .

[15]  Ken Chen,et al.  Efficient Classification of Multi-label and Imbalanced Data using Min-Max Modular Classifiers , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[16]  W. Grundy,et al.  Combining Microarray Expression Data and Phylogenetic Profiles to Learn Gene Functional Categories Using Support Vector Machines , 2000, RECOMB 2000.

[17]  Eisaku Maeda,et al.  Maximal Margin Labeling for Multi-Topic Text Categorization , 2004, NIPS.

[18]  Hai Zhao,et al.  Fast text categorization with min-max modular support vector machines , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..