Multi-label classification with Missing Labels using Label Correlation and Robust Structural Learning

Abstract A class of machine learning problem where each instance may either belong to one or more than one class simultaneously is known as Multi-label classification problem. Unlike other classification problems there exist several challenges and the important among them is learning the label correlation when labels are missing. In this paper, we present a unified learning system that addresses the aforementioned issue, and suggest a novel multi-label classifier termed as Multi-label classification with Missing Labels using Label Correlation and Robust Structural Learning (MLLCRS-ML). The propose classifier considers label-specific features along with utilizing the structural property of data and pairwise label correlation (both positive and negative label correlations) for recovering the missing labels. We have use hinge loss function which ensures less sensitivity towards outliers and the accelerated proximal gradient method (APG) to efficiently solve the underlying optimization problem. Experimental results on several benchmark data sets show that our propose approach MLLCRS-ML is as competitive as other state-of-the-art approaches.

[1]  Zhi-Hua Zhou,et al.  ML-KNN: A lazy learning approach to multi-label learning , 2007, Pattern Recognit..

[2]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[3]  Geoff Holmes,et al.  Multi-label Classification Using Ensembles of Pruned Sets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[4]  Kilian Q. Weinberger,et al.  Fast Image Tagging , 2013, ICML.

[5]  Zhi-Hua Zhou,et al.  Multilabel Neural Networks with Applications to Functional Genomics and Text Categorization , 2006, IEEE Transactions on Knowledge and Data Engineering.

[6]  Lijuan Sun,et al.  Weakly-supervised multi-label learning with noisy features and incomplete labels , 2020, Neurocomputing.

[7]  Rong Jin,et al.  Multi-label learning with incomplete class assignments , 2011, CVPR 2011.

[8]  Guoqiang Wu,et al.  Cost-sensitive multi-label learning with positive and negative label pairwise correlations , 2018, Neural Networks.

[9]  Tao Mei,et al.  Correlative multi-label video annotation , 2007, ACM Multimedia.

[10]  Robert D. Nowak,et al.  Transduction with Matrix Completion: Three Birds with One Stone , 2010, NIPS.

[11]  Qinghua Hu,et al.  Hybrid Noise-Oriented Multilabel Learning , 2020, IEEE Transactions on Cybernetics.

[12]  C. P. Prathibhamol,et al.  Multi label classification based on logistic regression (MLC-LR) , 2016, 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[13]  Grigorios Tsoumakas,et al.  Random k -Labelsets: An Ensemble Method for Multilabel Classification , 2007, ECML.

[14]  Yang Gao,et al.  Joint multi-label classification and label correlations with missing labels and feature selection , 2019, Knowl. Based Syst..

[15]  Yong Luo,et al.  Low-Rank Multi-View Learning in Matrix Completion for Multi-Label Image Classification , 2015, AAAI.

[16]  Pawel Teisseyre,et al.  Classifier chains for positive unlabelled multi-label learning , 2021, Knowl. Based Syst..

[17]  Grigorios Tsoumakas,et al.  Mining Multi-label Data , 2010, Data Mining and Knowledge Discovery Handbook.

[18]  Gordon Morison,et al.  Naive Bayes Multi-Label Classification Approach for High-Voltage Condition Monitoring , 2018, 2018 IEEE International Conference on Internet of Things and Intelligence System (IOTAIS).

[19]  Feiping Nie,et al.  SVM based multi-label learning with missing labels for image annotation , 2018, Pattern Recognit..

[20]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[21]  Baoyuan Wu,et al.  ML-MG: Multi-label Learning with Missing Labels Using a Mixed Graph , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[22]  Wei Liu,et al.  Teaching-to-Learn and Learning-to-Teach for Multi-label Propagation , 2016, AAAI.

[23]  Xuelong Li,et al.  Image Annotation by Multiple-Instance Learning With Discriminative Feature Mapping and Selection , 2014, IEEE Transactions on Cybernetics.

[24]  Eyke Hüllermeier,et al.  Multilabel classification via calibrated label ranking , 2008, Machine Learning.

[25]  Qingming Huang,et al.  Joint Feature Selection and Classification for Multilabel Learning , 2018, IEEE Transactions on Cybernetics.

[26]  Xiao Yu,et al.  Infrared Handprint Image Restoration Algorithm Based on Apoptotic Mechanism , 2020, IEEE Access.

[27]  Geoff Holmes,et al.  Classifier chains for multi-label classification , 2009, Machine Learning.

[28]  Qingming Huang,et al.  Improving multi-label classification with missing labels by learning label-specific features , 2019, Inf. Sci..

[29]  Ziwei Cheng,et al.  Joint label-specific features and label correlation for multi-label learning with missing label , 2020, Applied Intelligence.

[30]  Xindong Wu,et al.  Learning Label-Specific Features and Class-Dependent Labels for Multi-Label Classification , 2016, IEEE Transactions on Knowledge and Data Engineering.

[31]  João Paulo Papa,et al.  Multi-label semi-supervised classification through optimum-path forest , 2018, Inf. Sci..

[32]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[33]  Lei Wu,et al.  Lift: Multi-Label Learning with Label-Specific Features , 2015, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Qinghua Hu,et al.  Multi-label feature selection with missing labels , 2018, Pattern Recognit..

[35]  Alexandre Bernardino,et al.  Matrix Completion for Multi-label Image Classification , 2011, NIPS.

[36]  Amanda Clare,et al.  Knowledge Discovery in Multi-label Phenotype Data , 2001, PKDD.

[37]  Yuanping Zhu,et al.  Calibrated Rank-SVM for multi-label image categorization , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[38]  Xuelong Li,et al.  Learning Instance Correlation Functions for Multilabel Classification , 2017, IEEE Transactions on Cybernetics.

[39]  Qingming Huang,et al.  Multi-label classification by exploiting local positive and negative pairwise label correlation , 2017, Neurocomputing.

[40]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[41]  Qiang Ji,et al.  Multi-label Learning with Missing Labels , 2014, 2014 22nd International Conference on Pattern Recognition.

[42]  Guoxian Yu,et al.  Semi-supervised multi-label classification using incomplete label information , 2017, Neurocomputing.

[43]  Lei Wang,et al.  Multiple Kernel k-Means with Incomplete Kernels , 2017, AAAI.

[44]  Tommy W. S. Chow,et al.  Multi-Label Low-dimensional Embedding with Missing Labels , 2017, Knowl. Based Syst..

[45]  Zhi-Hua Zhou,et al.  Multi-Label Learning with Global and Local Label Correlation , 2017, IEEE Transactions on Knowledge and Data Engineering.

[46]  Rong Jin,et al.  Correlated Label Propagation with Application to Multi-label Learning , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[47]  Jian-Hua Xu,et al.  A multi-label classification algorithm based on triple class support vector machine , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.