Partial Multi-Label Learning via Credible Label Elicitation

In partial multi-label learning (PML), each training example is associated with multiple candidate labels which are only partially valid. The task of PML naturally arises in learning scenarios with inaccurate supervision, and the goal is to induce a multi-label predictor which can assign a set of proper labels for unseen instance. To learn from PML training examples, the training procedure is prone to be misled by the false positive labels concealed in candidate label set. In light of this major difficulty, a novel two-stage PML approach is proposed which works by eliciting credible labels from the candidate label set for model induction. In this way, most false positive labels are expected to be excluded from the training procedure. Specifically, in the first stage, the labeling confidence of candidate label for each PML training example is estimated via iterative label propagation. In the second stage, by utilizing credible labels with high labeling confidence, multi-label predictor is induced via pairwise label ranking with virtual label splitting or maximum a posteriori (MAP) reasoning. Extensive experiments on synthetic as well as real-world data sets clearly validate the effectiveness of credible label elicitation in learning from PML examples.

[1]  Thomas G. Dietterich,et al.  A Conditional Multinomial Mixture Model for Superset Label Learning , 2012, NIPS.

[2]  Ben Taskar,et al.  Learning from Partial Labels , 2011, J. Mach. Learn. Res..

[3]  Zhi-Hua Zhou,et al.  Multi-Label Learning with Weak Label , 2010, AAAI.

[4]  Zhi-Hua Zhou,et al.  Multi-label Learning , 2017, Encyclopedia of Machine Learning and Data Mining.

[5]  Geoff Holmes,et al.  Classifier chains for multi-label classification , 2009, Machine Learning.

[6]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[7]  Grigorios Tsoumakas,et al.  Random K-labelsets for Multilabel Classification , 2022 .

[8]  Zhi-Hua Zhou,et al.  A brief introduction to weakly supervised learning , 2018 .

[9]  Mark J. Huiskes,et al.  The MIR flickr retrieval evaluation , 2008, MIR '08.

[10]  Fei Yu,et al.  Maximum margin partial label learning , 2017, Machine Learning.

[11]  Sheng-Jun Huang,et al.  Partial Multi-Label Learning , 2018, AAAI.

[12]  Jian Yang,et al.  A Regularization Approach for Instance-Based Superset Label Learning , 2018, IEEE Transactions on Cybernetics.

[13]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[14]  Yale Song,et al.  Improving Pairwise Ranking for Multi-label Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Eyke Hüllermeier,et al.  Multilabel classification via calibrated label ranking , 2008, Machine Learning.

[16]  Wei Gao,et al.  Learning safe multi-label prediction for weakly labeled data , 2017, Machine Learning.

[17]  Sebastián Ventura,et al.  A Tutorial on Multilabel Learning , 2015, ACM Comput. Surv..

[18]  Rama Chellappa,et al.  Learning from Ambiguously Labeled Face Images , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Xin Geng,et al.  Binary relevance for multi-label learning: an overview , 2018, Frontiers of Computer Science.

[20]  Min-Ling Zhang,et al.  Lift: Multi-Label Learning with Label-Specific Features , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Jun Wang,et al.  Feature-Induced Partial Multi-label Learning , 2018, 2018 IEEE International Conference on Data Mining (ICDM).

[22]  Rama Chellappa,et al.  Ambiguously Labeled Learning Using Dictionaries , 2014, IEEE Transactions on Information Forensics and Security.

[23]  Xuan Wu,et al.  Towards Enabling Binary Decomposition for Partial Label Learning , 2018, IJCAI.

[24]  Min-Ling Zhang,et al.  Disambiguation-Free Partial Label Learning , 2017, IEEE Transactions on Knowledge and Data Engineering.

[25]  Zhi-Hua Zhou,et al.  ML-KNN: A lazy learning approach to multi-label learning , 2007, Pattern Recognit..

[26]  Stefan Kramer,et al.  Online multi-label dependency topic models for text classification , 2018, Machine Learning.

[27]  Zili Zhang,et al.  Multi-view Weak-label Learning based on Matrix Completion , 2018, SDM.