Weakly-supervised multi-label learning with noisy features and incomplete labels

Abstract Weakly-supervised multi-label learning has emerged as a hot topic more recently. Most existing methods deal with such problem by learning from the data where the label assignments are incomplete while the feature information is ideal. However, in many real applications, due to the influence of occlusion, illumination and low-resolution, the acquired features are often noisy, which may reduce the robustness of the learning model. In this paper, to overcome the above shortcoming, we propose a novel weakly-supervised multi-label learning framework called WML-LSC, where the low-rank and sparse constrain schemes are jointly incorporated to capture the desired feature information. Specifically, we first decompose the observed feature matrix into an ideal feature matrix and an outlier matrix. Considering that similar instances usually share similar visual characteristics, we constrain the ideal feature matrix to be low-rank. Meanwhile, a reasonable assumption is that the noise is sparse compared with the feature matrix, which leads outlier matrix to be sparse. In addition, a linear self-recovery model is adopted to reconstruct the incomplete label assignment matrix by exploiting label correlations. Finally, the desired model is trained on the ideal feature matrix and the refined label matrix. Extensive experimental results demonstrate that our proposed method can achieve superior and comparable performance against state-of-the-art methods.

[1]  Shuicheng Yan,et al.  Image tag refinement towards low-rank, content-tag prior and error sparsity , 2010, ACM Multimedia.

[2]  Yong Luo,et al.  Low-Rank Multi-View Learning in Matrix Completion for Multi-Label Image Classification , 2015, AAAI.

[3]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[4]  Jiayu Zhou,et al.  Multi-Task Learning based Survival Analysis for Predicting Alzheimer's Disease Progression with Multi-Source Block-wise Missing Data , 2018, SDM.

[5]  Min-Ling Zhang,et al.  Feature-Induced Labeling Information Enrichment for Multi-Label Learning , 2018, AAAI.

[6]  Inderjit S. Dhillon,et al.  Large-scale Multi-label Learning with Missing Labels , 2013, ICML.

[7]  Jieping Ye,et al.  An accelerated gradient method for trace norm minimization , 2009, ICML '09.

[8]  Min Xiao,et al.  Predictive Collaborative Filtering with Side Information , 2016, IJCAI.

[9]  Xiaoying Wang,et al.  Semi-supervised dual low-rank feature mapping for multi-label image annotation , 2018, Multimedia Tools and Applications.

[10]  Dacheng Tao,et al.  Multi-View Learning With Incomplete Views , 2015, IEEE Transactions on Image Processing.

[11]  Qiang Ji,et al.  Multi-label Learning with Missing Labels , 2014, 2014 22nd International Conference on Pattern Recognition.

[12]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[13]  Cordelia Schmid,et al.  TagProp: Discriminative metric learning in nearest neighbor models for image auto-annotation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[14]  Ning Xu,et al.  Multi-label Learning with Label Enhancement , 2017, 2018 IEEE International Conference on Data Mining (ICDM).

[15]  Min-Ling Zhang,et al.  A Review on Multi-Label Learning Algorithms , 2014, IEEE Transactions on Knowledge and Data Engineering.

[16]  Fernando De la Torre,et al.  Robust Regression , 2016, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Lei Wu,et al.  Lift: Multi-Label Learning with Label-Specific Features , 2015, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Inderjit S. Dhillon,et al.  Using Side Information to Reliably Learn Low-Rank Matrices from Missing and Corrupted Observations , 2018, J. Mach. Learn. Res..

[19]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[20]  Grigorios Tsoumakas,et al.  MULAN: A Java Library for Multi-Label Learning , 2011, J. Mach. Learn. Res..

[21]  Xiangliang Zhang,et al.  Multi-label Learning with Highly Incomplete Data via Collaborative Embedding , 2018, KDD.

[22]  Qinghua Hu,et al.  Latent Semantic Aware Multi-View Multi-Label Classification , 2018, AAAI.

[23]  Wei Liu,et al.  Multi-label Learning with Missing Labels Using Mixed Dependency Graphs , 2018, International Journal of Computer Vision.

[24]  Zili Zhang,et al.  Incomplete Multi-View Weak-Label Learning , 2018, IJCAI.

[25]  Xindong Wu,et al.  Learning Label Specific Features for Multi-label Classification , 2015, 2015 IEEE International Conference on Data Mining.

[26]  Rong Jin,et al.  Multi-label learning with incomplete class assignments , 2011, CVPR 2011.

[27]  Jieping Ye,et al.  Learning incoherent sparse and low-rank patterns from multiple tasks , 2010 .

[28]  Zili Zhang,et al.  Multi-view Weak-label Learning based on Matrix Completion , 2018, SDM.