Robust Multi-Label Learning with Corrupted Features and Incomplete Labels

Weakly-supervised multi-label learning has attracted wide attention recently. Most existing methods deal with such problem with incomplete labels and the feature information is ideal. However, in many scenarios, the acquired features may be corrupted due to the influence of occlusion, illumination and low-resolution, and the robustness of learning methods may be reduced. To overcome the above shortcoming, we propose a novel weakly-supervised multi-label learning algorithm, where a linear self-recovery model is adopted to reconstruct observed label information. Specifically, we first decompose the acquired feature matrix into an ideal feature matrix and an outlier matrix. To adequately utilize the visual information among instances, we introduce the graph Laplacian regularization. In addition, a linear self-recovery model is adopted to reconstruct the observed label matrix. Finally, the desired model is trained on ideal feature matrix and refined label matrix. Extensive experimental results prove the robustness of the proposed framework.

[1]  Yong Luo,et al.  Low-Rank Multi-View Learning in Matrix Completion for Multi-Label Image Classification , 2015, AAAI.

[2]  Dacheng Tao,et al.  Robust Extreme Multi-label Learning , 2016, KDD.

[3]  Xiangliang Zhang,et al.  Multi-label Learning with Highly Incomplete Data via Collaborative Embedding , 2018, KDD.

[4]  Qinghua Hu,et al.  Latent Semantic Aware Multi-View Multi-Label Classification , 2018, AAAI.

[5]  Inderjit S. Dhillon,et al.  Large-scale Multi-label Learning with Missing Labels , 2013, ICML.

[6]  Jieping Ye,et al.  An accelerated gradient method for trace norm minimization , 2009, ICML '09.

[7]  Cordelia Schmid,et al.  TagProp: Discriminative metric learning in nearest neighbor models for image auto-annotation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[8]  Rong Jin,et al.  Multi-label learning with incomplete class assignments , 2011, CVPR 2011.

[9]  Fernando De la Torre,et al.  Robust Regression , 2016, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Inderjit S. Dhillon,et al.  Using Side Information to Reliably Learn Low-Rank Matrices from Missing and Corrupted Observations , 2018, J. Mach. Learn. Res..

[11]  Grigorios Tsoumakas,et al.  MULAN: A Java Library for Multi-Label Learning , 2011, J. Mach. Learn. Res..

[12]  Miao Xu,et al.  Speedup Matrix Completion with Side Information: Application to Multi-Label Learning , 2013, NIPS.

[13]  Xiaoying Wang,et al.  Semi-supervised dual low-rank feature mapping for multi-label image annotation , 2018, Multimedia Tools and Applications.

[14]  Dacheng Tao,et al.  Multi-View Learning With Incomplete Views , 2015, IEEE Transactions on Image Processing.

[15]  Shuicheng Yan,et al.  Image tag refinement towards low-rank, content-tag prior and error sparsity , 2010, ACM Multimedia.

[16]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[17]  Wei Liu,et al.  Multi-label Learning with Missing Labels Using Mixed Dependency Graphs , 2018, International Journal of Computer Vision.

[18]  Zili Zhang,et al.  Incomplete Multi-View Weak-Label Learning , 2018, IJCAI.

[19]  Xindong Wu,et al.  Learning Label Specific Features for Multi-label Classification , 2015, 2015 IEEE International Conference on Data Mining.

[20]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[21]  Min-Ling Zhang,et al.  A Review on Multi-Label Learning Algorithms , 2014, IEEE Transactions on Knowledge and Data Engineering.

[22]  Inderjit S. Dhillon,et al.  Matrix Completion with Noisy Side Information , 2015, NIPS.

[23]  Min-Ling Zhang,et al.  Lift: Multi-Label Learning with Label-Specific Features , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Zhi-Hua Zhou,et al.  ML-KNN: A lazy learning approach to multi-label learning , 2007, Pattern Recognit..

[25]  Ivor W. Tsang,et al.  Matrix Co-completion for Multi-label Classification with Missing Features and Labels , 2018, ArXiv.

[26]  Zhixun Su,et al.  Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation , 2011, NIPS.

[27]  Ashish Kapoor,et al.  Multilabel Classification using Bayesian Compressed Sensing , 2012, NIPS.