Joint label completion and label-specific features for multi-label learning algorithm

Label correlations have always been one of the hotspots of multi-label learning. Using label correlations to complete the original label can enrich the information of the label matrix. At the same time, label-specific features give a thought that different labels have inherent characteristics that can be distinguished, and we can use label correlations to enhance the learning process of label-specific features among similar labels. At present, most of the algorithms combine label correlations and label-specific features to improve the multi-label learning effect, but do not consider the impact of label marking errors or defaults in data sets. In fact, the label completion method can further enrich the information of label matrix, and then the joint learning framework of joint label-specific features can effectively improve the robustness of the multi-label learning algorithm. Based on this, this paper proposes a multi-label learning algorithm for joint label completion and label-specific features, and constructs a new multi-label learning algorithm framework by means of joint label completion and label-specific features. Completion matrix and label-specific features are obtained by alternating iteration method, and the label matrix updating the optimization framework fully considers the label correlations. The algorithm in this paper has been demonstrated and trained on several benchmark multi-label data sets by extensive experiments, which verifies the effectiveness of the algorithm.

[1]  Zhi-Hua Zhou,et al.  ML-KNN: A lazy learning approach to multi-label learning , 2007, Pattern Recognit..

[2]  Lei Wu,et al.  Lift: Multi-Label Learning with Label-Specific Features , 2015, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Fulei Chu,et al.  Deep convolutional neural network based planet bearing fault classification , 2019, Comput. Ind..

[4]  Guandong Xu,et al.  Leveraging Supervised Label Dependency Propagation for Multi-label Learning , 2013, 2013 IEEE 13th International Conference on Data Mining.

[5]  Qingming Huang,et al.  Improving multi-label classification with missing labels by learning label-specific features , 2019, Inf. Sci..

[6]  Zhi-Hua Zhou,et al.  Multi-Label Learning with Global and Local Label Correlation , 2017, IEEE Transactions on Knowledge and Data Engineering.

[7]  Xindong Wu,et al.  Learning Label Specific Features for Multi-label Classification , 2015, 2015 IEEE International Conference on Data Mining.

[8]  Xiaogang Yang,et al.  Multi-Label Learning With Label Specific Features Using Correlation Information , 2019, IEEE Access.

[9]  Miao Xu,et al.  Speedup Matrix Completion with Side Information: Application to Multi-Label Learning , 2013, NIPS.

[10]  Brendt Wohlberg,et al.  Incremental Principal Component Pursuit for Video Background Modeling , 2015, Journal of Mathematical Imaging and Vision.

[11]  Xindong Wu,et al.  Learning Label-Specific Features and Class-Dependent Labels for Multi-Label Classification , 2016, IEEE Transactions on Knowledge and Data Engineering.

[12]  Alan Wee-Chung Liew,et al.  Multi-label classification via label correlation and first order feature dependance in a data stream , 2019, Pattern Recognit..

[13]  Baoyuan Wu,et al.  ML-MG: Multi-label Learning with Missing Labels Using a Mixed Graph , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[14]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[15]  Qingming Huang,et al.  Joint Feature Selection and Classification for Multilabel Learning , 2018, IEEE Transactions on Cybernetics.

[16]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[17]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[18]  Yang Gao,et al.  Joint multi-label classification and label correlations with missing labels and feature selection , 2019, Knowl. Based Syst..

[19]  Zhao Dawei,et al.  Multi-label learning of non-equilibrium labels completion with mean shift , 2018, Neurocomputing.

[20]  Opim Salim Sitompul,et al.  Biased support vector machine and weighted-smote in handling class imbalance problem , 2018 .

[21]  Zenglin Xu,et al.  Manifold regularized matrix completion for multi-label learning with ADMM , 2018, Neural Networks.

[22]  Zhen Wang,et al.  Learning Low-Rank Label Correlations for Multi-label Classification with Missing Labels , 2014, 2014 IEEE International Conference on Data Mining.

[23]  Yong Yu,et al.  Robust Subspace Segmentation by Low-Rank Representation , 2010, ICML.

[24]  Jason Weston,et al.  A kernel method for multi-labelled classification , 2001, NIPS.

[25]  Jia Zhang,et al.  Multi-label learning with label-specific features by resolving label correlations , 2018, Knowl. Based Syst..

[26]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[27]  Jianhua Ma,et al.  LCC: Towards efficient label completion and correction for supervised medical image learning in smart diagnosis , 2019, J. Netw. Comput. Appl..

[28]  R. Saidur,et al.  Application of support vector machine models for forecasting solar and wind energy resources: A review , 2018, Journal of Cleaner Production.

[29]  Zhi-Hua Zhou,et al.  Learning From Semi-Supervised Weak-Label Data , 2018, AAAI.

[30]  Jing-Yu Yang,et al.  Multi-label learning with label-specific feature reduction , 2016, Knowl. Based Syst..