Learn structured analysis discriminative dictionary for multi-label classification

Multi-label learning is a machine learning classification problem, in which an example belongs to more than one classes at the same time. Recently, multi-label learning has aroused a great deal of attention, and has achieved great success in the fields of text and image classification. In this paper, we propose a new method for multi-label learning, which is named as analysis discriminative dictionary learning for multi-label classification (ADML). We first incorporate analytical discrimination dictionary learning and sparse representation into multi-label classifier to obtain a unified model. The incoherence promoting term and reconstruction error for each label are minimized to obtain the dictionary. We then incorporate an analysis inconsistency promotion term into the model, which minimizes the reconstruction error of the dictionary with the corresponding label of the data. Further, we calculate a linear classifier by taking the label relationships into account. It is worth noting that we implicitly consider the label relationships in the analysis dictionary and linear classifier. Finally, we conduct experiments on 15 datasets to test the performance of the proposed ADML method and baselines. The results show that the proposed ADML method can deliver higher performance than previous multi-label methods.

[1]  Ning Xu,et al.  Compact Learning for Multi-Label Classification , 2020, Pattern Recognit..

[2]  Tao Xiang,et al.  Deep Ranking for Image Zero-Shot Multi-Label Classification , 2020, IEEE Transactions on Image Processing.

[3]  Shuicheng Yan,et al.  Jointly Learning Structured Analysis Discriminative Dictionary and Analysis Multiclass Classifier , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Jianping Gou,et al.  Robust discriminative nonnegative dictionary learning for occluded face recognition , 2017, Pattern Recognit. Lett..

[5]  Hamido Fujita,et al.  Inverse projection group sparse representation for tumor classification: A low rank variation dictionary approach , 2020, Knowl. Based Syst..

[6]  Eyke Hüllermeier,et al.  Combining instance-based learning and logistic regression for multilabel classification , 2009, Machine Learning.

[7]  Weixin Luo,et al.  Discriminative analysis-synthesis dictionary learning for image classification , 2017, Neurocomputing.

[8]  Jian Dong,et al.  A supervised dictionary learning and discriminative weighting model for action recognition , 2015, Neurocomputing.

[9]  Guoqiang Wu,et al.  A unified framework implementing linear binary relevance for multi-label learning , 2018, Neurocomputing.

[10]  Guan Gui,et al.  Improved Cross-Label Suppression Dictionary Learning for Face Recognition , 2018, IEEE Access.

[11]  Chin-Ling Chen,et al.  Label Specific Features-Based Classifier Chains for Multi-Label Classification , 2020, IEEE Access.

[12]  Helyane Bronoski Borges,et al.  An Adaptation of the ML-kNN Algorithm to Predict the Number of Classes in Hierarchical Multi-label Classification , 2017, MDAI.

[13]  Xiaoying Wang,et al.  Semi-supervised dual low-rank feature mapping for multi-label image annotation , 2018, Multimedia Tools and Applications.

[14]  Dae-Won Kim,et al.  Memetic feature selection for multilabel text categorization using label frequency difference , 2019, Inf. Sci..

[15]  HüllermeierEyke,et al.  Combining instance-based learning and logistic regression for multilabel classification , 2009 .

[16]  Xili Wang,et al.  Joint local constraint and fisher discrimination based dictionary learning for image classification , 2020, Neurocomputing.

[17]  Mohammad Rahmati,et al.  Entropy based dictionary learning for image classification , 2021, Pattern Recognit..

[18]  Grigorios Tsoumakas,et al.  Random k -Labelsets: An Ensemble Method for Multilabel Classification , 2007, ECML.

[19]  Xinping Guan,et al.  SVMs multi-class loss feedback based discriminative dictionary learning for image classification , 2020, Pattern Recognit..

[20]  Kathrin Klamroth,et al.  Biconvex sets and optimization with biconvex functions: a survey and extensions , 2007, Math. Methods Oper. Res..

[21]  Jian Yang,et al.  Robust, discriminative and comprehensive dictionary learning for face recognition , 2018, Pattern Recognit..

[22]  Fan Zhang,et al.  Structured discriminant analysis dictionary learning for pattern classification , 2021, Knowl. Based Syst..

[23]  Dae-Won Kim,et al.  Compact feature subset-based multi-label music categorization for mobile devices , 2019, Multimedia Tools and Applications.

[24]  Bassam Al-Salemi,et al.  Feature ranking for enhancing boosting-based multi-label text categorization , 2018, Expert Syst. Appl..

[25]  Francisco Javier García Castellano,et al.  Using Credal-C4.5 with Binary Relevance for Multi-Label Classification , 2018, J. Intell. Fuzzy Syst..

[26]  Jun Guo,et al.  Synthesis K-SVD based analysis dictionary learning for pattern classification , 2018, Multimedia Tools and Applications.

[27]  Yingjie Tian,et al.  Joint Ranking SVM and Binary Relevance with Robust Low-Rank Learning for Multi-Label Classification , 2019, Neural Networks.

[28]  Han Cao,et al.  Discriminative Dictionary Learning Based on Sample Diversity for Face Recognition , 2018, PCM.

[29]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[30]  Hsuan-Tien Lin,et al.  Progressive random k-labelsets for cost-sensitive multi-label classification , 2017, Machine Learning.

[31]  Yong Xu,et al.  Multi-resolution dictionary learning for face recognition , 2019, Pattern Recognit..

[32]  Grigorios Tsoumakas,et al.  Multi-label classification of music by emotion , 2011 .

[33]  Ziwei Cheng,et al.  Joint label-specific features and label correlation for multi-label learning with missing label , 2020, Applied Intelligence.

[34]  Pawel Teisseyre,et al.  Classifier chains for positive unlabelled multi-label learning , 2021, Knowl. Based Syst..

[35]  Xuelong Li,et al.  Joint Embedding Learning and Sparse Regression: A Framework for Unsupervised Feature Selection , 2014, IEEE Transactions on Cybernetics.

[36]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[37]  Eyke Hüllermeier,et al.  Combining Instance-Based Learning and Logistic Regression for Multilabel Classification , 2009, ECML/PKDD.

[38]  Guangming Shi,et al.  Exploiting class-wise coding coefficients: Learning a discriminative dictionary for pattern classification , 2018, Neurocomputing.

[39]  Hongbin Dong,et al.  A many-objective feature selection for multi-label classification , 2020, Knowl. Based Syst..

[40]  Jiangtao Ren,et al.  Multi-label text classification with latent word-wise label information , 2020, Applied Intelligence.

[41]  Zhi-Hua Zhou,et al.  ML-KNN: A lazy learning approach to multi-label learning , 2007, Pattern Recognit..

[42]  Bianca Zadrozny,et al.  A lazy feature selection method for multi-label classification , 2021, Intell. Data Anal..

[43]  Chenping Hou,et al.  Co-learning binary classifiers for LP-based multi-label classification , 2018, Cognitive Systems Research.

[44]  Yongsheng Gao,et al.  Low-rank double dictionary learning from corrupted data for robust image classification , 2017, Pattern Recognit..

[45]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[46]  David Zhang,et al.  Multi-Label Dictionary Learning for Image Annotation , 2016, IEEE Transactions on Image Processing.

[47]  Cong Jin,et al.  Multi-label automatic image annotation approach based on multiple improvement strategies , 2019, IET Image Process..

[48]  Tommy W S Chow,et al.  Multilabel Classification With Label-Specific Features and Classifiers: A Coarse- and Fine-Tuned Framework , 2019, IEEE Transactions on Cybernetics.

[49]  Praful Agrawal,et al.  An Optimal, Generative Model for Estimating Multi-Label Probabilistic Maps , 2020, IEEE Transactions on Medical Imaging.

[50]  Michael K. Ng,et al.  Transductive Multilabel Learning via Label Set Propagation , 2013, IEEE Transactions on Knowledge and Data Engineering.

[51]  Wei Zhou,et al.  Beyond Statistical Relations: Integrating Knowledge Relations into Style Correlations for Multi-Label Music Style Classification , 2020, WSDM.

[52]  Jian Yang,et al.  Fisher discrimination dictionary pair learning for image classification , 2017, Neurocomputing.

[53]  Ronen Feldman,et al.  The Data Mining and Knowledge Discovery Handbook , 2005 .

[54]  Geoff Holmes,et al.  Classifier chains for multi-label classification , 2009, Machine Learning.