Attribute reduction for multi-label classification based on labels of positive region

In this paper, on the basis of the rough set theory, four attribute reduction algorithms are proposed for multi-label data. In order to improve the computational efficiency, the proposed algorithms utilize the lower approximations of the label information set instead of the decision class to evaluate the importance of attributes. The relationship between the proposed methods and two classical attribute reductions is analyzed and shows that the proposed methods are more applicable to multi-label classification. Experimental results reveal that the proposed algorithms can remove redundant attributes without reducing classification accuracy for most data.

[1]  Zhi-Hua Zhou,et al.  ML-KNN: A lazy learning approach to multi-label learning , 2007, Pattern Recognit..

[2]  Yuwen Li,et al.  Attribute reduction for multi-label learning with fuzzy rough set , 2018, Knowl. Based Syst..

[3]  Witold Pedrycz,et al.  Neighborhood rough sets based multi-label classification for automatic image annotation , 2013, Int. J. Approx. Reason..

[4]  Sarah Vluymans,et al.  Multi-label classification using a fuzzy rough neighborhood consensus , 2018, Inf. Sci..

[5]  Yoram Singer,et al.  BoosTexter: A Boosting-based System for Text Categorization , 2000, Machine Learning.

[6]  Hua Li,et al.  A novel attribute reduction approach for multi-label data based on rough set theory , 2016, Inf. Sci..

[7]  Xizhao Wang,et al.  Building a Rule-Based Classifier—A Fuzzy-Rough Set Approach , 2010, IEEE Transactions on Knowledge and Data Engineering.

[8]  Jerzy W. Grzymala-Busse,et al.  Rough Sets , 1995, Commun. ACM.

[9]  Duoqian Miao,et al.  A rough set approach to feature selection based on ant colony optimization , 2010, Pattern Recognit. Lett..

[10]  Zhenmin Tang,et al.  Minimum cost attribute reduction in decision-theoretic rough set models , 2013, Inf. Sci..

[11]  Grigorios Tsoumakas,et al.  Random K-labelsets for Multilabel Classification , 2022 .

[12]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[13]  Dominik Slezak,et al.  On Generalized Decision Functions: Reducts, Networks and Ensembles , 2015, RSFDGrC.

[14]  Qinghua Hu,et al.  Neighborhood rough set based heterogeneous feature subset selection , 2008, Inf. Sci..

[15]  Zhi-Hua Zhou,et al.  Multilabel Neural Networks with Applications to Functional Genomics and Text Categorization , 2006, IEEE Transactions on Knowledge and Data Engineering.

[16]  Qinghua Hu,et al.  Cost-sensitive feature selection based on adaptive neighborhood granularity with multi-level confidence , 2016, Inf. Sci..

[17]  Jie Duan,et al.  Multi-label feature selection based on neighborhood mutual information , 2016, Appl. Soft Comput..

[18]  Qinghua Hu,et al.  Neighborhood classifiers , 2008, Expert Syst. Appl..

[19]  Witold Pedrycz,et al.  Hierarchical Granular Clustering: An Emergence of Information Granules of Higher Type and Higher Order , 2015, IEEE Transactions on Fuzzy Systems.

[20]  Min-Ling Zhang,et al.  A Review on Multi-Label Learning Algorithms , 2014, IEEE Transactions on Knowledge and Data Engineering.

[21]  Z. Pawlak.  Rough Sets: Theoretical Aspects of Reasoning about Data , 1991 .

[22]  Shunxiang Wu,et al.  Online multi-label streaming feature selection based on neighborhood rough set , 2018, Pattern Recognit..

[23]  Qinghua Hu,et al.  A Fitting Model for Feature Selection With Fuzzy Rough Sets , 2017, IEEE Transactions on Fuzzy Systems.