Feature Selection for Multi-Label Learning Based on F-Neighborhood Rough Sets

Multi-label learning is often applied to handle complex decision tasks, and feature selection is its essential part. The relation of labels is always ignored or not enough to consider for both multi-label learning and its feature selection. To deal with the problem, F-neighborhood rough sets are employed. Different from other methods, the original approximate space is not changed, but the relation of labels is sufficient to consider. To be specific, a multi-label decision system is discomposed into a family of single-label decision tables with the label set(first-order strategy) at first. Secondly, calculate attribute significance in the family of single-label decision tables. Third, construct an attribute significance matrix and improved attribute significance matrices to evaluate the quality of the features, then a parallel reduct is obtained with information fusion. These processes construct F-neighborhood parallel reduction algorithm for a multi-label decision system(FNPRMS). Compared with the state-of-the-arts, experimental results show that FNPRMS is effective and efficient on 9 publicly available data sets.

[1]  Miao Xu,et al.  Multi-Label Learning with PRO Loss , 2013, AAAI.

[2]  Qian Yuhua,et al.  Feature Selection for Multi-Label Classification Based on Neighborhood Rough Sets , 2015 .

[3]  Ming-Wen Shao,et al.  Attribute reduction based on k-nearest neighborhood rough sets , 2019, Int. J. Approx. Reason..

[4]  Jianhua Dai,et al.  Attribute selection based on information gain ratio in fuzzy rough set theory with application to tumor classification , 2013, Appl. Soft Comput..

[5]  Andrzej Skowron,et al.  Rudiments of rough sets , 2007, Inf. Sci..

[6]  Lily Chamakura,et al.  An instance voting approach to feature selection , 2019, Inf. Sci..

[7]  Jia Zhang,et al.  Mutual information based multi-label feature selection via constrained convex optimization , 2019, Neurocomputing.

[8]  Qinghua Hu,et al.  Mixed feature selection based on granulation and approximation , 2008, Knowl. Based Syst..

[9]  Newton Spolaôr,et al.  ReliefF for Multi-label Feature Selection , 2013, 2013 Brazilian Conference on Intelligent Systems.

[10]  Simon C. K. Shiu,et al.  Unsupervised feature selection by regularized self-representation , 2015, Pattern Recognit..

[11]  Xinye Cai,et al.  Neighborhood based decision-theoretic rough set models , 2016, Int. J. Approx. Reason..

[12]  Qinghua Hu,et al.  Multi-label feature selection with missing labels , 2018, Pattern Recognit..

[13]  Qinghua Hu,et al.  Multi-label Feature Selection with Fuzzy Rough Sets , 2014, RSKT.

[14]  Ming-Wen Shao,et al.  Feature subset selection based on fuzzy neighborhood rough sets , 2016, Knowl. Based Syst..

[15]  Theresa Beaubouef,et al.  Rough Sets , 2019, Lecture Notes in Computer Science.

[16]  Jinghua Liu,et al.  Feature selection for multi-label learning with missing labels , 2019, Applied Intelligence.

[17]  Zhi-Hua Zhou,et al.  Multilabel dimensionality reduction via dependence maximization , 2008, TKDD.

[18]  Ping Zhang,et al.  Distinguishing two types of labels for multi-label feature selection , 2019, Pattern Recognit..

[19]  Shunxiang Wu,et al.  Feature selection for multi-label learning based on kernelized fuzzy rough sets , 2018, Neurocomputing.

[20]  Zhi-Hua Zhou,et al.  Multi-Label Learning by Exploiting Label Correlations Locally , 2012, AAAI.

[21]  Yuwen Li,et al.  Attribute reduction for multi-label learning with fuzzy rough set , 2018, Knowl. Based Syst..

[22]  Qinghua Hu,et al.  Cost-sensitive feature selection based on adaptive neighborhood granularity with multi-level confidence , 2016, Inf. Sci..

[23]  Min-Ling Zhang,et al.  A Review on Multi-Label Learning Algorithms , 2014, IEEE Transactions on Knowledge and Data Engineering.

[24]  Qingming Huang,et al.  Improving multi-label classification with missing labels by learning label-specific features , 2019, Inf. Sci..

[25]  Witold Pedrycz,et al.  Granular multi-label feature selection based on mutual information , 2017, Pattern Recognit..

[26]  Shunxiang Wu,et al.  Online multi-label streaming feature selection based on neighborhood rough set , 2018, Pattern Recognit..

[27]  Qinghua Hu,et al.  Neighborhood rough set based heterogeneous feature subset selection , 2008, Inf. Sci..

[28]  Dae-Won Kim,et al.  Feature selection for multi-label classification using multivariate mutual information , 2013, Pattern Recognit. Lett..

[29]  Xindong Wu,et al.  MLSLR: Multilabel Learning via Sparse Logistic Regression , 2014, Inf. Sci..

[30]  Lin Chen,et al.  Attribute significance for F — Parallel reducts , 2011, 2011 IEEE International Conference on Granular Computing.

[31]  Jianghong Ma,et al.  Label-specific feature selection and two-level label recovery for multi-label classification with missing labels , 2019, Neural Networks.

[32]  Kuo-Chen Hung,et al.  Rule Generation Based on Novel Kernel Intuitionistic Fuzzy Rough Set Model , 2018, IEEE Access.

[33]  Mark A. Hall,et al.  Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning , 1999, ICML.

[34]  Qinghua Hu,et al.  Subspace clustering guided unsupervised feature selection , 2017, Pattern Recognit..

[35]  Zhi-Hua Zhou,et al.  ML-KNN: A lazy learning approach to multi-label learning , 2007, Pattern Recognit..

[36]  Jun Wang,et al.  Enhancing multi-label classification by modeling dependencies among labels , 2014, Pattern Recognit..

[37]  Qinghua Hu,et al.  Multi-label feature selection based on max-dependency and min-redundancy , 2015, Neurocomputing.

[38]  Witold Pedrycz,et al.  Measuring relevance between discrete and continuous features based on neighborhood mutual information , 2011, Expert Syst. Appl..

[39]  Zhi-Hua Zhou,et al.  On the Consistency of Multi-Label Learning , 2011, COLT.

[40]  Jieping Ye,et al.  A shared-subspace learning framework for multi-label classification , 2010, TKDD.

[41]  Wei-Zhi Wu,et al.  Maximal-Discernibility-Pair-Based Approach to Attribute Reduction in Fuzzy Rough Sets , 2018, IEEE Transactions on Fuzzy Systems.

[42]  Zhiming Luo,et al.  Manifold regularized discriminative feature selection for multi-label learning , 2019, Pattern Recognit..

[43]  Yong Liu,et al.  Quick attribute reduct algorithm for neighborhood rough set model , 2014, Inf. Sci..

[44]  Jie Lu,et al.  A Bayesian nonparametric model for multi-label learning , 2017, Machine Learning.

[45]  Víctor Robles,et al.  Feature selection for multi-label naive Bayes classification , 2009, Inf. Sci..

[46]  Xiaonan Li,et al.  Three-way decisions approach to multiple attribute group decision making with linguistic information-based decision-theoretic rough fuzzy set , 2018, Int. J. Approx. Reason..

[47]  Dae-Won Kim,et al.  Generalized Information-Theoretic Criterion for Multi-Label Feature Selection , 2019, IEEE Access.

[48]  Utkarsh Singh,et al.  Optimal Feature Selection via NSGA-II for Power Quality Disturbances Classification , 2018, IEEE Transactions on Industrial Informatics.

[49]  Ling Wei,et al.  Attributes reduction and rules acquisition in an lattice-valued information system with fuzzy decision , 2017, Int. J. Mach. Learn. Cybern..