Noise-Tolerant Fuzzy-$\beta$-Covering-Based Multigranulation Rough Sets and Feature Subset Selection

As a novel fuzzy covering, fuzzy covering has attracted considerable attention. However, traditional fuzzy covering based rough sets and most of its extended models can not well fit the distribution of samples in real data, which limits their application in classification learning and decision making. First, the upper and lower approximations of these models have no inclusion relation, so they can not characterize a given objective concept accurately. Moreover, most of these models are hard to resist the influence of noise data, resulting in poor robustness in feature learning. For these reasons, a robust rough set model is set forth by combining fuzzy rough sets, covering based rough sets, and multigranulation rough sets. To this end, the optimistic and pessimistic lower and upper approximations of a target concept is reconstructed by means of the fuzzy neighborhood related to a family of fuzzy coverings, and a new multigranulation fuzzy rough set model is presented. Furthermore, fuzzy dependency function is introduced to evaluate the classification ability of a family of fuzzy coverings at different granularity level. The dimensionality reduction of a given fuzzy covering decision table is carried out from the perspective of maintaining the discrimination power, and a forward algorithm for feature selection is developed by using the optimistic significance of candidate features as heuristic information. Three groups of numerical experiments on 16 different types of data sets demonstrate that the proposed model exhibits good robustness on data sets contaminated with noise, and outperforms some state-of-the-art feature learning algorithms in terms of classification accuracy and the size of selected feature subset.

[1]  Chris Cornelis,et al.  A comprehensive study of fuzzy covering-based rough set models: Definitions, properties and interrelationships , 2017, Fuzzy Sets Syst..

[2]  Yee Leung,et al.  Generalized fuzzy rough approximation operators based on fuzzy coverings , 2008, Int. J. Approx. Reason..

[3]  Bin Yang,et al.  Matrix representations and interdependency on L-fuzzy covering-based approximation operators , 2018, Int. J. Approx. Reason..

[4]  Qinghua Hu,et al.  On Robust Fuzzy Rough Set Models , 2012, IEEE Transactions on Fuzzy Systems.

[5]  Qinghua Hu,et al.  Information-preserving hybrid data reduction based on fuzzy-rough techniques , 2006, Pattern Recognit. Lett..

[6]  Kun She,et al.  Multi-Granulation Entropy and Its Applications , 2013, Entropy.

[7]  Degang Chen,et al.  Attribute Reduction for Heterogeneous Data Based on the Combination of Classical and Fuzzy Rough Set Models , 2014, IEEE Transactions on Fuzzy Systems.

[8]  M. Friedman A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings , 1940 .

[9]  Wei-Zhi Wu,et al.  Intuitionistic Fuzzy Rough Set-Based Granular Structures and Attribute Subset Selection , 2019, IEEE Transactions on Fuzzy Systems.

[10]  Bing Huang,et al.  Intuitionistic fuzzy multigranulation rough sets , 2014, Inf. Sci..

[11]  Yuhua Qian,et al.  NMGRS: Neighborhood-based multigranulation rough sets , 2012, Int. J. Approx. Reason..

[12]  Xizhao Wang,et al.  Incremental Perspective for Feature Selection Based on Fuzzy Rough Sets , 2018, IEEE Transactions on Fuzzy Systems.

[13]  Bin Yang,et al.  A fuzzy covering-based rough set model and its generalization over fuzzy lattice , 2016, Inf. Sci..

[14]  Jiucheng Xu,et al.  Feature Selection Using Fuzzy Neighborhood Entropy-Based Uncertainty Measures for Fuzzy Neighborhood Multigranulation Rough Sets , 2021, IEEE Transactions on Fuzzy Systems.

[15]  Yuhua Qian,et al.  Multigranulation fuzzy rough set over two universes and its application to decision making , 2017, Knowl. Based Syst..

[16]  Qinghua Hu,et al.  Fuzzy Rough Set Based Feature Selection for Large-Scale Hierarchical Classification , 2019, IEEE Transactions on Fuzzy Systems.

[17]  Weihua Xu,et al.  Adaptive weighted generalized multi-granulation interval-valued decision-theoretic rough sets , 2020, Knowl. Based Syst..

[18]  José Carlos R. Alcantud,et al.  Novel classes of coverings based multigranulation fuzzy rough sets and corresponding applications to multiple attribute group decision-making , 2020, Artificial Intelligence Review.

[19]  Jesús Manuel Fernández Salido,et al.  Rough set analysis of a general type of fuzzy data using transitive aggregations of fuzzy similarity relations , 2003, Fuzzy Sets Syst..

[20]  Tao Feng,et al.  The reduction and fusion of fuzzy covering systems based on the evidence theory , 2012, Int. J. Approx. Reason..

[21]  Jinjin Li,et al.  A fitting model for attribute reduction with fuzzy β-covering , 2020, Fuzzy Sets Syst..

[22]  Hamido Fujita,et al.  Fuzzy neighborhood covering for three-way classification , 2020, Inf. Sci..

[23]  Ren Diao,et al.  Fuzzy-Rough Set Bireducts for Data Reduction , 2020, IEEE Transactions on Fuzzy Systems.

[24]  Qinghua Hu,et al.  A Fitting Model for Feature Selection With Fuzzy Rough Sets , 2017, IEEE Transactions on Fuzzy Systems.

[25]  Degang Chen,et al.  The Model of Fuzzy Variable Precision Rough Sets , 2009, IEEE Transactions on Fuzzy Systems.

[26]  Qinghua Hu,et al.  Feature Selection Based on Neighborhood Self-Information , 2020, IEEE Transactions on Cybernetics.

[27]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[28]  Yiyu Yao,et al.  Covering based multigranulation fuzzy rough sets and corresponding applications , 2019, Artificial Intelligence Review.

[29]  Jiye Liang,et al.  Local multigranulation decision-theoretic rough sets , 2017, Int. J. Approx. Reason..

[30]  Meikang Qiu,et al.  Distributed Feature Selection for Big Data Using Fuzzy Rough Sets , 2020, IEEE Transactions on Fuzzy Systems.

[31]  Jianming Zhan,et al.  Covering based multigranulation (I, T)-fuzzy rough set models and applications in multi-attribute group decision-making , 2019, Inf. Sci..

[32]  Witold Pedrycz,et al.  Covering-based multi-granulation fuzzy rough sets , 2015, J. Intell. Fuzzy Syst..

[33]  Qinghua Hu,et al.  Feature Selection Based on Neighborhood Discrimination Index , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[34]  O. J. Dunn Multiple Comparisons among Means , 1961 .

[35]  Qinghua Hu,et al.  Parameterized attribute reduction with Gaussian kernel based fuzzy rough sets , 2011, Inf. Sci..

[36]  Liwen Ma,et al.  On some types of neighborhood-related covering rough sets , 2012, Int. J. Approx. Reason..

[37]  Yaojin Lin,et al.  A graph approach for fuzzy-rough feature selection , 2020, Fuzzy Sets Syst..

[38]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.

[39]  Weihua Xu,et al.  Multi-granulation Fuzzy Rough Sets in a Fuzzy Tolerance Approximation Space , 2011 .

[40]  Chris Cornelis,et al.  Fuzzy neighborhood operators based on fuzzy coverings , 2017, Fuzzy Sets Syst..

[41]  Chris Cornelis,et al.  Ordered Weighted Average Based Fuzzy Rough Sets , 2010, RSKT.

[42]  Xiao Zhang,et al.  Active Incremental Feature Selection Using a Fuzzy-Rough-Set-Based Information Entropy , 2020, IEEE Transactions on Fuzzy Systems.

[43]  Bin Yang,et al.  On some types of fuzzy covering-based rough sets , 2017, Fuzzy Sets Syst..

[44]  D. Dubois,et al.  ROUGH FUZZY SETS AND FUZZY ROUGH SETS , 1990 .

[45]  Yan Wang,et al.  Fuzzy Rough Attribute Reduction for Categorical Data , 2020, IEEE Transactions on Fuzzy Systems.

[46]  Wei-Zhi Wu,et al.  Reduction foundation with multigranulation rough sets using discernibility , 2019, Artificial Intelligence Review.

[47]  Theresa Beaubouef,et al.  Rough Sets , 2019, Lecture Notes in Computer Science.

[48]  Chris Cornelis,et al.  A comprehensive study of implicator-conjunctor-based and noise-tolerant fuzzy rough sets: Definitions, properties and robustness analysis , 2015, Fuzzy Sets Syst..

[49]  Zeshui Xu,et al.  Covering-based general multigranulation intuitionistic fuzzy rough sets and corresponding applications to multi-attribute group decision-making , 2019, Inf. Sci..

[50]  Yiyu Yao,et al.  MGRS: A multi-granulation rough set , 2010, Inf. Sci..

[51]  Weihua Xu,et al.  The comparative study of covering rough sets and multi-granulation rough sets , 2019, Soft Comput..

[52]  Liwen Ma,et al.  Two fuzzy covering rough set models and their generalizations over fuzzy lattices , 2016, Fuzzy Sets Syst..