Fuzzy rough set-based attribute reduction using distance measures

Abstract Attribute reduction is one of the most important applications of fuzzy rough sets in machine learning and pattern recognition. Most existing methods employ the intersection operation of fuzzy relations to construct the dependency function of attribute reduction. However, the intersection operation may lead to low discrimination of fuzzy decision in high-dimensional data space. In this study, we introduce distance measures into fuzzy rough sets and propose a novel method for attribute reduction. We first construct a fuzzy rough set model based on distance measure with a fixed parameter. Then, the fixed distance parameter is replaced by a variable one to better characterize attribute reduction with fuzzy rough sets. Some iterative formulas for computing fuzzy rough dependency and attribute significance are presented, and an iterative computation model based on a variable distance parameter is proposed. Based on this, a greedy convergent algorithm for attribute reduction is designed. The experimental comparison demonstrates that the proposed reduction algorithm is effective and performs better than some of the other existing algorithms.

[1]  Richard Jensen,et al.  Unsupervised fuzzy-rough set-based dimensionality reduction , 2013, Inf. Sci..

[2]  Yuhua Qian,et al.  A comparative study of multigranulation rough sets and concept lattices via rule acquisition , 2016, Knowl. Based Syst..

[3]  Degang Chen,et al.  Attribute Reduction for Heterogeneous Data Based on the Combination of Classical and Fuzzy Rough Set Models , 2014, IEEE Transactions on Fuzzy Systems.

[4]  Witold Pedrycz,et al.  Data-Distribution-Aware Fuzzy Rough Set Model and its Application to Robust Classification , 2016, IEEE Transactions on Cybernetics.

[5]  Qinghua Hu,et al.  Streaming Feature Selection for Multilabel Learning Based on Fuzzy Mutual Information , 2017, IEEE Transactions on Fuzzy Systems.

[6]  D. Dubois,et al.  ROUGH FUZZY SETS AND FUZZY ROUGH SETS , 1990 .

[7]  Ju-Sheng Mi,et al.  Attribute reduction based on generalized fuzzy evidence theory in fuzzy decision systems , 2011, Fuzzy Sets Syst..

[8]  Didier Dubois,et al.  Putting Rough Sets and Fuzzy Sets Together , 1992, Intelligent Decision Support.

[9]  Bernhard Moser,et al.  On Representing and Generating Kernels by Fuzzy Equivalence Relations , 2006, J. Mach. Learn. Res..

[10]  John N. Mordeson,et al.  Rough set theory applied to (fuzzy) ideal theory , 2001, Fuzzy Sets Syst..

[11]  Ming-Wen Shao,et al.  Feature subset selection based on fuzzy neighborhood rough sets , 2016, Knowl. Based Syst..

[12]  Weihua Xu,et al.  Granular Computing Approach to Two-Way Learning Based on Formal Concept Analysis in Fuzzy Datasets , 2016, IEEE Transactions on Cybernetics.

[13]  Lin Sun,et al.  Feature selection using rough entropy-based uncertainty measures in incomplete decision systems , 2012, Knowl. Based Syst..

[14]  Qingguo Li,et al.  Incremental approaches to knowledge reduction based on characteristic matrices , 2017, Int. J. Mach. Learn. Cybern..

[15]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.

[16]  Partha Garai,et al.  On fuzzy-rough attribute selection: Criteria of Max-Dependency, Max-Relevance, Min-Redundancy, and Max-Significance , 2013, Appl. Soft Comput..

[17]  Anna Maria Radzikowska,et al.  A comparative study of fuzzy rough sets , 2002, Fuzzy Sets Syst..

[18]  Yuhua Qian,et al.  Multigranulation fuzzy rough set over two universes and its application to decision making , 2017, Knowl. Based Syst..

[19]  Peng Li,et al.  A general frame for intuitionistic fuzzy rough sets , 2012, Inf. Sci..

[20]  Hamido Fujita,et al.  Parallel attribute reduction in dominance-based neighborhood rough set , 2016, Inf. Sci..

[21]  Slavka Bodjanova,et al.  Approximation of fuzzy concepts in decision making , 1997, Fuzzy Sets Syst..

[22]  Qinghua Hu,et al.  A Novel Algorithm for Finding Reducts With Fuzzy Rough Sets , 2012, IEEE Transactions on Fuzzy Systems.

[23]  Zhifei Zhang,et al.  Incremental approaches for updating reducts in dynamic covering information systems , 2017, Knowl. Based Syst..

[24]  Witold Pedrycz,et al.  Kernelized Fuzzy Rough Sets and Their Applications , 2011, IEEE Transactions on Knowledge and Data Engineering.

[25]  Yiyu Yao,et al.  Attribute reduction in decision-theoretic rough set models , 2008, Inf. Sci..

[26]  Bernhard Moser,et al.  On the T , 2006, Fuzzy Sets Syst..

[27]  Hui Wang,et al.  Fuzzy rough set based incremental attribute reduction from dynamic data with sample arriving , 2017, Fuzzy Sets Syst..

[28]  Qiang Shen,et al.  Centre for Intelligent Systems and Their Applications Fuzzy Rough Attribute Reduction with Application to Web Categorization Fuzzy Rough Attribute Reduction with Application to Web Categorization Fuzzy Sets and Systems ( ) – Fuzzy–rough Attribute Reduction with Application to Web Categorization , 2022 .

[29]  Jiye Liang,et al.  Information Granularity in Fuzzy Binary GrC Model , 2011, IEEE Transactions on Fuzzy Systems.

[30]  Jiye Liang,et al.  Ieee Transactions on Knowledge and Data Engineering 1 a Group Incremental Approach to Feature Selection Applying Rough Set Technique , 2022 .

[31]  Qinghua Hu,et al.  A Fitting Model for Feature Selection With Fuzzy Rough Sets , 2017, IEEE Transactions on Fuzzy Systems.

[32]  Degang Chen,et al.  Active Sample Selection Based Incremental Algorithm for Attribute Reduction With Rough Sets , 2017, IEEE Transactions on Fuzzy Systems.

[33]  Yuwen Li,et al.  Attribute reduction for multi-label learning with fuzzy rough set , 2018, Knowl. Based Syst..

[34]  Nehad N. Morsi,et al.  Axiomatics for fuzzy rough sets , 1998, Fuzzy Sets Syst..

[35]  Jianhua Dai,et al.  Attribute selection based on information gain ratio in fuzzy rough set theory with application to tumor classification , 2013, Appl. Soft Comput..

[36]  Ming-Wen Shao,et al.  Generalized fuzzy rough approximation operators determined by fuzzy implicators , 2013, Int. J. Approx. Reason..

[37]  Weihua Xu,et al.  A novel approach to information fusion in multi-source datasets: A granular computing viewpoint , 2017, Inf. Sci..

[38]  Xiaoyong Du,et al.  A Novel Approach to Building a Robust Fuzzy Rough Classifier , 2015, IEEE Transactions on Fuzzy Systems.

[39]  Jianwu Dang,et al.  Fuzzy rough regression with application to wind speed prediction , 2014, Inf. Sci..

[40]  Hong-Ying Zhang,et al.  Feature selection and approximate reasoning of large-scale set-valued decision tables based on α-dominance-based quantitative rough sets , 2017, Inf. Sci..

[41]  Wei-Zhi Wu,et al.  Maximal-Discernibility-Pair-Based Approach to Attribute Reduction in Fuzzy Rough Sets , 2018, IEEE Transactions on Fuzzy Systems.

[42]  Bing Huang,et al.  Intuitionistic fuzzy multigranulation rough sets , 2014, Inf. Sci..

[43]  Yee Leung,et al.  Generalized fuzzy rough sets determined by a triangular norm , 2008, Inf. Sci..

[44]  Yanhong She,et al.  Uncertainty measures in rough algebra with applications to rough logic , 2014, Int. J. Mach. Learn. Cybern..

[45]  Bingzhen Sun,et al.  Fuzzy rough set on probabilistic approximation space over two universes and its application to emergency decision‐making , 2015, Expert Syst. J. Knowl. Eng..

[46]  Degang Chen,et al.  The Model of Fuzzy Variable Precision Rough Sets , 2009, IEEE Transactions on Fuzzy Systems.

[47]  Jerzy W. Grzymala-Busse,et al.  Rough Sets , 1995, Commun. ACM.

[48]  Hamido Fujita,et al.  An incremental attribute reduction approach based on knowledge granularity with a multi-granulation view , 2017, Inf. Sci..