Intuitionistic Fuzzy Rough Set-Based Granular Structures and Attribute Subset Selection

Attribute subset selection is an important issue in data mining and information processing. However, most automatic methodologies consider only the relevance factor between samples while ignoring the diversity factor. This may not allow the utilization value of hidden information to be exploited. For this reason, we propose a hybrid model named intuitionistic fuzzy (IF) rough set to overcome this limitation. The model combines the technical advantages of rough set and IF set and can effectively consider the above-mentioned statistical factors. First, fuzzy information granules based on IF relations are defined and used to characterize the hierarchical structures of the lower and upper approximations of IF rough set within the framework of granular computing. Then, the computation of IF rough approximations and knowledge reduction in IF information systems are investigated. Third, based on the approximations of IF rough set, significance measures are developed to evaluate the approximation quality and classification ability of IF relations. Furthermore, a forward heuristic algorithm for finding one optimal reduct of IF information systems is developed using these measures. Finally, numerical experiments are conducted on public datasets to examine the effectiveness and efficiency of the proposed algorithm in terms of the number of selected attributes, computational time, and classification accuracy.

[1]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[2]  Manas Ranjan Patra,et al.  Multi Criterion Decision Making using Intuitionistic Fuzzy Rough Set on Two Universal Sets , 2015 .

[3]  Theresa Beaubouef,et al.  Rough Sets , 2019, Lecture Notes in Computer Science.

[4]  Lei Zhou,et al.  On characterization of intuitionistic fuzzy rough sets based on intuitionistic fuzzy implicators , 2009, Inf. Sci..

[5]  Qinghua Hu,et al.  Feature Selection Based on Neighborhood Discrimination Index , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Wei-Zhi Wu,et al.  Evidence-theory-based numerical characterization of multigranulation rough sets in incomplete information systems , 2016, Fuzzy Sets Syst..

[7]  Decui Liang,et al.  Deriving three-way decisions from intuitionistic fuzzy decision-theoretic rough sets , 2015, Inf. Sci..

[8]  Ioannis K. Vlachos,et al.  Subsethood, entropy, and cardinality for interval-valued fuzzy sets - An algebraic derivation , 2007, Fuzzy Sets Syst..

[9]  Yee Leung,et al.  On characterizations of (I, J)-fuzzy rough approximation operators , 2005, Fuzzy Sets Syst..

[10]  Xizhao Wang,et al.  On the generalization of fuzzy rough sets , 2005, IEEE Transactions on Fuzzy Systems.

[11]  Lei Zhou,et al.  On generalized intuitionistic fuzzy rough approximation operators , 2008, Inf. Sci..

[12]  Qinghua Hu,et al.  On Robust Fuzzy Rough Set Models , 2012, IEEE Transactions on Fuzzy Systems.

[13]  Yee Leung,et al.  Generalized fuzzy rough sets determined by a triangular norm , 2008, Inf. Sci..

[14]  Qinghua Hu,et al.  Neighbor Inconsistent Pair Selection for Attribute Reduction by Rough Set Approach , 2018, IEEE Transactions on Fuzzy Systems.

[15]  Qinghua Hu,et al.  A Novel Algorithm for Finding Reducts With Fuzzy Rough Sets , 2012, IEEE Transactions on Fuzzy Systems.

[16]  Qiang Shen,et al.  Semantics-preserving dimensionality reduction: rough and fuzzy-rough-based approaches , 2004, IEEE Transactions on Knowledge and Data Engineering.

[17]  Witold Pedrycz,et al.  Kernelized Fuzzy Rough Sets and Their Applications , 2011, IEEE Transactions on Knowledge and Data Engineering.

[18]  Witold Pedrycz,et al.  The Development of Fuzzy Rough Sets with the Use of Structures and Algebras of Axiomatic Fuzzy Sets , 2009, IEEE Transactions on Knowledge and Data Engineering.

[19]  Degang Chen,et al.  Attribute Reduction for Heterogeneous Data Based on the Combination of Classical and Fuzzy Rough Set Models , 2014, IEEE Transactions on Fuzzy Systems.

[20]  Jiye Liang,et al.  Fuzzy-rough feature selection accelerator , 2015, Fuzzy Sets Syst..

[21]  De-gang Chen,et al.  The Model of Fuzzy Variable Precision Rough Sets , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[22]  LangJérôme,et al.  Fuzzy sets in approximate reasoning, part 2 , 1991 .

[23]  Bing Huang,et al.  Hierarchical structures and uncertainty measures for intuitionistic fuzzy approximation space , 2016, Inf. Sci..

[24]  Changzhong Wang,et al.  Attribute reduction using distance-based fuzzy rough sets , 2015, 2015 International Conference on Machine Learning and Cybernetics (ICMLC).

[25]  Qin Liu,et al.  An approach to decision making based on intuitionistic fuzzy rough sets over two universes , 2013, J. Oper. Res. Soc..

[26]  Sam Kwong,et al.  Fuzzy-Rough-Set-Based Active Learning , 2014, IEEE Transactions on Fuzzy Systems.

[27]  Hui Wang,et al.  Granular Computing Based on Fuzzy Similarity Relations , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[28]  Qiang Shen,et al.  Centre for Intelligent Systems and Their Applications Fuzzy Rough Attribute Reduction with Application to Web Categorization Fuzzy Rough Attribute Reduction with Application to Web Categorization Fuzzy Sets and Systems ( ) – Fuzzy–rough Attribute Reduction with Application to Web Categorization , 2022 .

[29]  Humberto Bustince,et al.  Structures on intuitionistic fuzzy relations , 1996, Fuzzy Sets Syst..

[30]  Peng Li,et al.  A general frame for intuitionistic fuzzy rough sets , 2012, Inf. Sci..

[31]  Zhang Zhi-ming Intuitionistic fuzzy rough sets based on intuitionistic fuzzy coverings , 2010 .

[32]  Degang Chen,et al.  Fuzzy rough set based attribute reduction for information systems with fuzzy decisions , 2011, Knowl. Based Syst..

[33]  Qinghua Hu,et al.  Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation , 2007, Pattern Recognit..

[34]  Dogan Çoker,et al.  Fuzzy rough sets are intuitionistic L-fuzzy sets , 1998, Fuzzy Sets Syst..

[35]  Janusz Kacprzyk,et al.  Entropy for intuitionistic fuzzy sets , 2001, Fuzzy Sets Syst..

[36]  Xiaoxia Zhang,et al.  Variable precision intuitionistic fuzzy rough sets model and its application , 2014, Int. J. Mach. Learn. Cybern..

[37]  Bing Huang,et al.  Intuitionistic fuzzy multigranulation rough sets , 2014, Inf. Sci..

[38]  Qinghua Hu,et al.  Streaming Feature Selection for Multilabel Learning Based on Fuzzy Mutual Information , 2017, IEEE Transactions on Fuzzy Systems.

[39]  Rajen B. Bhatt,et al.  On fuzzy-rough sets approach to feature selection , 2005, Pattern Recognit. Lett..

[40]  Daniel S. Yeung,et al.  On attributes reduction with fuzzy rough sets , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[41]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[42]  Witold Pedrycz,et al.  Large-Scale Multimodality Attribute Reduction With Multi-Kernel Fuzzy Rough Sets , 2018, IEEE Transactions on Fuzzy Systems.

[43]  Wei-Zhi Wu,et al.  A set-cover-based approach for the test-cost-sensitive attribute reduction problem , 2016, Soft Computing.

[44]  D. Dubois,et al.  ROUGH FUZZY SETS AND FUZZY ROUGH SETS , 1990 .

[45]  Xiao Zhang,et al.  Feature selection in mixed data: A method using a novel fuzzy rough set-based information entropy , 2016, Pattern Recognit..

[46]  Jiye Liang,et al.  Fuzzy Granular Structure Distance , 2015, IEEE Transactions on Fuzzy Systems.

[47]  Qinghua Hu,et al.  Attribute Selection for Partially Labeled Categorical Data By Rough Set Approach , 2017, IEEE Transactions on Cybernetics.

[48]  Bing Huang,et al.  Information granulation and uncertainty measures in interval-valued intuitionistic fuzzy information systems , 2013, Eur. J. Oper. Res..

[49]  Yi Lin,et al.  Variable precision intuitionistic fuzzy rough set model and applications based on conflict distance , 2015, Expert Syst. J. Knowl. Eng..

[50]  Ming-Wen Shao,et al.  Feature subset selection based on fuzzy neighborhood rough sets , 2016, Knowl. Based Syst..

[51]  Weihua Xu,et al.  Granular Computing Approach to Two-Way Learning Based on Formal Concept Analysis in Fuzzy Datasets , 2016, IEEE Transactions on Cybernetics.

[52]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.

[53]  Krassimir T. Atanassov,et al.  Intuitionistic Fuzzy Sets - Theory and Applications , 1999, Studies in Fuzziness and Soft Computing.

[54]  Xiaoyong Du,et al.  A Novel Approach to Building a Robust Fuzzy Rough Classifier , 2015, IEEE Transactions on Fuzzy Systems.

[55]  Zhiming Zhang,et al.  Attributes reduction based on intuitionistic fuzzy rough sets , 2016, J. Intell. Fuzzy Syst..

[56]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[57]  Qinghua Hu,et al.  A Fitting Model for Feature Selection With Fuzzy Rough Sets , 2017, IEEE Transactions on Fuzzy Systems.

[58]  Yiyu Yao,et al.  A Comparative Study of Fuzzy Sets and Rough Sets , 1998 .

[59]  Chris Cornelis,et al.  Implication in intuitionistic fuzzy and interval-valued fuzzy set theory: construction, classification, application , 2004, Int. J. Approx. Reason..

[60]  Guo-Jun Wang,et al.  Intuitionistic fuzzy sets and L-fuzzy sets , 2000, Fuzzy Sets Syst..

[61]  Chris Cornelis,et al.  Intuitionistic fuzzy rough sets: at the crossroads of imperfect knowledge , 2003 .

[62]  Yi Lin,et al.  Intuitionistic fuzzy rough set model based on conflict distance and applications , 2015, Appl. Soft Comput..