A systematic study on attribute reduction with rough sets based on general binary relations

Attribute reduction is considered as an important preprocessing step for pattern recognition, machine learning, and data mining. This paper provides a systematic study on attribute reduction with rough sets based on general binary relations. We define a relation information system, a consistent relation decision system, and a relation decision system and their attribute reductions. Furthermore, we present a judgment theorem and a discernibility matrix associated with attribute reduction in each type of system; based on the discernibility matrix, we can compute all the reducts. Finally, the experimental results with UCI data sets show that the proposed reduction methods are an effective technique to deal with complex data sets.

[1]  Mohamed Quafafou,et al.  alpha-RST: a generalization of rough set theory , 2000, Inf. Sci..

[2]  Zbigniew Bonikowski,et al.  Algebraic Structures of Rough Sets , 1993, RSKD.

[3]  Dominik Slezak,et al.  Approximate Reducts and Association Rules - Correspondence and Complexity Results , 1999, RSFDGrC.

[4]  Daren Yu,et al.  Entropies Of Fuzzy Indiscernibility Relation And Its Operations , 2005, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[5]  Huan Liu,et al.  Consistency-based search in feature selection , 2003, Artif. Intell..

[6]  R. Lathe.  Phd by thesis , 1988, Nature.

[7]  Wei-Zhi Wu,et al.  Knowledge reduction in random information systems via Dempster-Shafer theory of evidence , 2005, Inf. Sci..

[8]  Qiang Shen,et al.  Selecting informative features with fuzzy-rough sets and its application for complex systems monitoring , 2004, Pattern Recognit..

[9]  Malcolm J. Beynon,et al.  Reducts within the variable precision rough sets model: A further investigation , 2001, Eur. J. Oper. Res..

[10]  Andrzej Skowron,et al.  Rough sets: Some extensions , 2007, Inf. Sci..

[11]  Qinghua Hu,et al.  Neighborhood classifiers , 2008, Expert Syst. Appl..

[12]  John N. Mordeson,et al.  Rough set theory applied to (fuzzy) ideal theory , 2001, Fuzzy Sets Syst..

[13]  Daniel Vanderpooten,et al.  A Generalized Definition of Rough Approximations Based on Similarity , 2000, IEEE Trans. Knowl. Data Eng..

[14]  B. Wen.  COMBINING ROUGH SET METHODOLOGY AND FUZZY CLUSTERING FOR KNOWLEDGE DISCOVERY FROM QUANTITATIVE DATA , 2004 .

[15]  Zdzislaw Pawlak,et al.  Rough Set Theory and its Applications to Data Analysis , 1998, Cybern. Syst..

[16]  Daniel S. Yeung,et al.  Rough approximations on a complete completely distributive lattice with applications to generalized rough sets , 2006, Inf. Sci..

[17]  Wei-Zhi Wu,et al.  Approaches to knowledge reduction based on variable precision rough set model , 2004, Inf. Sci..

[18]  E. Bryniarski.  A calculus of rough sets of the first order , 1989 .

[19]  Huan Liu,et al.  Efficient Feature Selection via Analysis of Relevance and Redundancy , 2004, J. Mach. Learn. Res..

[20]  Jan G. Bazan.  Chapter 17 a Comparison of Dynamic and Non{dynamic Rough Set Methods for Extracting Laws from Decision Tables , 1998 .

[21]  Qinghua Hu,et al.  Fuzzy probabilistic approximation spaces and their information measures , 2006, IEEE Transactions on Fuzzy Systems.

[22]  Andrzej Skowron,et al.  The Discernibility Matrices and Functions in Information Systems , 1992, Intelligent Decision Support.

[23]  Hung Son Nguyen,et al.  Approximate Boolean Reasoning: Foundations and Applications in Data Mining , 2006, Trans. Rough Sets.

[24]  Andrzej Skowron,et al.  Tolerance Approximation Spaces , 1996, Fundam. Informaticae.

[25]  U. Wybraniec-Skardowska.  On a generalization of approximation space , 1989 .

[26]  Z. Pawlak.  Rough Sets: Theoretical Aspects of Reasoning about Data , 1991 .

[27]  W. Zakowski.  APPROXIMATIONS IN THE SPACE (U,π) , 1983 .

[28]  Salvatore Greco,et al.  Rough sets theory for multicriteria decision analysis , 2001, Eur. J. Oper. Res..

[29]  Qinghua Hu,et al.  A new approach to attribute reduction of consistent and inconsistent covering decision systems with covering rough sets , 2007, Inf. Sci..

[30]  Yiyu Yao,et al.  Constructive and Algebraic Methods of the Theory of Rough Sets , 1998, Inf. Sci..

[31]  William Zhu,et al.  Topological approaches to covering rough sets , 2007, Inf. Sci..

[32]  Dominik Slezak,et al.  Approximate Reducts in Decision Tables , 1996 .

[33]  Jerzy Stefanowski,et al.  On rough set based approaches to induction of decision rules , 1998 .

[34]  Lech Polkowski,et al.  Rough Sets in Knowledge Discovery 2 , 1998 .

[35]  Wojciech Ziarko,et al.  Variable Precision Rough Set Model , 1993, J. Comput. Syst. Sci..

[36]  Marzena Kryszkiewicz,et al.  Rules in Incomplete Information Systems , 1999, Inf. Sci..

[37]  Yiyu Yao,et al.  Relational Interpretations of Neigborhood Operators and Rough Set Approximation Operators , 1998, Inf. Sci..

[38]  Degang Chen.  The Part Reductions in Information Systems , 2004, Rough Sets and Current Trends in Computing.

[39]  Mark A. Hall,et al.  Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning , 1999, ICML.

[40]  Chen Degang,et al.  The Part Reductions in Information Systems , 2004 .

[41]  Kenzo Nonami,et al.  Optimal two-degree-of-freedom fuzzy control for locomotion control of a hydraulically actuated hexapod robot , 2007, Inf. Sci..

[42]  Xizhao Wang,et al.  On the generalization of fuzzy rough sets , 2005, IEEE Transactions on Fuzzy Systems.

[43]  Marzena Kryszkiewicz.  Comparative study of alternative types of knowledge reduction in inconsistent systems , 2001, Int. J. Intell. Syst..

[44]  Andrzej Skowron,et al.  Rudiments of rough sets , 2007, Inf. Sci..

[45]  Fei-Yue Wang,et al.  Reduction and axiomization of covering generalized rough sets , 2003, Inf. Sci..

[46]  Marzena Kryszkiewicz,et al.  Rough Set Approach to Incomplete Information Systems , 1998, Inf. Sci..

[47]  Andrzej Skowron,et al.  Rough sets and Boolean reasoning , 2007, Inf. Sci..

[48]  Urszula Wybraniec-Skardowska,et al.  Extensions and Intentions in the Ruogh Set Theory , 1998, Inf. Sci..

[49]  B. C. Brookes,et al.  Information Sciences , 2020, Cognitive Skills You Need for the 21st Century.

[50]  Qinghua Hu,et al.  Information-preserving hybrid data reduction based on fuzzy-rough techniques , 2006, Pattern Recognit. Lett..

[51]  R. Słowiński.  Intelligent Decision Support: Handbook of Applications and Advances of the Rough Sets Theory , 1992 .

[52]  Marzena Kryszkiewicz.  Comparative study of alternative types of knowledge reduction in inconsistent systems , 2001, Int. J. Intell. Syst..

[53]  Gianpiero Cattaneo,et al.  Abstract Approximation Spaces for Rough Theories , 2008 .

[54]  C. J. V. Rijsbergen,et al.  Rough Sets, Fuzzy Sets and Knowledge Discovery , 1994, Workshops in Computing.

[55]  Salvatore Greco,et al.  Rough sets methodology for sorting problems in presence of multiple attributes and criteria , 2002, Eur. J. Oper. Res..

[56]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[57]  Chen Degang,et al.  A new approach to attribute reduction of consistent and inconsistent covering decision systems with covering rough sets , 2007 .