Decision-relative discernibility matrices in the sense of entropies

Abstract In rough set theory, attribute reduction is a basic issue, which aims to hold the discernibility of the attribute set. To obtain all of the reducts of an information system or a decision table, researchers have introduced many discernibility matrices based reduction methods. However, the reducts in the sense of positive region can only be obtained by using the existing discernibility matrices. In this paper, we introduce two discernibility matrices in the sense of entropies (Shannon’s entropy and complement entropy). By means of the two discernibility matrices, we can achieve all of the reducts in the sense of Shannon’s entropy and all of the reducts in the sense of complement entropy, respectively. Furthermore, we discover the relationships among the reducts in the sense of preserving positive region, Shannon’s entropy and complement entorpy. The experimental studies show that by the proposed decision-relative discernibility matrices based reduction methods, all the reducts of a decision table in sense of entropies can be obtained.

[1]  Chen Zhao-jiong,et al.  A New Discernibility Matrix and the Computation of a Core , 2002 .

[2]  James F. Peters,et al.  Rough Set Approach to Pattern Extraction from Classifiers , 2003, RSKD.

[3]  Yiyu Yao,et al.  Discernibility matrix simplification for constructing attribute reducts , 2009, Inf. Sci..

[4]  Wei Wei,et al.  Comparative study of decision performance of decision tables induced by attribute reductions , 2010, Int. J. Gen. Syst..

[5]  Wei-Zhi Wu,et al.  Approaches to knowledge reduction based on variable precision rough set model , 2004, Inf. Sci..

[6]  Witold Pedrycz,et al.  Positive approximation: An accelerator for attribute reduction in rough set theory , 2010, Artif. Intell..

[7]  Daisuke Yamaguchi,et al.  Attribute dependency functions considering data efficiency , 2009, Int. J. Approx. Reason..

[8]  Jiye Liang,et al.  A new method for measuring uncertainty and fuzziness in rough set theory , 2002, Int. J. Gen. Syst..

[9]  Qinghua Hu,et al.  Hybrid attribute reduction based on a novel fuzzy-rough model and information granulation , 2007, Pattern Recognit..

[10]  DEYU LI,et al.  On Knowledge Reduction In Inconsistent Decision Information Systems , 2005, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[11]  Ming-Wen Shao,et al.  Dominance relation and rules in an incomplete ordered information system , 2005, Int. J. Intell. Syst..

[12]  Jiye Liang,et al.  Interval ordered information systems , 2008, Comput. Math. Appl..

[13]  Wei Wei,et al.  An attribute reduction approach and its accelerated version for hybrid data , 2009, 2009 8th IEEE International Conference on Cognitive Informatics.

[14]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[15]  Wei Wei,et al.  A comparative study of rough sets for hybrid data , 2012, Inf. Sci..

[16]  Marzena Kryszkiewicz Comparative study of alternative types of knowledge reduction in inconsistent systems , 2001, Int. J. Intell. Syst..

[17]  Yiyu Yao,et al.  MGRS: A multi-granulation rough set , 2010, Inf. Sci..

[18]  Hung Son Nguyen,et al.  Approximate Boolean Reasoning: Foundations and Applications in Data Mining , 2006, Trans. Rough Sets.

[19]  Yang Ming,et al.  An Incremental Updating Algorithm of the Computation of a Core Based on the Improved Discernibility Matrix , 2006 .

[20]  Dominik Slezak,et al.  Approximate Reducts and Association Rules - Correspondence and Complexity Results , 1999, RSFDGrC.

[21]  Ming-Wen Shao,et al.  Dominance relation and rules in an incomplete ordered information system , 2005 .

[22]  Jiye Liang,et al.  Set-valued ordered information systems , 2009, Inf. Sci..

[23]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[24]  Dominik Slezak,et al.  Approximate Entropy Reducts , 2002, Fundam. Informaticae.

[25]  Ivo Düntsch,et al.  Uncertainty Measures of Rough Set Prediction , 1998, Artif. Intell..

[26]  Jiye Liang,et al.  A new measure of uncertainty based on knowledge granulation for rough sets , 2009, Inf. Sci..

[27]  Andrzej Skowron,et al.  Rudiments of rough sets , 2007, Inf. Sci..

[28]  Dominik Sl,et al.  Foundations of Entropy Based Bayesian Networks: Theoretical Results & Rough Set Based Extraction from Data , 2000 .

[29]  Marzena Kryszkiewicz Comparative study of alternative types of knowledge reduction in inconsistent systems , 2001, Int. J. Intell. Syst..

[30]  Yiyu Yao,et al.  A Model of Machine Learning Based on User Preference of Attributes , 2006, RSCTC.

[31]  Andrzej Skowron,et al.  The Discernibility Matrices and Functions in Information Systems , 1992, Intelligent Decision Support.

[32]  Jiye Liang,et al.  Information entropy, rough entropy and knowledge granulation in incomplete information systems , 2006, Int. J. Gen. Syst..

[33]  Jiye Liang,et al.  The Information Entropy, Rough Entropy And Knowledge Granulation In Rough Set Theory , 2004, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[34]  Wojciech Ziarko,et al.  Variable Precision Rough Set Model , 1993, J. Comput. Syst. Sci..

[35]  Wei-Zhi Wu,et al.  Knowledge reduction in random information systems via Dempster-Shafer theory of evidence , 2005, Inf. Sci..

[36]  Andrzej Skowron,et al.  Rough sets and Boolean reasoning , 2007, Inf. Sci..

[37]  Dominik Slezak,et al.  Approximate Reducts in Decision Tables , 1996 .

[38]  Guoyin Wang,et al.  Rough reduction in algebra view and information view , 2003, Int. J. Intell. Syst..

[39]  XU Feng-sheng,et al.  New discernibility matrix and computation of core , 2007 .

[40]  XIAOHUA Hu,et al.  LEARNING IN RELATIONAL DATABASES: A ROUGH SET APPROACH , 1995, Comput. Intell..