Information Entropy and Mutual Information-based Uncertainty Measures in Rough Set Theory

As an extension of the classical set theory, rough set theory plays a cr ucial role in uncertainty measurement. In this paper, concepts of information entropy and mutual information-based uncertainty measures are presented in both complete and incomplete information/decision systems. Then, some important properties of these measures are investigated, relationships among them are established, and comparison analyses with several representative uncertainty measures are illustrated as well. Theoretical analysis indicates that these proposed uncertainty measures can be used to evaluate the uncertainty ability of different knowledge in complete/incomplete decision systems, and then these results can be helpful for understanding the essence of knowledge content and uncertainty measures in incomplete information/decision systems. Thus, these results have a wide variety of applications in rule evaluation and knowledge discovery in rough set theory.

[1]  Lin Sun,et al.  Knowledge Entropy and Feature Selection in Incomplete Decision Systems , 2013 .

[2]  Dun Liu,et al.  Incremental updating approximations in dominance-based rough sets approach under the variation of the attribute set , 2013, Knowl. Based Syst..

[3]  Lin Sun,et al.  Granularity-Based User-Centric Multi-Strategies and Application in Knowledge Retrieval , 2013, J. Comput..

[4]  Lin Sun,et al.  Granular Space-Based Feature Selection and Its Applications , 2013, J. Softw..

[5]  Lin Sun,et al.  Feature selection using rough entropy-based uncertainty measures in incomplete decision systems , 2012, Knowl. Based Syst..

[6]  Lin Sun,et al.  Granular Computing-based Granular Structure Model and its Application in Knowledge Retrieval , 2012 .

[7]  Jianhua Dai,et al.  Approximations and uncertainty measures in incomplete information systems , 2012, Inf. Sci..

[8]  Jianhua Dai,et al.  Conditional entropy for incomplete decision systems and its application in data mining , 2012, Int. J. Gen. Syst..

[9]  Lin Sun,et al.  Decision Degree-based Decision Tree Technology for Rule Extraction , 2012, J. Comput..

[10]  Zengtai Gong,et al.  The further investigation of covering-based rough sets: Uncertainty characterization, similarity measure and generalized models , 2010, Inf. Sci..

[11]  Yassine Hassouni,et al.  Concurrence in the framework of coherent states , 2010, Quantum Inf. Process..

[12]  Jiye Liang,et al.  A New Method for Measuring the Uncertainty in Incomplete Information Systems , 2009, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[13]  Zhongzhi Shi,et al.  A fast approach to attribute reduction in incomplete decision systems with tolerance relation-based rough sets , 2009, Inf. Sci..

[14]  Jiye Liang,et al.  A new measure of uncertainty based on knowledge granulation for rough sets , 2009, Inf. Sci..

[15]  Jiye Liang,et al.  Information granules and entropy theory in information systems , 2008, Science in China Series F: Information Sciences.

[16]  Jiye Liang,et al.  Combination Entropy and Combination Granulation in Rough Set Theory , 2008, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[17]  Daren Yu,et al.  Entropies Of Fuzzy Indiscernibility Relation And Its Operations , 2005, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[18]  Yuming Zhou,et al.  An improved accuracy measure for rough sets , 2005, J. Comput. Syst. Sci..

[19]  Yee Leung,et al.  An uncertainty measure in partition-based fuzzy rough sets , 2005, Int. J. Gen. Syst..

[20]  Fei-Yue Wang,et al.  Reduction and axiomization of covering generalized rough sets , 2003, Inf. Sci..

[21]  Jiye Liang,et al.  A new method for measuring uncertainty and fuzziness in rough set theory , 2002, Int. J. Gen. Syst..

[22]  M. J. Wierman,et al.  MEASURING UNCERTAINTY IN ROUGH SET THEORY , 1999 .

[23]  Yiyu Yao,et al.  Relational Interpretations of Neigborhood Operators and Rough Set Approximation Operators , 1998, Inf. Sci..

[24]  D. A. Bell,et al.  Rough Computational Methods for Information , 1998, Artif. Intell..

[25]  Lin Sun,et al.  A granular computing approach to gene selection. , 2014, Bio-medical materials and engineering.

[26]  Lin Sun,et al.  Feature selection using mutual information based uncertainty measures for tumor classification. , 2014, Bio-medical materials and engineering.

[27]  Ouen Pinngern,et al.  Feature subset selection wrapper based on mutual information and rough sets , 2012, Expert Syst. Appl..

[28]  Lin Sun,et al.  Granularity Partition-based Feature Selection and Its Application in Decision Systems , 2012 .

[29]  Lin Sun,et al.  Rough Entropy-based Feature Selection and Its Application ⋆ , 2011 .

[30]  Yiyu,et al.  Notes on Rough Set Approximations and Associated Measures , 2010 .

[31]  Jing-Yu Yang,et al.  Credible rules in incomplete decision system based on descriptors , 2009, Knowl. Based Syst..

[32]  K. Thangavel,et al.  Dimensionality reduction based on rough set theory: A review , 2009, Appl. Soft Comput..

[33]  Ma Yuan-yuan.  Rules extraction method of decision tree based on new conditional entropy , 2007 .

[34]  Liu Yu-shu.  Rapid Reduction Algorithm Based on the Conditional Information Quantity , 2007 .

[35]  Liu Da-you.  Attribute reduction algorithm based on new conditional information quantity , 2007 .

[36]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[37]  Hsien-Chung Wu,et al.  Mining interesting sequential patterns for intelligent systems , 2005 .

[38]  Dai Chun-yan,et al.  A survey on rough set theory and its application , 2004 .