Uncertainty measurement for interval-valued decision systems based on extended conditional entropy

Uncertainty measures can supply new points of view for analyzing data and help us to disclose the substantive characteristics of data sets. Some uncertainty measures for single-valued information systems or single-valued decision systems have been developed. However, there are few studies on the uncertainty measurement for interval-valued information systems or interval-valued decision systems. This paper addresses the uncertainty measurement problem in interval-valued decision systems. An extended conditional entropy is proposed in interval-valued decision systems based on possible degree between interval values. Consequently, a concept called rough decision entropy is introduced to evaluate the uncertainty of an interval-valued decision system. Besides, the original approximation accuracy measure proposed by Pawlak is extended to deal with interval-valued decision systems and the concept of interval approximation roughness is presented. Experimental results demonstrate that the rough decision entropy measure and the interval approximation roughness measure are effective and valid for evaluating the uncertainty measurement of interval-valued decision systems. Experimental results also indicate that the rough decision entropy measure outperforms the interval approximation roughness measure.

[1]  Qingsheng Zhu,et al.  Finding key attribute subset in dataset for outlier detection , 2011, Knowl. Based Syst..

[2]  Witold Pedrycz,et al.  Positive approximation: An accelerator for attribute reduction in rough set theory , 2010, Artif. Intell..

[3]  Jiye Liang,et al.  Interval ordered information systems , 2008, Comput. Math. Appl..

[4]  Yiyu Yao,et al.  Comparison of Rough-Set and Interval-Set Models for Uncertain Reasoning , 1996, Fundam. Informaticae.

[5]  Yuhua Qian,et al.  Test-cost-sensitive attribute reduction , 2011, Inf. Sci..

[6]  Ramon E. Moore,et al.  Methods and Applications of Interval Analysis (SIAM Studies in Applied and Numerical Mathematics) (Siam Studies in Applied Mathematics, 2.) , 1979 .

[7]  Yozo Nakahara,et al.  On the linear programming problems with interval coefficients , 1992 .

[8]  Ivo Diintsch Uncertainty measures of rough set prediction , 2003 .

[9]  S. K. Michael Wong,et al.  Rough Sets: Probabilistic versus Deterministic Approach , 1988, Int. J. Man Mach. Stud..

[10]  Jiye Liang,et al.  Information entropy, rough entropy and knowledge granulation in incomplete information systems , 2006, Int. J. Gen. Syst..

[11]  Qiang Wu,et al.  Real formal concept analysis based on grey-rough set theory , 2009, Knowl. Based Syst..

[12]  Jiye Liang,et al.  The Information Entropy, Rough Entropy And Knowledge Granulation In Rough Set Theory , 2004, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[13]  Jemal H. Abawajy,et al.  A rough set approach for selecting clustering attribute , 2010, Knowl. Based Syst..

[14]  Manfred M. Fischer,et al.  A Rough Set Approach for the Discovery of Classification Rules in Interval-Valued Information Systems , 2008, Int. J. Approx. Reason..

[15]  Gwo-Hshiung Tzeng,et al.  An integration method combining Rough Set Theory with formal concept analysis for personal investment portfolios , 2010, Knowl. Based Syst..

[16]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[17]  A. Kusiak Information Entropy , 2006 .

[18]  Jiye Liang,et al.  A new method for measuring uncertainty and fuzziness in rough set theory , 2002, Int. J. Gen. Syst..

[19]  Yiyu Yao,et al.  A Generalized Decision Logic in Interval-Set-Valued Information Tables , 1999, RSFDGrC.

[20]  Theresa Beaubouef,et al.  Information-Theoretic Measures of Uncertainty for Rough Sets and Rough Relational Databases , 1998, Inf. Sci..

[21]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[22]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[23]  Jiye Liang,et al.  Information Granularity in Fuzzy Binary GrC Model , 2011, IEEE Transactions on Fuzzy Systems.

[24]  Jiye Liang,et al.  A new measure of uncertainty based on knowledge granulation for rough sets , 2009, Inf. Sci..

[25]  Jiye Liang,et al.  Knowledge structure, knowledge granulation and knowledge distance in a knowledge base , 2009, Int. J. Approx. Reason..

[26]  Jiye Liang,et al.  Combination Entropy and Combination Granulation in Rough Set Theory , 2008, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[27]  Liang,et al.  Information Measures of Roughness of Knowledge and Rough Sets for Incomplete Information Systems , 2001 .

[28]  Jing-Yu Yang,et al.  Dominance-based rough set approach to incomplete interval-valued information system , 2009, Data Knowl. Eng..

[29]  Yiyu Yao,et al.  On Information-Theoretic Measures of Attribute Importance , 1999, PAKDD.

[30]  M. J. Wierman,et al.  MEASURING UNCERTAINTY IN ROUGH SET THEORY , 1999 .