Entropy and co-entropy of a covering approximation space

The notions of entropy and co-entropy associated to partitions have been generalized to coverings when Pawlak's rough set theory based on partitions has been extended to covering rough sets. Unfortunately, the monotonicities of entropy and co-entropy with respect to the standard partial order on partitions do not behave well in this generalization. Taking the coverings and the covering lower and upper approximation operations into account, we introduce a novel entropy and the corresponding co-entropy in this paper. The new entropy and co-entropy exhibit the expected monotonicity, provide a measure for the fineness of the pairs of the covering lower and upper approximation operations, and induce a quasi-order relation on coverings. We illustrate the theoretical development by the first, second, and third types of covering lower and upper approximation operations.

[1]  M. J. Wierman,et al.  MEASURING UNCERTAINTY IN ROUGH SET THEORY , 1999 .

[2]  Qiaoyan Wen,et al.  Information-theoretic measures associated with rough set approximations , 2011, Inf. Sci..

[3]  E. Bryniarski.  A calculus of rough sets of the first order , 1989 .

[4]  Yiyu Yao,et al.  Probabilistic approaches to rough sets , 2003, Expert Syst. J. Knowl. Eng..

[5]  Theresa Beaubouef,et al.  Information-Theoretic Measures of Uncertainty for Rough Sets and Rough Relational Databases , 1998, Inf. Sci..

[6]  Qingguo Li,et al.  Reduction about approximation spaces of covering generalized rough sets , 2010, Int. J. Approx. Reason..

[7]  Xu Weihua,et al.  Knowledge granulation, knowledge entropy and knowledge uncertainty measure in ordered information systems , 2009 .

[8]  Jiye Liang,et al.  Knowledge structure, knowledge granulation and knowledge distance in a knowledge base , 2009, Int. J. Approx. Reason..

[9]  Janusz Zalewski,et al.  Rough sets: Theoretical aspects of reasoning about data , 1996 .

[10]  Yee Leung,et al.  Generalized fuzzy rough approximation operators based on fuzzy coverings , 2008, Int. J. Approx. Reason..

[11]  Cungen Cao,et al.  An information entropy-based approach to outlier detection in rough sets , 2010, Expert Syst. Appl..

[12]  Gianpiero Cattaneo,et al.  Entropies and Co-Entropies of Coverings with Application to Incomplete Information Systems , 2007, Fundam. Informaticae.

[13]  Jiye Liang,et al.  Information Granularity in Fuzzy Binary GrC Model , 2011, IEEE Transactions on Fuzzy Systems.

[14]  Gianpiero Cattaneo,et al.  Information Entropy and Granulation Co-Entropy of Partitions and Coverings: A Summary , 2009, Trans. Rough Sets.

[15]  Yan Gao,et al.  On Covering Rough Sets , 2007, RSKT.

[16]  Jiye Liang,et al.  Information granules and entropy theory in information systems , 2008, Science in China Series F: Information Sciences.

[17]  Yiyu,et al.  Notes on Rough Set Approximations and Associated Measures , 2010 .

[18]  Fei-Yue Wang,et al.  Relationships among three types of covering rough sets , 2006, 2006 IEEE International Conference on Granular Computing.

[19]  Jiye Liang,et al.  A new measure of uncertainty based on knowledge granulation for rough sets , 2009, Inf. Sci..

[20]  Ai Lab.  ON THE RELATIONSHIPS BETWEEN INFORMATION ENTROPY AND ROUGHNESS OF KNOWLEDGE IN ROUGH SET THEORY , 1998 .

[21]  Wen-Xiu Zhang,et al.  Knowledge granulation, knowledge entropy and knowledge uncertainty measure in ordered information systems , 2009, Appl. Soft Comput..

[22]  Sankar K. Pal,et al.  Generalized Rough Sets, Entropy, and Image Ambiguity Measures , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  Ivo Diintsch.  Uncertainty measures of rough set prediction , 2003 .

[24]  Li Zheng,et al.  Topology vs generalized rough sets , 2011, Int. J. Approx. Reason..

[25]  Wen-Xiu Zhang,et al.  Measuring roughness of generalized rough sets induced by a covering , 2007, Fuzzy Sets Syst..

[26]  A. Kusiak.  Information Entropy , 2006 .

[27]  Gianpiero Cattaneo,et al.  On Non-pointwise Entropies of Coverings: Relationship with Anti-monotonicity , 2008, RSKT.

[28]  Ping Zhu,et al.  Covering rough sets based on neighborhoods: An approach without using neighborhoods , 2009, Int. J. Approx. Reason..

[29]  Qiu Jin,et al.  On covering generalized rough set: Covering rough membership function , 2012, 2012 9th International Conference on Fuzzy Systems and Knowledge Discovery.

[30]  Qinghua Hu,et al.  Data compression with homomorphism in covering information systems , 2011, Int. J. Approx. Reason..

[31]  Urszula Wybraniec-Skardowska,et al.  Extensions and Intentions in the Ruogh Set Theory , 1998, Inf. Sci..

[32]  William Zhu,et al.  Topological approaches to covering rough sets , 2007, Inf. Sci..

[33]  William Zhu,et al.  Relationship among basic concepts in covering-based rough sets , 2009, Inf. Sci..

[34]  John B. Black,et al.  Knowledge Structures , 1986 .

[35]  Ching-Hsue Cheng,et al.  Entropy-based fuzzy rough classification approach for extracting classification rules , 2006, Expert Syst. Appl..

[36]  Jiye Liang,et al.  Information entropy, rough entropy and knowledge granulation in incomplete information systems , 2006, Int. J. Gen. Syst..

[37]  W. Li,et al.  Hybrid approaches to attribute reduction based on indiscernibility and discernibility relation , 2011, Int. J. Approx. Reason..

[38]  Jiye Liang,et al.  The Information Entropy, Rough Entropy And Knowledge Granulation In Rough Set Theory , 2004, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[39]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[40]  Faxing Wang,et al.  Rough approximations of vague sets in fuzzy approximation space , 2011, Int. J. Approx. Reason..

[41]  Yuming Zhou,et al.  An improved accuracy measure for rough sets , 2005, J. Comput. Syst. Sci..

[42]  M. E. Abd El-Monsef,et al.  Generalized rough sets , 2004 .

[43]  Yiyu Yao,et al.  Information-Theoretic Measures for Knowledge Discovery and Data Mining , 2003 .

[44]  Yiyu Yao,et al.  Two views of the theory of rough sets in finite universes , 1996, Int. J. Approx. Reason..

[45]  W. Zakowski.  APPROXIMATIONS IN THE SPACE (U,π) , 1983 .

[46]  J.W.T. Lee,et al.  On the upper approximations of covering generalized rough sets , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[47]  Charles F. Hockett,et al.  A mathematical theory of communication , 1948, MOCO.

[48]  Ping Zhu,et al.  An Axiomatic Approach to the Roughness Measure of Rough Sets , 2009, Fundam. Informaticae.

[49]  Fei-Yue Wang,et al.  Reduction and axiomization of covering generalized rough sets , 2003, Inf. Sci..

[50]  Liang Jiye,et al.  Uncertainty measures of roughness of knowledge and rough sets in incomplete information systems , 2000, Proceedings of the 3rd World Congress on Intelligent Control and Automation (Cat. No.00EX393).

[51]  Zdzisław Pawlak,et al.  Rough sets: a new approach to vagueness , 1992 .