Novel fuzzy information proximity measures

As a measure of information shared between two fuzzy pattern vectors, the fuzzy information proximity measure (FIPM) plays an important part in fuzzy pattern recognition, fuzzy clustering analysis and fuzzy approximate reasoning. In this paper, two novel FIPMs are set up. Firstly, an axiom theory about the FIPM is given, and different expressions of the FIPM are discussed. A new FIPM is then proposed based on the axiom theory of the FIPM and the concept of fuzzy subsethood function. Two concepts based on the idea of Shannon information entropy, fuzzy joint entropy (FJE) and fuzzy conditional entropy (FCE), are proposed and the basic properties of FJE and FCE are given and proved. Finally, classical similarity measures such as dissimilarity measure (DM) and similarity measure (SM) are studied, and two new measures, fuzzy absolute information measure (FAIM) and fuzzy relative information measure (FRIM), are set up, which can be used as measures of the proximity between fuzzy sets A and B.

[1]  Journal of Information Science , 1984 .

[2]  Nikhil R. Pal,et al.  Some new information measures for fuzzy sets , 1993, Inf. Sci..

[3]  Michael R. Anderberg,et al.  Cluster Analysis for Applications , 1973 .

[4]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[5]  Sergios Theodoridis,et al.  Pattern Recognition, Third Edition , 2006 .

[6]  Shi Zhongzhi,et al.  Studies on incidence pattern recognition based on information entropy , 2005, J. Inf. Sci..

[7]  Ding Shi.  Information characteristics of discrete K-L transform based on information entropy , 2003 .

[8]  Sankar K. Pal,et al.  Higher order fuzzy entropy and hybrid entropy of a set , 1992, Inf. Sci..

[9]  Bart Kosko,et al.  Fuzzy entropy and conditioning , 1986, Inf. Sci..

[10]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[11]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[12]  Settimo Termini,et al.  A Definition of a Nonprobabilistic Entropy in the Setting of Fuzzy Sets Theory , 1972, Inf. Control..

[13]  Maynard M. W. Chan.  Technical Note - System Simulation and Maximum Entropy , 1971, Oper. Res..

[14]  A. Bonaert.  Introduction to the theory of Fuzzy subsets , 1977, Proceedings of the IEEE.

[15]  靳奉祥,et al.  Information characteristics of discrete K—L transform based on information entropy , 2003 .

[16]  Zhongzhi Shi,et al.  Supervised feature extraction algorithm based on improved polynomial entropy , 2006, J. Inf. Sci..

[17]  Zhongzhi Shi,et al.  Downloaded from , 1997 .

[18]  L. Zadeh.  Probability measures of Fuzzy events , 1968 .

[19]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .