MEASURES OF UNCERTAINTY AND INFORMATION BASED ON POSSIBILITY DISTRIBUTIONS

Abstract A measure of uncertainly and information for possibility theory is introduced in this paper The measure is called the U-uncertainty or, alternatively, the U-information. Due to its properties, the U-uncertainty/information can be viewed as a possibilistic counterpart or the Shannon entropy and, at the same time, a generalization or the Hartley uncertainty/information. A conditional U-uncertainty is also derived in this paper, it depends on the U-uncertainties or the joint and marginal possibility distributions in exactly the same way as the conditional Shannon entropy depends on the entropies or the joint and marginal probability distributions. The conditional U-uncertainty is derived without the use of the notion of conditional possibilities, thus avoiding a current controversy in possibility theory. The proposed measures of U-uncertainty and conditional U-uncertainty provide a foundation for developing an alternative theory of information, one based on possibility theory rather than probability...

[1]  R. Hartley Transmission of information , 1928 .

[2]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[3]  L. Brillouin,et al.  Science and information theory , 1956 .

[4]  A. N. Kolmogorov,et al.  Foundations of the theory of probability , 1960 .

[5]  Michael Satosi Watanabe,et al.  Information Theoretical Analysis of Multivariate Correlation , 1960, IBM J. Res. Dev..

[6]  A. Rényi On Measures of Entropy and Information , 1961 .

[7]  C. Cherry,et al.  On human communication , 1966 .

[8]  A. Kolmogorov Three approaches to the quantitative definition of information , 1968 .

[9]  Satosi Watanabe,et al.  Knowing and guessing , 1969 .

[10]  Zoltán Daróczy,et al.  Generalized Information Functions , 1970, Inf. Control..

[11]  Roger C. Conant,et al.  MEASURING THE STRENGTH OF INTERVARIABLE RELATIONS , 1973 .

[12]  C. T. Ng,et al.  Why the Shannon and Hartley entropies are ‘natural’ , 1974, Advances in Applied Probability.

[13]  A Review of: “TRENDS IN GENERAL SYSTEMS THEORY”, Edited by George J. Klir. John Wiley, New York, 1972, 462 pp. , 1974 .

[14]  George J. Klir,et al.  ON THE REPRESENTATION OF ACTIVITY ARRAYS , 1975 .

[15]  Roger C. Conant,et al.  Laws of Information which Govern Systems , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[16]  George J. Klir,et al.  A conceptual foundation for systems problem solving , 1978 .

[17]  Hung T. Nguyen,et al.  On conditional possibility distributions , 1978 .

[18]  Gerrit Broekstra On the representation and identification of structure systems , 1978 .

[19]  Lotfi A. Zadeh,et al.  PRUF—a meaning representation language for natural languages , 1978 .

[20]  E. Hisdal Conditional possibilities independence and noninteraction , 1978 .

[21]  E. T. Jaynes,et al.  Where do we Stand on Maximum Entropy , 1979 .

[22]  Hung Nguyen Toward a calculus of the mathematical notion of possibility , 1979, 1979 18th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[23]  Dick E. Boekee,et al.  The R-Norm Information Measure , 1980, Inf. Control..

[24]  Roger C. Conant Structural modelling using a simple information measure , 1980 .

[25]  Didier Dubois,et al.  Fuzzy sets and systems ' . Theory and applications , 2007 .

[26]  Ronald R. Yager Aspects of possibilistic uncertainty , 1980 .

[27]  Rodney W. Johnson,et al.  Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy , 1980, IEEE Trans. Inf. Theory.

[28]  Ronald R. Yager A Foundation for a Theory of Possibility , 1980, Cybern. Syst..

[29]  Satosi Watanabe,et al.  Pattern recognition as a quest for minimum entropy , 1981, Pattern Recognit..

[30]  G. Klir,et al.  Reconstruction of possibilistic behavior systems , 1982 .

[31]  M. Puri,et al.  A possibility measure is not a fuzzy measure , 1982 .

[32]  R. Yager MEASURING TRANQUILITY AND ANXIETY IN DECISION MAKING: AN APPLICATION OF FUZZY SETS , 1982 .