Principles of uncertainty: What are they? Why do we need them?

The meaning and utility of three principles of uncertainty is discussed. These principles, which are referred to as a principle of minimum uncertainty, a principle of maximum uncertainty, and a principle of uncertainty invariance, depend on the theory in which uncertainty is conceptualized. Due to a connection between uncertainty and information, the principles may also be conceived as principles of information. To make the principles operational in a particular uncertainty theory, we need to measure the amount of relevant uncertainty (and associated information) in each problem situation describable within the theory. Well justified measures of uncertainty have thus far been established only in some uncertainty theories. These theories, their uncertainty measures, and the associated uncertainty principles are overviewed in the paper.

[1]  D. Dubois,et al.  Fuzzy sets and statistical data , 1986 .

[2]  George J. Klir,et al.  Measure of strife in Dempster-Shafer theory , 1993 .

[3]  R. Hartley.  Transmission of information , 1928 .

[4]  G. L. S. Shackle,et al.  Decision Order and Time in Human Affairs , 1962 .

[5]  R. Christensen.  ENTROPY MINIMAX MULTIVARIATE STATISTICAL MODELING–I: THEORY , 1985 .

[6]  G. Klir,et al.  MEASURES OF UNCERTAINTY AND INFORMATION BASED ON POSSIBILITY DISTRIBUTIONS , 1982 .

[7]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[8]  G. Klir,et al.  MEASURING TOTAL UNCERTAINTY IN DEMPSTER-SHAFER THEORY: A NOVEL APPROACH , 1994 .

[9]  Ronald R. Yager,et al.  Fuzzy set and possibility theory , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[10]  George J. Klir,et al.  Fuzzy sets, uncertainty and information , 1988 .

[11]  E. T. Jaynes,et al.  Papers on probability, statistics and statistical physics , 1983 .

[12]  George J. Klir,et al.  Uncertainty in the dempster-shafer Theory - A Critical Re-examination , 1990 .

[13]  George J. Klir,et al.  A Note on the Measure of Discord , 1992, UAI.

[14]  Thomas Sudkamp,et al.  The semantics of plausibility and possibility , 1992 .

[15]  Roger C. Conant,et al.  Laws of Information which Govern Systems , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[16]  J. N. Kapur.  Maximum-entropy models in science and engineering , 1992 .

[17]  Claude E. Shannon,et al.  The mathematical theory of communication , 1950 .

[18]  A. Ramer.  Uniqueness of information measure in the theory of evidence , 1987 .

[19]  George J. Klir,et al.  Measures of discord in the Dempster-Shafer theory , 1993, Inf. Sci..

[20]  George J. Klir,et al.  DISCORD IN POSSIBILITY THEORY , 1991 .

[21]  P. Walley.  Statistical Reasoning with Imprecise Probabilities , 1990 .

[22]  H. Ichihashi,et al.  AN UNCERTAINTY MEASURE WITH MONOTONICITY UNDER THE RANDOM SET INCLUSION , 1993 .

[23]  D. Dubois,et al.  Properties of measures of information in evidence and possibility theories , 1987 .

[24]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[25]  P. M. Williams.  Bayesian Conditionalisation and the Principle of Minimum Information , 1980, The British Journal for the Philosophy of Science.

[26]  George J. Klir,et al.  On the uniqueness of possibilistic measure of uncertainty and information , 1987 .

[27]  George J. Klir,et al.  A principle of uncertainty and information invariance , 1990 .

[28]  Hidetomo Ichihashi,et al.  Maximum Entropy Algorithms for Uncertainty Measures , 1993, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[29]  Charles F. Hockett,et al.  A mathematical theory of communication , 1948, MOCO.

[30]  George J. Klir,et al.  Developments in Uncertainty-Based Information , 1993, Adv. Comput..

[31]  Ronald Christensen,et al.  ENTROPY MINIMAX MULTIVARIATE STATISTICAL MODELING—II: APPLICATIONS , 1986 .

[32]  G. Klir,et al.  PROBABILITY-POSSIBILITY TRANSFORMATIONS: A COMPARISON , 1992 .

[33]  I. Good,et al.  The Maximum Entropy Formalism. , 1979 .

[34]  D. Bell,et al.  Evidence Theory and Its Applications , 1991 .

[35]  G. Klir,et al.  Fuzzy Measure Theory , 1993 .

[36]  G. Jumarie.  Possibility‐Probability Transformation: A New Result via Information Theory of Deterministic Functions , 1994 .

[37]  D. Dubois,et al.  A NOTE ON MEASURES OF SPECIFICITY FOR FUZZY SETS , 1985 .

[38]  E. T. Jaynes,et al.  Where do we Stand on Maximum Entropy , 1979 .

[39]  Siegfried Wonneberger,et al.  Generalization of an invertible mapping between probability and possibility , 1994 .