Uncertainty measures on probability intervals from the imprecise Dirichlet model

When we use a mathematical model to represent information, we can obtain a closed and convex set of probability distributions, also called a credal set. This type of representation involves two types of uncertainty called conflict (or randomness) and non-specificity, respectively. The imprecise Dirichlet model (IDM) allows us to carry out inference about the probability distribution of a categorical variable obtaining a set of a special type of credal set (probability intervals). In this paper, we shall present tools for obtaining the uncertainty functions on probability intervals obtained with the IDM, which can enable these functions in any application of this model to be calculated.

[1]  Michel GRABISCH,et al.  The Interaction and Möbius Representations of Fuzzy Measures on Finite Spaces, -Additive Measures: A Survey , 2022 .

[2]  George J. Klir,et al.  Disaggregated total uncertainty measure for credal sets , 2006, Int. J. Gen. Syst..

[3]  Arthur P. Dempster,et al.  Upper and Lower Probabilities Induced by a Multivalued Mapping , 1967, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[4]  G. Klir,et al.  Fuzzy Measure Theory , 1993 .

[5]  Serafín Moral,et al.  An Algorithm to Compute the Upper Entropy for Order-2 Capacities , 2006, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[6]  Terrence L. Fine,et al.  Lower probability models for uncertainty and nondeterministic processes , 1988 .

[7]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[8]  R. Hartley.  Transmission of information , 1928 .

[9]  G. Klir,et al.  MEASURES OF UNCERTAINTY AND INFORMATION BASED ON POSSIBILITY DISTRIBUTIONS , 1982 .

[10]  Ronald R. Yager,et al.  Entropy and Specificity in a Mathematical Theory of Evidence , 2008, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[11]  G. Klir,et al.  ON THE COMPUTATION OF UNCERTAINTY MEASURE IN DEMPSTER-SHAFER THEORY , 1996 .

[12]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[13]  P. Walley.  Inferences from Multinomial Data: Learning About a Bag of Marbles , 1996 .

[14]  Alex M. Andrew,et al.  Uncertainty and Information: Foundations of Generalized Information Theory , 2006 .

[15]  Henry E. Kyburg,et al.  Bayesian and Non-Bayesian Evidential Updating , 1987, Artificial Intelligence.

[16]  G. Choquet.  Theory of capacities , 1954 .

[17]  Serafín Moral,et al.  Difference of entropies as a non-specificity function on credal sets† , 2005, Int. J. Gen. Syst..

[18]  P. Walley.  Statistical Reasoning with Imprecise Probabilities , 1990 .

[19]  G. Klir,et al.  Uncertainty-based information: Elements of generalized information theory (studies in fuzziness and soft computing). , 1998 .

[20]  Marco Zaffalon.  A Credal Approach to Naive Classification , 1999, ISIPTA.

[21]  Alain Chateauneuf,et al.  Some Characterizations of Lower Probabilities and Other Monotone Capacities through the use of Möbius Inversion , 1989, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[22]  Serafín Moral,et al.  Building classification trees using the total uncertainty criterion , 2003, Int. J. Intell. Syst..

[23]  James O. Berger,et al.  An overview of robust Bayesian analysis , 1994 .

[24]  Serafín Moral,et al.  Upper entropy of credal sets. Applications to credal classification , 2005, Int. J. Approx. Reason..

[25]  J. Benzecri,et al.  Théorie des capacités , 1956 .

[26]  Kurt Weichselberger,et al.  A Methodology for Uncertainty in Knowledge-Based Systems , 1990, Lecture Notes in Computer Science.

[27]  George J. Klir,et al.  On Measuring Uncertainty and Uncertainty-Based Information: Recent Developments , 2001, Annals of Mathematics and Artificial Intelligence.

[28]  Irving John Good,et al.  Subjective Probability as the Measure of a Non-measurable Set , 1962 .

[29]  G. Cooman.  POSSIBILITY THEORY I: THE MEASURE- AND INTEGRAL-THEORETIC GROUNDWORK , 1997 .

[30]  I. Molchanov.  Theory of Random Sets , 2005 .

[31]  Fred Richman,et al.  Calculating Maximum-Entropy Probability densities for Belief Functions , 1994, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[32]  Jagat Narain Kapur,et al.  Measures of information and their applications , 1994 .

[33]  Serafín Moral,et al.  A Non-Specificity Measure for Convex Sets of Probability Distributions , 2000, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[34]  L. M. D. C. Ibáñez,et al.  Representation of fuzzy measures through probabilities , 1989 .

[35]  Prem K. Goel,et al.  Bayesian Analysis in Statistics and Econometrics , 1992 .

[36]  Jean-Marc Bernard,et al.  An introduction to the imprecise Dirichlet model for multinomial data , 2005, Int. J. Approx. Reason..

[37]  D. Dubois,et al.  A NOTE ON MEASURES OF SPECIFICITY FOR FUZZY SETS , 1985 .

[38]  Serafín Moral,et al.  Maximum of Entropy for Credal Sets , 2003, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[39]  Isaac Levi,et al.  The Enterprise Of Knowledge , 1980 .

[40]  G. Klir,et al.  MEASURING TOTAL UNCERTAINTY IN DEMPSTER-SHAFER THEORY: A NOVEL APPROACH , 1994 .

[41]  George Baciu,et al.  The MinMax information measure , 1995 .

[42]  Luis M. de Campos,et al.  Probability Intervals: a Tool for uncertain Reasoning , 1994, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[43]  George J. Klir,et al.  On the uniqueness of possibilistic measure of uncertainty and information , 1987 .

[44]  A. Ramer.  Uniqueness of information measure in the theory of evidence , 1987 .