Generalized information theory for hints

This paper develops a new uncertainty measure for the theory of hints that complies with the established semantics of statistical information theory and further satisfies all classical requirements for such a measure imposed in the literature. The proposed functional decomposes into conversant uncertainty measures and therefore discloses a new interpretation of the latters as well. By abstracting to equivalence classes of hints we transport the new measure to mass functions in Dempster-Shafer theory and analyse its relationship with the aggregate uncertainty, which currently is the only known functional for the Dempster-Shafer theory of evidence that satisfies the same set of properties. Moreover, the perspective of hints reveals that the standard independence notion in Dempster-Shafer theory called non-interactivity corresponds to an amalgamation of probabilistic independence and qualitative independence between frames of discernment. All results in this paper are developed for arbitrary families of compatible frames generalizing the very specialized multi-variate systems that are usually studied in information theory.

[1]  Jürg Kohlas,et al.  Information Algebra , 2009, Wiley Encyclopedia of Computer Science and Engineering.

[2]  Jürg Kohlas,et al.  Model-Based Diagnostics and Probabilistic Assumption-Based Reasoning , 1998, Artif. Intell..

[3]  P. Monney.  A Mathematical Theory of Arguments for Statistical Evidence , 2002 .

[4]  G. Klir,et al.  MEASURING TOTAL UNCERTAINTY IN DEMPSTER-SHAFER THEORY: A NOVEL APPROACH , 1994 .

[5]  George J. Klir,et al.  Measures of uncertainty for imprecise probabilities: An axiomatic approach , 2010, Int. J. Approx. Reason..

[6]  Éloi Bossé,et al.  Measuring ambiguity in the evidence theory , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[7]  Alex M. Andrew,et al.  Uncertainty and Information: Foundations of Generalized Information Theory , 2006 .

[8]  J. Kohlas,et al.  A Mathematical Theory of Hints: An Approach to the Dempster-Shafer Theory of Evidence , 1995 .

[9]  Jürg Kohlas,et al.  Algorithms for uncertainty and defeasible reasoning , 2000 .

[10]  Jürg Kohlas,et al.  A Mathematical Theory of Hints , 1995 .

[11]  George J. Klir,et al.  Remarks on “Measuring Ambiguity in the Evidence Theory” , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[12]  Ewa Orlowska.  Information Algebras , 1995, AMAST.

[13]  Alfréd Rényi,et al.  Probability Theory , 1970 .

[14]  Marc Pouly,et al.  Generic Inference: A Unifying Theory for Automated Reasoning , 2011 .

[15]  Nic Wilson.  Algorithms for Dempster-Shafer Theory , 2000 .

[16]  G. Klir,et al.  MEASURES OF UNCERTAINTY AND INFORMATION BASED ON POSSIBILITY DISTRIBUTIONS , 1982 .

[17]  D. Dubois,et al.  A NOTE ON MEASURES OF SPECIFICITY FOR FUZZY SETS , 1985 .

[18]  S. K. Michael Wong,et al.  Upper and Lower Entropies of Belief Functions Using Compatible Probability Functions , 1993, ISMIS.

[19]  G. Grätzer.  General Lattice Theory , 1978 .

[20]  A. Ramer.  Uniqueness of information measure in the theory of evidence , 1987 .

[21]  G. Klir,et al.  ON THE COMPUTATION OF UNCERTAINTY MEASURE IN DEMPSTER-SHAFER THEORY , 1996 .

[22]  Marc Pouly.  Generalized Information Theory Based on the Theory of Hints , 2011, ECSQARU.

[23]  Joseph Y. Halpern.  Reasoning about uncertainty , 2003 .

[24]  David Harmanec.  Toward a Characterization of Uncertainty Measure for the Dempster-Shafer Theory , 1995, UAI.

[25]  Serafín Moral,et al.  An Algorithm to Compute the Upper Entropy for Order-2 Capacities , 2006, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[26]  Leo Egghe,et al.  Uncertainty and information: Foundations of generalized information theory , 2007, J. Assoc. Inf. Sci. Technol..

[27]  Arthur P. Dempster,et al.  A Generalization of Bayesian Inference , 1968, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[28]  G. Klir.  Measure of Uncertainty and Information , 2006 .

[29]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[30]  Philippe Smets,et al.  The Transferable Belief Model , 1991, Artif. Intell..

[31]  Jürg Kohlas.  Information algebras - generic structures for inference , 2003, Discrete mathematics and theoretical computer science.

[32]  Fred Richman,et al.  Calculating Maximum-Entropy Probability densities for Belief Functions , 1994, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[33]  H. Ichihashi,et al.  AN UNCERTAINTY MEASURE WITH MONOTONICITY UNDER THE RANDOM SET INCLUSION , 1993 .