Maximum of Entropy for Belief Intervals Under Evidence Theory

The Dempster-Shafer Theory (DST) or Evidence Theory has been commonly used to deal with uncertainty. It is based on the basic probability assignment concept (BPA). The upper entropy on the credal set associated with a BPA is the only uncertainty measure in DST that verifies all the necessary mathematical properties and behaviors. Nonetheless, its computation is notably complex. For this reason, many alternatives to this measure have been recently proposed, but they do not satisfy most of the mathematical requirements and present some undesirable behaviors. Belief intervals have been frequently employed to quantify uncertainty in DST in the last years, and they can represent the uncertainty-based-information better than a BPA. In this research, we develop a new uncertainty measure that consists of the maximum of entropy on the credal set corresponding to belief intervals for singletons. It verifies all the crucial mathematical requirements and presents good behavior, solving most of the shortcomings found in uncertainty measures proposed recently. Moreover, its calculation is notably easier than the upper entropy on the credal set associated with the BPA. Therefore, our proposed uncertainty measure is more suitable to be used in practical applications.

[1]  Frans Voorbraak,et al.  A Computationally Efficient Approximation of Dempster-Shafer Theory , 1988, Int. J. Man Mach. Stud..

[2]  Xiaoyang Li,et al.  A Novel Belief Entropy for Measuring Uncertainty in Dempster-Shafer Evidence Theory Framework Based on Plausibility Transformation and Weighted Hartley Entropy , 2019, Entropy.

[3]  Serafín Moral,et al.  Difference of entropies as a non-specificity function on credal sets† , 2005, Int. J. Gen. Syst..

[4]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[5]  Dennis M. Buede,et al.  A target identification comparison of Bayesian and Dempster-Shafer multisensor fusion , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[6]  Asghar Shahpari,et al.  Using Mutual Aggregate Uncertainty Measures in a Threat Assessment Problem Constructed by Dempster–Shafer Network , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[7]  G. Klir,et al.  MEASURING TOTAL UNCERTAINTY IN DEMPSTER-SHAFER THEORY: A NOVEL APPROACH , 1994 .

[8]  Prakash P. Shenoy,et al.  On the plausibility transformation method for translating belief function models to probability models , 2006, Int. J. Approx. Reason..

[9]  Jing Zhao,et al.  Belief intervals aggregation , 2018, Int. J. Intell. Syst..

[10]  Hidetomo Ichihashi,et al.  Maximum Entropy Algorithms for Uncertainty Measures , 1993, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[11]  Luis M. de Campos,et al.  Probability Intervals: a Tool for uncertain Reasoning , 1994, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[12]  Serafín Moral,et al.  Maximum of Entropy for Credal Sets , 2003, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[13]  Ronald R. Yager,et al.  Entropy and Specificity in a Mathematical Theory of Evidence , 2008, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[14]  Qing Liu,et al.  An Improved Deng Entropy and Its Application in Pattern Recognition , 2019, IEEE Access.

[15]  P. Walley,et al.  A survey of concepts of independence for imprecise probabilities , 2000 .

[16]  Prem K. Goel,et al.  Bayesian Analysis in Statistics and Econometrics , 1992 .

[17]  Arthur P. Dempster,et al.  Upper and Lower Probabilities Induced by a Multivalued Mapping , 1967, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[18]  Andrés R. Masegosa,et al.  Requirements for total uncertainty measures in Dempster–Shafer theory of evidence , 2008, Int. J. Gen. Syst..

[19]  Xinyang Deng,et al.  Analyzing the monotonicity of belief interval based uncertainty measures in belief function theory , 2017, Int. J. Intell. Syst..

[20]  Fred Richman,et al.  Calculating Maximum-Entropy Probability densities for Belief Functions , 1994, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[21]  Serafín Moral,et al.  A Non-Specificity Measure for Convex Sets of Probability Distributions , 2000, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[22]  G. Klir,et al.  Uncertainty-based information: Elements of generalized information theory (studies in fuzziness and soft computing). , 1998 .

[23]  Horace Ho-Shing Ip,et al.  Human face recognition using Dempster-Shafer theory , 1994, Proceedings of 1st International Conference on Image Processing.

[24]  Deqiang Han,et al.  A new non-specificity measure in evidence theory based on belief intervals , 2016 .

[25]  Van-Nam Huynh,et al.  Notes on “Reducing Algorithm Complexity for Computing an Aggregate Uncertainty Measure” , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[26]  D. Dubois,et al.  A NOTE ON MEASURES OF SPECIFICITY FOR FUZZY SETS , 1985 .

[27]  Prakash P. Shenoy,et al.  A new definition of entropy of belief functions in the Dempster-Shafer theory , 2018, Int. J. Approx. Reason..

[28]  George J. Klir,et al.  Disaggregated total uncertainty measure for credal sets , 2006, Int. J. Gen. Syst..

[29]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[30]  Éloi Bossé,et al.  Measuring ambiguity in the evidence theory , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[31]  Eloi Bosse,et al.  Critique of Recent Uncertainty Measures Developed Under the Evidence Theory and Belief Intervals , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[32]  Éloi Bossé,et al.  Drawbacks of Uncertainty Measures Based on the Pignistic Transformation , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[33]  Ruonan Zhu,et al.  Power Law and Dimension of the Maximum Value for Belief Distribution With the Maximum Deng Entropy , 2018, IEEE Access.

[34]  E. Jaynes.  On the rationale of maximum-entropy methods , 1982, Proceedings of the IEEE.

[35]  Yong Deng,et al.  The Maximum Deng Entropy , 2015, IEEE Access.

[36]  Liguo Fei,et al.  An Improved Belief Entropy to Measure Uncertainty of Basic Probability Assignments Based on Deng Entropy and Belief Interval , 2019, Entropy.

[37]  Thierry Denoeux,et al.  A k-nearest neighbor classification rule based on Dempster-Shafer theory , 1995, IEEE Trans. Syst. Man Cybern..

[38]  Joaquín Abellán,et al.  Analyzing properties of Deng entropy in the theory of evidence , 2017 .

[40]  M. Beynon,et al.  The Dempster-Shafer theory of evidence: an alternative approach to multicriteria decision modelling , 2000 .