Distances in evidence theory: Comprehensive survey and generalizations

The purpose of the present work is to survey the dissimilarity measures defined so far in the mathematical framework of evidence theory, and to propose a classification of these measures based on their formal properties. This research is motivated by the fact that while dissimilarity measures have been widely studied and surveyed in the fields of probability theory and fuzzy set theory, no comprehensive survey is yet available for evidence theory. The main results presented herein include a synthesis of the properties of the measures defined so far in the scientific literature; the generalizations proposed naturally lead to additions to the body of the previously known measures, leading to the definition of numerous new measures. Building on this analysis, we have highlighted the fact that Dempster's conflict cannot be considered as a genuine dissimilarity measure between two belief functions and have proposed an alternative based on a cosine function. Other original results include the justification of the use of two-dimensional indexes as (cosine; distance) couples and a general formulation for this class of new indexes. We base our exposition on a geometrical interpretation of evidence theory and show that most of the dissimilarity measures so far published are based on inner products, in some cases degenerated. Experimental results based on Monte Carlo simulations illustrate interesting relationships between existing measures.

[1]  Ronald P. S. Mahler Combining ambiguous evidence with respect to ambiguous a priori knowledge. I. Boolean logic , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[2]  G. Klir Uncertainty and Information: Foundations of Generalized Information Theory , 2005 .

[3]  Christophe Osswald,et al.  Conflict measure for the discounting operation on belief functions , 2008, 2008 11th International Conference on Information Fusion.

[4]  Philippe Smets,et al.  Analyzing the combination of conflicting belief functions , 2007, Inf. Fusion.

[5]  A. Tversky,et al.  Additive similarity trees , 1977 .

[6]  Thierry Denoeux,et al.  Refined modeling of sensor reliability in the belief function framework using contextual discounting , 2008, Inf. Fusion.

[7]  Thierry Denœux,et al.  Inner and outer approximation of belief structures using a hierarchical clustering approach , 2001 .

[8]  Arthur P. Dempster,et al.  Upper and Lower Probabilities Induced by a Multivalued Mapping , 1967, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[9]  Dong Wang,et al.  An improved combination rule in fault diagnosis based on dempster shafer theory , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[10]  A. Tversky Features of Similarity , 1977 .

[11]  G. Matheron Random Sets and Integral Geometry , 1976 .

[12]  Joaquín Abellán,et al.  Measures of divergence on credal sets , 2006, Fuzzy Sets Syst..

[13]  G. Klir,et al.  Uncertainty-based information: Elements of generalized information theory (studies in fuzziness and soft computing). , 1998 .

[14]  Chenglin Wen,et al.  Fuzzy Information Fusion Algorithm of Fault Diagnosis Based on Similarity Measure of Evidence , 2008, ISNN.

[15]  Thierry Denoeux,et al.  Nonparametric regression analysis of uncertain and imprecise data using belief functions , 2004, Int. J. Approx. Reason..

[16]  Olivier Colot,et al.  Automatic discounting rate computation using a dissent criterion , 2010 .

[17]  Éloi Bossé,et al.  A new distance between two bodies of evidence , 2001, Inf. Fusion.

[18]  Serafín Moral,et al.  Distances between fuzzy measures through associated probabilities: some applications , 1990 .

[19]  Weiru Liu,et al.  Analyzing the degree of conflict among belief functions , 2006, Artif. Intell..

[20]  Johan Schubert Clustering decomposed belief functions using generalized weights of conflict , 2008, Int. J. Approx. Reason..

[21]  Qing Ye,et al.  An approach for evidence clustering using generalized distance , 2009 .

[22]  Shi Wen-kang,et al.  A new fusion approach based on distance of evidences , 2005 .

[23]  Fabio Cuzzolin Two New Bayesian Approximations of Belief Functions Based on Convex Geometry , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Fabio Cuzzolin,et al.  A Geometric Approach to the Theory of Evidence , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[25]  Isabelle Bloch,et al.  On fuzzy distances and their use in image processing under imprecision , 1999, Pattern Recognit..

[26]  M. K. Luhandjula Studies in Fuzziness and Soft Computing , 2013 .

[27]  Mathias Bauer,et al.  Approximation algorithms and decision making in the Dempster-Shafer theory of evidence - An empirical study , 1997, Int. J. Approx. Reason..

[28]  Ronald P. S. Mahler,et al.  The modified Dempster-Shafer approach to classification , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[29]  You He,et al.  Research on conflicting evidences combination strategy , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[30]  Philippe Smets,et al.  The Transferable Belief Model , 1994, Artif. Intell..

[31]  Samuel S. Blackman,et al.  Design and Analysis of Modern Tracking Systems , 1999 .

[32]  Harry E. Stephanou,et al.  Measuring Consensus Effectiveness by a Generalized Entropy Criterion , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Thierry Denoeux,et al.  EVCLUS: evidential clustering of proximity data , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  Didier Dubois,et al.  Consonant approximations of belief functions , 1990, Int. J. Approx. Reason..

[35]  Thierry Denoeux,et al.  A neural network classifier based on Dempster-Shafer theory , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[36]  George J. Klir,et al.  Uncertainty-Based Information , 1999 .

[37]  Anne-Laure Jousselme,et al.  A proof for the positive definiteness of the Jaccard index matrix , 2013, Int. J. Approx. Reason..

[38]  M. Masson,et al.  Pairwise classifier combination in the transferable belief model , 2005, 2005 7th International Conference on Information Fusion.

[39]  Thierry Denoeux,et al.  An evidence-theoretic k-NN rule with parameter optimization , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[40]  Fabio Cuzzolin Geometry of Dempster's rule of combination , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[41]  David Harmanec,et al.  Faithful Approximations of Belief Functions , 1999, UAI.

[42]  A. D. Gordon Constructing dissimilarity measures , 1990 .

[43]  T. Denœux Conjunctive and disjunctive combination of belief functions induced by nondistinct bodies of evidence , 2008 .

[44]  Malcolm James Beynon,et al.  The Role of the DS/AHP in Identifying Inter-Group Alliances and Majority Rule Within Group Decision Making , 2006 .

[45]  Bjørnar Tessem,et al.  Approximations for Efficient Computation in the Theory of Evidence , 1993, Artif. Intell..

[46]  Khaled Mellouli,et al.  Clustering Approach Using Belief Function Theory , 2006, AIMSA.

[47]  Bernadette Bouchon-Meunier,et al.  A Similarity Measure between Basic Belief Assignments , 2006, 2006 9th International Conference on Information Fusion.

[48]  Sung-Hyuk Cha Comprehensive Survey on Distance/Similarity Measures between Probability Density Functions , 2007 .

[49]  Thierry Denoeux,et al.  The Unnormalized Dempster’s Rule of Combination: A New Justification from the Least Commitment Principle and Some Extensions , 2010, Journal of Automated Reasoning.

[50]  Thierry Denoeux,et al.  Approximating the combination of belief functions using the fast Mo"bius transform in a coarsened frame , 2002, Int. J. Approx. Reason..

[51]  Harry E. Stephanou,et al.  Belief function divergence as a classifier , 1991, Proceedings of the 1991 IEEE International Symposium on Intelligent Control.

[52]  Éloi Bossé,et al.  Dynamic estimation of evidence discounting rates based on information credibility , 2010, RAIRO Oper. Res..

[53]  M. Basseville Distance measures for signal processing and pattern recognition , 1989 .

[54]  Branko Ristic,et al.  The TBM global distance measure for the association of uncertain combat ID declarations , 2006, Inf. Fusion.

[55]  Fabio Cuzzolin,et al.  $L_{p}$ Consonant Approximations of Belief Functions , 2014, IEEE Transactions on Fuzzy Systems.