Theory of evidence — A survey of its mathematical foundations, applications and computational aspects

The mathematical theory of evidence has been introduced by Glenn Shafer in 1976 as a new approach to the representation of uncertainty. This theory can be represented under several distinct but more or less equivalent forms. Probabilistic interpretations of evidence theory have their roots in Arthur Dempster's multivalued mappings of probability spaces. This leads to random set and more generally to random filter models of evidence. In this probabilistic view evidence is seen as more or less probable arguments for certain hypotheses and they can be used to support those hypotheses to certain degrees. These degrees of support are in fact the reliabilities with which the hypotheses can be derived from the evidence. Alternatively, the mathematical theory of evidence can be founded axiomatically on the notion of belief functions or on the allocation of belief masses to subsets of a frame of discernment. These approaches aim to present evidence theory as an extension of probability theory. Evidence theory has been used to represent uncertainty in expert systems, especially in the domain of diagnostics. It can be applied to decision analysis and it gives a new perspective for statistical analysis. Among its further applications are image processing, project planning and scheduling and risk analysis. The computational problems of evidence theory are well understood and even though the problem is complex, efficient methods are available.

[1]  D. Dubois,et al.  A set-theoretic view of belief functions: Logical operations and approximations by fuzzy sets , 1986 .

[2]  Edward H. Shortliffe,et al.  A Method for Managing Evidential Reasoning in a Hierarchical Hypothesis Space , 1985, Artif. Intell..

[3]  Gregory M. Provan.  Solving Diagnostic Problems Using Extended Truth Maintenance Systems , 1988, ECAI.

[4]  Alessandro Saffiotti.  A Hybrid Belief System for Doubtful Agents , 1990, IPMU.

[5]  J. Jaffray.  Linear utility theory for belief functions , 1989 .

[6]  J. Jaffray,et al.  Decision making with belief functions: Compatibility and incompatibility with the sure-thing principle , 1993 .

[7]  P. Smets.  Medical diagnosis: Fuzzy sets and degrees of belief , 1981 .

[8]  Robert E. Tarjan,et al.  Simple Linear-Time Algorithms to Test Chordality of Graphs, Test Acyclicity of Hypergraphs, and Selectively Reduce Acyclic Hypergraphs , 1984, SIAM J. Comput..

[9]  Jürg Kohlas.  Describing Uncertainty in Dynamical Systems by Uncertain Restrictions , 1991 .

[10]  J. Kacprzyk,et al.  Advances in the Dempster-Shafer theory of evidence , 1994 .

[11]  Ronald Fagin,et al.  Uncertainty, belief, and probability 1 , 1991, IJCAI.

[12]  Hung T. Nguyen,et al.  On dynamics of cautious belief and conditional objects , 1993, Int. J. Approx. Reason..

[13]  P. Halmos.  Lectures on Boolean Algebras , 1963 .

[14]  Ronald R. Yager,et al.  Uncertainty in Knowledge Bases , 1990, Lecture Notes in Computer Science.

[15]  Robert Kennes,et al.  Computational aspects of the Mobius transformation of graphs , 1992, IEEE Trans. Syst. Man Cybern..

[16]  Jürg Kohlas,et al.  Propagating Belief Functions Through Constraint Systems , 1990, IPMU.

[17]  Frank Klawonn,et al.  The Dynamic of Belief in the Transferable Belief Model and Specialization-Generalization Matrices , 1992, UAI.

[18]  Khaled Mellouli,et al.  On the propagation of beliefs in networks using the Dempster-Shafer theory of evidence , 1987 .

[19]  Kathryn B. Laskey,et al.  Belief Maintenance: An Integrated Approach to Uncertainty Management , 1988, AAAI.

[20]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[21]  Philippe Smets,et al.  Constructing the Pignistic Probability Function in a Context of Uncertainty , 1989, UAI.

[22]  Mario Stefanelli,et al.  Contribution to the discussion of the paper by Steffen L. Lauritzen and David Spiegelhalter: "Local Computations with Probabilities on Graphical Structures and their Application to Expert Systems" , 1988 .

[23]  J. Kohlas.  Modeling uncertainty with belief functions in numerical models , 1989 .

[24]  Rudolf Kruse,et al.  Symbolic and Quantitative Approaches to Uncertainty , 1991, Lecture Notes in Computer Science.

[25]  D. Fraser.  The Structure of Inference. , 1969 .

[26]  Jean-Yves Jaffray,et al.  Dynamic Decision Making with Belief Functions , 1992 .

[27]  Peter C. Fishburn,et al.  Utility theory for decision making , 1970 .

[28]  John Lawrence,et al.  Automating argument construction , 1988 .

[29]  Alessandro Saffiotti.  Using Dempster-Shafer theory in knowledge representation , 1990, UAI.

[30]  J. Dekleer.  An assumption-based TMS , 1986 .

[31]  Raymond Reiter,et al.  Foundations of Assumption-based Truth Maintenance Systems: Preliminary Report , 1987, AAAI.

[32]  Jürg Kohlas,et al.  Probabilistic Assumption-Based Reasoning , 1993, UAI.

[33]  John D. Lowrance,et al.  A Framework for Evidential-Reasoning Systems , 1990, AAAI.

[34]  Rudolf Kruse,et al.  Uncertainty and Vagueness in Knowledge Based Systems , 1991, Artificial Intelligence.

[35]  Glenn Shafer,et al.  Readings in Uncertain Reasoning , 1990 .

[36]  Smets Ph.,et al.  Belief functions, Non-standard logics for automated reasoning , 1988 .

[37]  Leonard P. Wesley.  Evidential knowledge-based computer vision , 1986 .

[38]  A. Dempster.  Upper and Lower Probabilities Generated by a Random Closed Interval , 1968 .

[39]  Judea Pearl,et al.  Reasoning with belief functions: An analysis of compatibility , 1990, Int. J. Approx. Reason..

[40]  R. Bellman.  Dynamic programming. , 1957, Science.

[41]  Umberto Bertelè,et al.  Parametrization in nonserial dynamic programming , 1971 .

[42]  Glenn Shafer,et al.  Implementing Dempster's Rule for Hierarchical Evidence , 1987, Artif. Intell..

[43]  Alessandro Saffiotti,et al.  The Transferable Belief Model , 1991, ECSQARU.

[44]  Hung T. Nguyen,et al.  Uncertainty Models for Knowledge-Based Systems; A Unified Approach to the Measurement of Uncertainty , 1985 .

[45]  E. Ruspini.  The Logical Foundations of Evidential Reasoning (revised) , 1987 .

[46]  Paul-André Monney,et al.  Planar Geometric Reasoning with the Theory of Hints , 1991, Workshop on Computational Geometry.

[47]  Jürg Kohlas.  The reliability of reasoning with unreliable arguments , 1991, Ann. Oper. Res..

[48]  Mary McLeish,et al.  A model for non-monotonic reasoning using Dempster's rule , 1990, UAI.

[49]  George J. Klir,et al.  Fuzzy sets, uncertainty and information , 1988 .

[50]  Glenn Shafer,et al.  Rejoinders to comments on "perspectives on the theory and practice of belief functions" , 1992, Int. J. Approx. Reason..

[51]  Larry Wasserman,et al.  Prior Envelopes Based on Belief Functions , 1990 .

[52]  S. J. Press,et al.  Bayesian and Likelihood Methods in Statistics and Econometrics: Essays in Honor of George A. Barnard. , 1991 .

[53]  Philippe Smets,et al.  Fast Algorithms for Dempster-Shafer Theory , 1990, IPMU.

[54]  Prakash P. Shenoy,et al.  Axioms for probability and belief-function proagation , 1990, UAI.

[55]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[56]  Khaled Mellouli,et al.  Propagating belief functions in qualitative Markov trees , 1987, Int. J. Approx. Reason..

[57]  Rudolf Kruse,et al.  Uncertainty and vagueness in knowledge based systems: numerical methods , 1991, Artificial intelligence.

[58]  Ronald R. Yager,et al.  The entailment principle for dempster—shafer granules , 1986, Int. J. Intell. Syst..

[59]  Jürg Kohlas,et al.  Propagating belief functions through constraint system , 1991, Int. J. Approx. Reason..

[60]  John Yen,et al.  GERTIS: a Dempster-Shafer approach to diagnosing hierarchical hypotheses , 1989, CACM.

[61]  Philippe Smets,et al.  The Nature of the Unnormalized Beliefs Encountered in the Transferable Belief Model , 1992, UAI.

[62]  Jürg Kohlas,et al.  Zuverlässigkeit und Verfügbarkeit , 1987 .

[63]  G. Choquet.  Theory of capacities , 1954 .

[64]  Ronald Fagin,et al.  Uncertainty, belief, and probability , 1989, IJCAI 1989.

[65]  Richard E. Barlow,et al.  Statistical Theory of Reliability and Life Testing: Probability Models , 1976 .

[66]  L. Wasserman.  Belief functions and statistical inference , 1990 .

[67]  R. P. Srivastava,et al.  The Bayesian and belief-function formalisms a general perspective for auditing , 1990 .

[68]  Ronald Fagin,et al.  Two Views of Belief: Belief as Generalized Probability and Belief as Evidence , 1992, Artif. Intell..

[69]  A. Dempster.  Upper and lower probability inferences based on a sample from a finite univariate population. , 1967, Biometrika.

[70]  Philippe Smets,et al.  Default reasoning and the transferable belief model , 1990, UAI.

[71]  G. Shafer.  A Theory of Statistical Evidence , 1976 .

[72]  R. Almond.  BELIEF FUNCTION MODELS FOR SIMPLE SERIES AND PARALLEL SYSTEMS , 1991 .

[73]  Umberto Bertelè,et al.  Nonserial Dynamic Programming , 1972 .

[74]  Thomas M. Strat,et al.  Decision analysis using belief functions , 1990, Int. J. Approx. Reason..

[75]  Derek G. Corneil,et al.  Complexity of finding embeddings in a k -tree , 1987 .

[76]  Philippe Smets,et al.  The Combination of Evidence in the Transferable Belief Model , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[77]  B. Roy.  Méthodologie multicritère d'aide à la décision , 1985 .

[78]  Madan M. Gupta,et al.  Conditional Logic in Expert Systems , 1991 .

[79]  Glenn Shafer,et al.  Evidential Reasoning Using DELEF , 1988, AAAI.

[80]  R. M. Oliver,et al.  Influence diagrams, belief nets and decision analysis , 1992 .

[81]  Johan de Kleer,et al.  An Assumption-Based TMS , 1987, Artif. Intell..

[82]  Alessandro Saffiotti,et al.  Pulcinella: A General Tool for Propagating Uncertainty in Valuation Networks , 1991, UAI.

[83]  Ronald Fagin,et al.  A new approach to updating beliefs , 1990, UAI.

[84]  Jürg Kohlas,et al.  A Mathematical Theory of Hints , 1995 .

[85]  G. Matheron.  Random Sets and Integral Geometry , 1976 .

[86]  Gregory M. Provan,et al.  A logic-based analysis of Dempster-Shafer theory , 1990, Int. J. Approx. Reason..

[87]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[88]  Glenn Shafer,et al.  Perspectives on the theory and practice of belief functions , 1990, Int. J. Approx. Reason..

[89]  Gregory M. Provan.  The Application of Dempster Shafer Theory to a Logic-Based Visual Recognition System , 1989, UAI.

[90]  Pekka Orponen,et al.  Dempster's Rule of Combination is #P-Complete , 1990, Artif. Intell..

[91]  Katsumi Inoue,et al.  Linear Resolution for Consequence Finding , 1992, Artif. Intell..

[92]  Raymond Reiter,et al.  A Theory of Diagnosis from First Principles , 1986, Artif. Intell..

[93]  Gabriele Lohmann.  An Evidential Reasoning Approach to the Classification of Satellite Images , 1991, ECSQARU.

[94]  D. Rose.  Triangulated graphs and the elimination process , 1970 .

[95]  Petr Hájek,et al.  Uncertain information processing in expert systems , 1992 .

[96]  L. Cardona,et al.  The Reliability of Reasoning with Unreliable Rules and Propositions , 1991, ECSQARU.