Incremental conditioning of lower and upper probabilities

Abstract Bayesian-style conditioning of an exact probability distribution can be done incrementally by updating the current distribution each time a new item of evidence is obtained. Many have suggested the use of lower and upper probabilities for representing bounds on probability distributions, which naturally suggests an analogous procedure of incremental conditioning using forms of interval arithemetic. Unfortunately, conditioning of lower and upper probability bounds loses information, yielding incorrect bounds when updates and performed incrementally and making the conditioning operation noncommutative. Furthermore, when lower probability functions are represented by way of their Mobius transforms, the operation of conditioning can cause an exponential explosion in the number of nonzero Mobius assignments used to represent the function. This paper presents an alternative representation for lower probability that overcomes these problems. By representing the results of both Dempster conditioning and strong consitioning, the representation indirectly encodes lower probability bounds in a form that allows updates to be performed incrementally without a loss of information. Conditioning with the new representation does not depend on the order of updates or on whether evidence is incorporated incrementally or all at once. The bounds obtained are exact when the original lower probabilities satisfy a property called 2-monotonicity. Although the new representation encodes more information about probability bounds than the straight representation, updates on the new representation never increase the number of Mobius assignments used to encode the lower probability—a considerable improvement over the worst-case exponential increase seen with the straight representation. The new representation helps to improve the efficiency and convenience of representing and manipulating lower probabilities.

[1]  Serafín Moral,et al.  Propagation of Uncertainty in Dependence Graphs , 1991, ECSQARU.

[2]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[3]  Didier Dubois,et al.  On the unicity of dempster rule of combination , 1986, Int. J. Intell. Syst..

[4]  Stephen R. Watson [Probabilistic Expert Systems in Medicine: Practical Issues in Handling Uncertainty]: Comment , 1987 .

[5]  Glenn Shafer,et al.  Perspectives on the theory and practice of belief functions , 1990, Int. J. Approx. Reason..

[6]  J. Hartigan,et al.  Bayesian Inference Using Intervals of Measures , 1981 .

[7]  David Lindley,et al.  The Probability Approach to the Treatment of Uncertainty in Artificial Intelligence and Expert Systems , 1987 .

[8]  Thomas M. Strat,et al.  Decision analysis using belief functions , 1990, Int. J. Approx. Reason..

[9]  Isaac Levi,et al.  The Enterprise Of Knowledge , 1980 .

[10]  J. Kacprzyk,et al.  Advances in the Dempster-Shafer theory of evidence , 1994 .

[11]  Patrick Suppes,et al.  Logic, Methodology and Philosophy of Science , 1963 .

[12]  Glenn Shafer,et al.  Languages and Designs for Probability Judgment , 1985, Cogn. Sci..

[13]  A. Tversky,et al.  Languages and designs for probability , 1985 .

[14]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[15]  Carl G. Wagner,et al.  Constructing Lower Probabilities , 1993, UAI.

[16]  L. N. Kanal,et al.  Uncertainty in Artificial Intelligence 5 , 1990 .

[17]  Cedric A. B. Smith,et al.  Consistency in Statistical Inference and Decision , 1961 .

[18]  David J. Spiegelhalter [Probabilistic Expert Systems in Medicine: Practical Issues in Handling Uncertainty]: Comment , 1987 .

[19]  Gregory F. Cooper,et al.  NESTOR: A Computer-Based Medical Diagnostic Aid That Integrates Causal and Probabilistic Knowledge. , 1984 .

[20]  Ronald Fagin,et al.  A new approach to updating beliefs , 1990, UAI.

[21]  Enrique H. Ruspini Approximate inference and interval probabilities , 1986, IPMU.

[22]  Benjamin N. Grosof,et al.  An inequality paradigm for probabilistic knowledge the augmented logic of conditional probability intervals , 1985, UAI 1985.

[23]  Ronald R. Yager,et al.  Uncertainty in Knowledge-Based Systems , 1987, Lecture Notes in Computer Science.

[24]  Prakash P. Shenoy,et al.  Axioms for probability and belief-function proagation , 1990, UAI.

[25]  Enrique H. Ruspini,et al.  Approximate Deduction in Single Evidential Bodies , 1986, UAI 1986.

[26]  Khaled Mellouli,et al.  Propagating belief functions in qualitative Markov trees , 1987, Int. J. Approx. Reason..

[27]  H. Jaap van den Herik,et al.  Proof-Number Search , 1994, Artif. Intell..

[28]  G. Choquet Theory of capacities , 1954 .

[29]  T. Fine,et al.  Towards a Frequentist Theory of Upper and Lower Probability , 1982 .

[30]  Benjamin N. Grosof An Inequality Paradigm for Probabilistic Knowledge: The Logic of Conditional Probability Intervals , 1985, UAI.

[31]  Hidetomo Ichihashi,et al.  Jeffrey-like rules of conditioning for the Dempster-Shafer theory of evidence , 1989, Int. J. Approx. Reason..

[32]  L. Chrisman Abstract probabilistic modeling of action , 1992 .

[33]  Philippe Smets,et al.  What is Dempster-Shafer's model? , 1994 .

[34]  Jerome A. Feldman,et al.  Decision Theory and Artificial Intelligence II: The Hungry Monkey , 1977, Cogn. Sci..

[35]  Philippe Smets About Updating , 1991, UAI.

[36]  Henry E. Kyburg,et al.  Higher order probabilities and intervals , 1988, Int. J. Approx. Reason..

[37]  Paul Snow Bayesian Inference without Point Estimates , 1986, AAAI.

[38]  Gautam Biswas,et al.  Belief functions and belief maintenance in artificial intelligence , 1990, Int. J. Approx. Reason..

[39]  Alessandro Saffiotti,et al.  The Transferable Belief Model , 1991, ECSQARU.

[40]  Chelsea C. White,et al.  A Posteriori Representations Based on Linear Inequality Descriptions of a Priori and Conditional Probabilities , 1986, IEEE Transactions on Systems, Man, and Cybernetics.

[41]  Henry E. Kyburg,et al.  Bayesian and Non-Bayesian Evidential Updating , 1987, Artificial Intelligence.

[42]  Luis M. de Campos,et al.  Updating Uncertain Information , 1990, IPMU.

[43]  Eric Horvitz,et al.  Decision theory in expert systems and artificial intelligenc , 1988, Int. J. Approx. Reason..

[44]  P. Walley Statistical Reasoning with Imprecise Probabilities , 1990 .

[45]  John S. Breese,et al.  Probability Intervals Over Influence Diagrams , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Larry Wasserman,et al.  Prior Envelopes Based on Belief Functions , 1990 .

[47]  Robert Kennes,et al.  Computational aspects of the Mobius transformation of graphs , 1992, IEEE Trans. Syst. Man Cybern..

[48]  J. Kyburg Higher order probability and intervals , 1988 .

[49]  T. Fine,et al.  A Note on Undominated Lower Probabilities , 1986 .

[50]  Judea Pearl,et al.  Reasoning with belief functions: An analysis of compatibility , 1990, Int. J. Approx. Reason..

[51]  Luis M. de Campos,et al.  The concept of conditional fuzzy measure , 1990, Int. J. Intell. Syst..

[52]  Terrence L. Fine,et al.  Unstable Collectives and Envelopes of Probability Measures , 1991 .

[53]  Bjørnar Tessem,et al.  Interval probability propagation , 1992, Int. J. Approx. Reason..

[54]  Irving John Good,et al.  Subjective Probability as the Measure of a Non-measurable Set , 1962 .

[55]  Didier Dubois,et al.  Evidence, knowledge, and belief functions , 1992, Int. J. Approx. Reason..

[56]  Serafín Moral,et al.  An axiomatic framework for propagating uncertainty in directed acyclic networks , 1993, Int. J. Approx. Reason..

[57]  Ronald Fagin,et al.  Two Views of Belief: Belief as Generalized Probability and Belief as Evidence , 1992, Artif. Intell..