Qualitative Probabilities for Default Reasoning, Belief Revision, and Causal Modeling

Abstract This paper presents a formalism that combines useful properties of both logic and probabilities. Like logic, the formalism admits qualitative sentences and provides symbolic machinery for deriving deductively closed beliefs and, like probability, it permits us to express if-then rules with different levels of firmness and to retract beliefs in response to changing observations. Rules are interpreted as order-of-magnitude approximations of conditional probabilities which impose constraints over the rankings of worlds. Inferences are supported by a unique priority ordering on rules which is syntactically derived from the knowledge base. This ordering accounts for rule interactions, respects specificity considerations and facilitates the construction of coherent states of beliefs. Practical algorithms are developed and analyzed for testing consistency, computing rule ordering, and answering queries. Imprecise observations are incorporated using qualitative versions of Jeffrey's rule and Bayesian updating, with the result that coherent belief revision is embodied naturally and tractably. Finally, causal rules are interpreted as imposing Markovian conditions that further constrain world rankings to reflect the modularity of causal organizations. These constraints are shown to facilitate reasoning about causal projections, explanations, actions and change.

[1]  Moisés Goldszmidt,et al.  On the Relation between Kappa Calculus and Probabilistic Reasoning , 1994, UAI.

[2]  Bernhard Nebel,et al.  Belief Revision and Default Reasoning: Syntax-Based Approaches , 1991, KR.

[3]  James P. Delgrande,et al.  An Approach to Default Reasoning Based on a First-Order Conditional Logic: Revised Report , 1987, Artif. Intell..

[4]  Raymond Reiter,et al.  A Logic for Default Reasoning , 1987, Artif. Intell..

[5]  Moisés Goldszmidt,et al.  System-Z+: A Formalism for Reasoning with Variable-Strength Defaults , 1991, AAAI.

[6]  P. Suppes A Probabilistic Theory Of Causality , 1970 .

[7]  H. Kyburg Probability and Rationality , 1961 .

[8]  D. Lewis Probabilities of Conditionals and Conditional Probabilities , 1976 .

[9]  Wolfgang Spohn,et al.  Ordinal Conditional Functions: A Dynamic Theory of Epistemic States , 1988 .

[10]  Daniel Hunter Parallel belief revision , 1988, UAI.

[11]  Rina Dechter,et al.  Directed Constraint Networks: A Relational Framework for Causal Modeling , 1991, IJCAI.

[12]  Hector Geffner,et al.  A Framework for Reasoning with Defaults , 1990 .

[13]  Ronald Fagin,et al.  On the semantics of updates in databases , 1983, PODS.

[14]  Drew McDermott,et al.  Nonmonotonic Logic and Temporal Projection , 1987, Artif. Intell..

[15]  Hirofumi Katsuno,et al.  On the Difference between Updating a Knowledge Base and Revising It , 1991, KR.

[16]  Moisés Goldszmidt,et al.  A Maximum Entropy Approach to Nonmonotonic Reasoning , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Sarit Kraus,et al.  Nonmonotonic Reasoning, Preferential Models and Cumulative Logics , 1990, Artif. Intell..

[18]  Jean H. Gallier,et al.  Linear-Time Algorithms for Testing the Satisfiability of Propositional Horn Formulae , 1984, J. Log. Program..

[19]  Wolfgang Spohn,et al.  Stochastic independence, causal independence, and shieldability , 1980, J. Philos. Log..

[20]  Craig Boutilier Conditional logics for default reasoning and belief revision , 1992 .

[21]  Judea Pearl,et al.  A Probabilistic Calculus of Actions , 1994, UAI.

[22]  Stuart C. Shapiro,et al.  Encyclopedia of artificial intelligence, vols. 1 and 2 (2nd ed.) , 1992 .

[23]  David Poole,et al.  On the Comparison of Theories: Preferring the Most Specific Explanation , 1985, IJCAI.

[24]  John McCarthy,et al.  Applications of Circumscription to Formalizing Common Sense Knowledge , 1987, NMR.

[25]  Judea Pearl,et al.  From Conditional Oughts to Qualitative Decision Theory , 1993, UAI.

[26]  Craig Boutilier What is a Default Priority ? , 1992 .

[27]  Prakash P. Shenoy,et al.  On Spohn's rule for revision of beliefs , 1991, Int. J. Approx. Reason..

[28]  Moisés Goldszmidt,et al.  Rank-based Systems: A Simple Approach to Belief Revision, Belief Update, and Reasoning about Evidence and Actions , 1992, KR.

[29]  Didier Dubois,et al.  Possibility Theory - An Approach to Computerized Processing of Uncertainty , 1988 .

[30]  Judea Pearl,et al.  Counterfactuals and Policy Analysis in Structural Models , 1995, UAI.

[31]  Rina Dechter,et al.  Network-based heuristics for constraint satisfaction problems , 1988 .

[32]  Judea Pearl,et al.  A Theory of Inferred Causation , 1991, KR.

[33]  Peter Gärdenfors,et al.  On the logic of theory change: Partial meet contraction and revision functions , 1985, Journal of Symbolic Logic.

[34]  J. Pearl Causal diagrams for empirical research , 1995 .

[35]  Judea Pearl,et al.  Embracing Causality in Default Reasoning , 1988, Artif. Intell..

[36]  E. W. Adams,et al.  The logic of conditionals , 1975 .

[37]  Judea Pearl,et al.  Probabilistic Semantics for Nonmonotonic Reasoning: A Survey , 1989, KR.

[38]  Mukesh Dalal,et al.  Investigations into a Theory of Knowledge Base Revision , 1988, AAAI.

[39]  C. E. Alchourrón,et al.  On the logic of theory change: Partial meet contraction and revision functions , 1985 .

[40]  Moisés Goldszmidt,et al.  Fast Belief Update Using Order-of-Magnitude Probabilities , 1995, UAI.

[41]  Judea Pearl,et al.  CAUSATION, ACTION, AND COUNTERFACTUALS , 2004 .

[42]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[43]  M. Goldszmidt Qualitative probabilities: a normative framework for commonsense reasoning , 1992 .

[44]  Hector Geffner,et al.  Conditional Entailment: Bridging two Approaches to Default Reasoning , 1992, Artif. Intell..

[45]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[46]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[47]  David Poole,et al.  A Logical Framework for Default Reasoning , 1988, Artif. Intell..

[48]  Daniel Lehmann,et al.  What does a Conditional Knowledge Base Entail? , 1989, Artif. Intell..

[49]  Moisés Goldszmidt,et al.  Action Networks: A Framework for Reasoning about Actions and Change under Uncertainty , 1994, UAI.

[50]  Judea Pearl,et al.  Counterfactual Probabilities: Computational Methods, Bounds and Applications , 1994, UAI.

[51]  Fahiem Bacchus,et al.  Representing and reasoning with probabilistic knowledge - a logical approach to probabilities , 1991 .

[52]  Moisés Goldszmidt,et al.  On the Consistency of Defeasible Databases , 1991, Artif. Intell..

[53]  Craig Boutilier,et al.  Revision by Conditional Beliefs , 1993, AAAI.

[54]  Judea Pearl,et al.  System Z: a Natural Ordering of Defaults with Tractable Applications to Nonmonotonic Reasoning^ , 1990 .

[55]  Gerhard Brewka,et al.  Preferred Subtheories: An Extended Logical Framework for Default Reasoning , 1989, IJCAI.

[56]  Judea Pearl,et al.  Embracing Causality in Formal Reasoning , 1987, AAAI.

[57]  Henry A. Kautz The Logic of Persistence , 1986, AAAI.

[58]  Yoav Shoham,et al.  Nonmonotonic Logics: Meaning and Utility , 1987, IJCAI.

[59]  Marianne Winslett,et al.  Reasoning about Action Using a Possible Models Approach , 1988, AAAI.

[60]  J. Pearl Jeffrey's Rule, Passage of Experience, and Neo-Bayesianism , 1990 .

[61]  J. Pearl,et al.  On the Logic of Iterated Belief Revision , 1994, Artif. Intell..

[62]  P G rdenfors,et al.  Knowledge in flux: modeling the dynamics of epistemic states , 1988 .