Logical and Algorithmic Properties of Conditional Independence and Graphical Models

This article develops an axiomatic basis for the relationship between conditional independence and graphical models in statistical analysis. In particular, the following relationships are established: (1) every axiom for conditional independence is an axiom for graph separation, (2) every graph represents a consistent set of independence and dependence constraints, (3) all binary factorizations of strictly positive probability models can be encoded and determined in polynomial time using their correspondence to graph separation, (4) binary factorizations of non-strictly positive probability models can also be derived in polynomial time albeit less efficiently and (5) unconditional independence relative to normal models can be axiomatized with a finite set of axioms.

[1]  J. Gerber On Membership , 1988 .

[2]  Ronald Fagin,et al.  Multivalued dependencies and a new normal form for relational databases , 1977, TODS.

[3]  Ronald Fagin,et al.  Functional Dependencies in a Relational Data Base and Propositional Logic , 1977, IBM J. Res. Dev..

[4]  Catriel Beeri,et al.  A complete axiomatization for functional and multivalued dependencies in database relations , 1977, SIGMOD '77.

[5]  A. Dawid Conditional Independence in Statistical Theory , 1979 .

[6]  T. Speed,et al.  Markov Fields and Log-Linear Interaction Models for Contingency Tables , 1980 .

[7]  Catriel Beeri,et al.  On the menbership problem for functional and multivalued dependencies in relational databases , 1980, TODS.

[8]  Wolfgang Spohn,et al.  Stochastic independence, causal independence, and shieldability , 1980, J. Philos. Log..

[9]  Ronald Fagin,et al.  Horn clauses and database dependencies , 1982, JACM.

[10]  Ronald Fagin,et al.  The theory of data dependencies - a survey , 1984 .

[11]  Khaled Mellouli,et al.  Propagating belief functions in qualitative Markov trees , 1987, Int. J. Approx. Reason..

[12]  David J. Spiegelhalter,et al.  Local computations with probabilities on graphical structures and their application to expert systems , 1990 .

[13]  Dan Geiger,et al.  On the logic of causal models , 2013, UAI.

[14]  Judea Pearl,et al.  Causal networks: semantics and expressiveness , 2013, UAI.

[15]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[16]  D. Geiger Graphoids: a qualitative framework for probabilistic inference , 1990 .

[17]  Dan Geiger,et al.  Axioms and Algorithms for Inferences Involving Probabilistic Independence , 1991, Inf. Comput..

[18]  Francesco M. Malvestuto,et al.  Comment on "A unique formal system for binary decompositions of database relations, probability distributions, and graphs" , 1992, Inf. Sci..

[19]  Francesco M. Malvestuto A unique formal system for binary decompositions of database relations, probability distributions, and graphs , 1992, Inf. Sci..