Structural Learning of Chain Graphs via Decomposition.

Chain graphs present a broad class of graphical models for description of conditional independence structures, including both Markov networks and Bayesian networks as special cases. In this paper, we propose a computationally feasible method for the structural learning of chain graphs based on the idea of decomposing the learning problem into a set of smaller scale problems on its decomposed subgraphs. The decomposition requires conditional independencies but does not require the separators to be complete subgraphs. Algorithms for both skeleton recovery and complex arrow orientation are presented. Simulations under a variety of settings demonstrate the competitive performance of our method, especially when the underlying graph is sparse.

[1]  Mathias Drton,et al.  A SINful approach to Gaussian graphical model selection , 2005 .

[2]  D. Madigan,et al.  Alternative Markov Properties for Chain Graphs , 2001 .

[3]  S. S. Wilks.  The Large-Sample Distribution of the Likelihood Ratio for Testing Composite Hypotheses , 1938 .

[4]  B. Schölkopf,et al.  High-Dimensional Graphical Model Selection Using ℓ1-Regularized Logistic Regression , 2007 .

[5]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[6]  P. Spirtes,et al.  Causation, prediction, and search , 1993 .

[7]  D. Hand,et al.  A Discrete Variable Chain Graph for Applicants for Credit , 1999 .

[8]  W. Wong,et al.  Learning Causal Bayesian Network Structures From Experimental Data , 2008 .

[9]  Peter Bühlmann,et al.  Estimating High-Dimensional Directed Acyclic Graphs with the PC-Algorithm , 2007, J. Mach. Learn. Res..

[10]  Michael I. Jordan,et al.  Probabilistic Networks and Expert Systems , 1999 .

[11]  Steffen L. Lauritzen,et al.  Graphical models in R , 1996 .

[12]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[13]  Nir Friedman,et al.  Being Bayesian About Network Structure. A Bayesian Approach to Structure Discovery in Bayesian Networks , 2004, Machine Learning.

[14]  Qiang Zhao,et al.  Decomposition of structural learning about directed acyclic graphs , 2006, Artif. Intell..

[15]  Milan Studený,et al.  A recovery algorithm for chain graphs , 1997, Int. J. Approx. Reason..

[16]  Nanny Wermuth,et al.  ON BLOCK-RECURSIVE LINEAR REGRESSION EQUATIONTS , 1992 .

[17]  A. Roverato,et al.  On Block Ordering of Variables in Graphical Modelling , 2006 .

[18]  Gregory F. Cooper,et al.  The ALARM Monitoring System: A Case Study with two Probabilistic Inference Techniques for Belief Networks , 1989, AIME.

[19]  N. Wermuth,et al.  On Substantive Research Hypotheses, Conditional Independence Graphs and Graphical Chain Models , 1990 .

[20]  N. Meinshausen,et al.  High-dimensional graphs and variable selection with the Lasso , 2006, math/0608017.

[21]  David Maxwell Chickering,et al.  Learning Equivalence Classes of Bayesian Network Structures , 1996, UAI.

[22]  Alan Agresti,et al.  Categorical Data Analysis , 1991, International Encyclopedia of Statistical Science.

[23]  D. Edwards.  Introduction to graphical modelling , 1995 .

[24]  Zhi Geng,et al.  A Recursive Method for Structural Learning of Directed Acyclic Graphs , 2008, J. Mach. Learn. Res..

[25]  Nir Friedman,et al.  Learning Bayesian Network Structure from Massive Datasets: The "Sparse Candidate" Algorithm , 1999, UAI.

[26]  Constantin F. Aliferis,et al.  The max-min hill-climbing Bayesian network structure learning algorithm , 2006, Machine Learning.

[27]  Vladimir Pavlovic,et al.  Protein classification using probabilistic chain graphs and the Gene Ontology structure , 2006, Bioinform..

[28]  M. Studený,et al.  On chain graph models for description of conditional independence structures , 1998 .

[29]  S. Lauritzen,et al.  Chain graph models and their causal interpretations , 2002 .

[30]  Nanny Wermuth,et al.  Multivariate Dependencies: Models, Analysis and Interpretation , 1996 .

[31]  M. Frydenberg.  The chain graph Markov property , 1990 .

[32]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[33]  Jaime G. Carbonell,et al.  Predicting protein folds with structural repeats using a chain graph model , 2005, ICML '05.

[34]  N. Wermuth,et al.  Graphical and recursive models for contingency tables , 1983 .