Graphical Markov models, unifying results and their interpretation

Graphical Markov models combine conditional independence constraints with graph- ical representations of stepwise data generating processes. The models started to be formulated about 40 years ago and vigorous development is ongoing. Longitudinal observational studies as well as intervention studies are best modelled via a subclass called regression graph models and, especially traceable regressions. Regression graphs include two types of undirected graph and directed acyclic graphs in ordered sequences of joint responses. Response components may correspond to discrete or continuous random variables or to both types and may depend exclu- sively on variables which have been generated earlier. These aspects are essential when causal hypothesis are the motivation for the planning of empirical studies. To turn the graphs into useful tools for tracing pathways of dependence, for understanding development over time and for predicting structure in alternative models, the generated distri- butions have to mimic some properties of joint Gaussian distributions. Here, relevant results concerning these aspects are spelled out and illustrated by examples. With regression graph models, it becomes feasible, for the

[1]  Jessika Weiss,et al.  Graphical Models In Applied Multivariate Statistics , 2016 .

[2]  Andreas Ritter,et al.  Structural Equations With Latent Variables , 2016 .

[3]  N. Wermuth,et al.  Pairwise Markov properties for regression graphs , 2015, 1512.09016.

[4]  Nanny Wermuth,et al.  Graphical Markov models: overview , 2014, 1407.7783.

[5]  Marco Valtorta,et al.  Parameter Identifiability of Discrete Bayesian Networks with Hidden Variables , 2014, 1406.0541.

[6]  Z. Geng,et al.  Qualitative Evaluation of Associations by the Transitivity of the Association Signs , 2014, 1405.4258.

[7]  Piotr Zwiernik,et al.  Binary distributions of concentric rings , 2014, J. Multivar. Anal..

[8]  S. Lauritzen,et al.  Markov properties for mixed graphs , 2011, 1109.5909.

[9]  Tamás Rudas,et al.  On the Application of Discrete Marginal Graphical Models , 2013 .

[10]  N. Wermuth,et al.  Star graphs induce tetrad correlations: for Gaussian as well as for binary variables , 2013, 1307.5396.

[11]  Seung-Jean Kim,et al.  Condition‐number‐regularized covariance estimation , 2013, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[12]  Nanny Wermuth,et al.  Concepts and a case study for a flexible class of graphical Markov models , 2013, 1303.1436.

[13]  Peter Buhlmann,et al.  Geometry of the faithfulness assumption in causal inference , 2012, 1207.0547.

[14]  Kayvan Sadeghi Stable mixed graphs , 2011, 1110.4168.

[15]  R. J. Evans,et al.  Two algorithms for fitting constrained marginal models , 2011, Comput. Stat. Data Anal..

[16]  A. Roverato,et al.  Log-mean linear models for binary data , 2011, 1109.6239.

[17]  E. Stanghellini,et al.  Identification of discrete concentration graph models with one hidden binary variable , 2010, 1009.4279.

[18]  Sonja Kuhnt,et al.  Robustness and Complex Data Structures , 2013 .

[19]  Po-Ling Loh,et al.  Structure estimation for discrete graphical models: Generalized covariance matrices and their inverses , 2012, NIPS.

[20]  N. Wermuth Traceable Regressions , 2012 .

[21]  M. Drton,et al.  Half-trek criterion for generic identifiability of linear structural equation models , 2011, 1107.5552.

[22]  Kayvan Sadeghi,et al.  Graphical Markov Models with Mixed Graphs in R , 2012, R J..

[23]  N. Wermuth,et al.  Sequences of regressions and their independences , 2011, 1110.1986.

[24]  Kshitij Khare,et al.  Wishart distributions for decomposable covariance graph models , 2011, 1103.1768.

[25]  N. Wermuth PROBABILITY DISTRIBUTIONS WITH SUMMARY GRAPH STRUCTURE , 2010, 1003.3259.

[26]  G. M. Marchetti,et al.  Chain graph models of multivariate regression type for categorical data , 2009, 0906.2098.

[27]  Joseph F. Grcar,et al.  Mathematicians of Gaussian Elimination , 2011 .

[28]  Per Kragh Andersen,et al.  Regression with Linear Predictors , 2010 .

[29]  R. Dechter,et al.  Heuristics, Probability and Causality. A Tribute to Judea Pearl , 2010 .

[30]  Halpern Joseph,et al.  Causality, Probability, and Heuristics: A Tribute to Judea Pearl , 2010 .

[31]  Sebastiaan J. van Schaik Answering reachability queries on large directed graphs , 2010 .

[32]  N. Wermuth,et al.  Changing Parameters by Partial Mappings , 2010 .

[33]  M. Drton Discrete chain graph models , 2009, 0909.0843.

[34]  Piotr Zwiernik,et al.  Implicit inequality constraints in a binary tree model , 2009, 0904.1980.

[35]  N. Wermuth,et al.  Matrix representations and independencies in directed acyclic graphs , 2009, 0904.0333.

[36]  Kshitij Khare,et al.  Wishart Distributions for Covariance Graph Models , 2009 .

[37]  N. Wermuth,et al.  Triangular systems for symmetric binary variables , 2009 .

[38]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[39]  Omer Reingold,et al.  Undirected connectivity in log-space , 2008, JACM.

[40]  P. McCullagh Sampling bias and logistic models , 2008 .

[41]  N. Wermuth,et al.  Distortion of effects caused by indirect confounding , 2008 .

[42]  Monia Lupparelli,et al.  Parameterizations and Fitting of Bi‐directed Graph Models to Categorical Data , 2008, 0801.1440.

[43]  G'erard Letac,et al.  Wishart distributions for decomposable graphs , 2007, 0708.2380.

[44]  T. Richardson,et al.  Estimation of a covariance matrix with zeros , 2005, math/0508268.

[45]  Frantisek Matús,et al.  On Gaussian conditional independence structures , 2007, Kybernetika.

[46]  B. Qaqish,et al.  Multivariate logistic models , 2006 .

[47]  Robert Castelo,et al.  A Robust Procedure For Gaussian Graphical Model Search From Microarray Data With p Larger Than n , 2006, J. Mach. Learn. Res..

[48]  N. Wermuth,et al.  Partial inversion for linear systems and partial closure of independence graphs , 2006 .

[49]  Z. Geng,et al.  Collapsibility of distribution dependence , 2006 .

[50]  David R. Cox,et al.  PRINCIPLES OF STATISTICAL INFERENCE , 2017 .

[51]  N. Wermuth,et al.  Covariance chains , 2006 .

[52]  C.J.H. Mann,et al.  Probabilistic Conditional Independence Structures , 2005 .

[53]  Malik Beshir Malik,et al.  Applied Linear Regression , 2005, Technometrics.

[54]  M. Mouchart,et al.  Ignorable Common Information, Null sets and Basu’s First Theorem , 2005 .

[55]  N. Wermuth,et al.  Joint response graphs and separation induced by triangular systems , 2004 .

[56]  David Madigan,et al.  A graphical characterization of lattice conditional independence models , 2004, Annals of Mathematics and Artificial Intelligence.

[57]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[58]  Rainer Dahlhaus,et al.  Partial correlation analysis for the identification of synaptic connections , 2003, Biological Cybernetics.

[59]  J. Robins,et al.  Uniform consistency in causal inference , 2003 .

[60]  Tom Burr,et al.  Causation, Prediction, and Search , 2003, Technometrics.

[61]  Arno Siebes,et al.  A characterization of moral transitive acyclic directed graph Markov models as labeled trees , 2003 .

[62]  Didelez,et al.  Decomposability and selection of graphical models for time series , 2003 .

[63]  Roland Fried,et al.  Decomposability and selection of graphical models for multivariate time series , 2003 .

[64]  J. Koster Marginalizing and conditioning in graphical models , 2002 .

[65]  Graham J. Wills,et al.  Introduction to graphical modelling , 1995 .

[66]  P. Spirtes,et al.  Ancestral graph Markov models , 2002 .

[67]  S. Lauritzen,et al.  The TM algorithm for maximising a conditional likelihood function , 2001 .

[68]  D. Madigan,et al.  Alternative Markov Properties for Chain Graphs , 2001 .

[69]  J. Pearl Causality: Models, Reasoning and Inference , 2000 .

[70]  R. Mabry Proof Without Words: ¼+(¼)2+(¼)3+…=⅓. , 1999 .

[71]  Nanny Wermuth,et al.  On association models defined over independence graphs , 1998 .

[72]  Michael I. Jordan Graphical Models , 1998 .

[73]  Nanny Wermuth,et al.  Multivariate Dependencies: Models, Analysis and Interpretation , 1996 .

[74]  G. Kauermann On a dualization of graphical Gaussian models , 1996 .

[75]  Steffen L. Lauritzen,et al.  Graphical models in R , 1996 .

[76]  A. Dawid,et al.  Hyper Markov Laws in the Statistical Analysis of Decomposable Graphical Models , 1993 .

[77]  N. Wermuth,et al.  Linear Dependencies Represented by Chain Graphs , 1993 .

[78]  S. Orbom,et al.  When Can Association Graphs Admit A Causal Interpretation? , 1993 .

[79]  J. H. Schuenemeyer,et al.  Generalized Linear Models (2nd ed.) , 1992 .

[80]  B. Everitt Log-linear models for contingency tables , 1992 .

[81]  Elizabeth M. Markham Proof without Words , 1992 .

[82]  Paul Goodwin Influence Diagrams, Belief Nets and Decision Analysis , 1991 .

[83]  R. M. Dudley,et al.  Influence Diagrams, Belief Nets and Decision Analysis. , 1991 .

[84]  Nanny Wermuth,et al.  An approximation to maximum likelihood estimates in reduced models , 1990 .

[85]  P. McCullagh,et al.  Generalized Linear Models, 2nd Edn. , 1990 .

[86]  N. Wermuth,et al.  On Substantive Research Hypotheses, Conditional Independence Graphs and Graphical Chain Models , 1990 .

[87]  Steffen L. Lauritzen,et al.  Independence properties of directed markov fields , 1990, Networks.

[88]  Dan Geiger,et al.  Identifying independence in bayesian networks , 1990, Networks.

[89]  M. Frydenberg Marginalization and Collapsibility in Graphical Interaction Models , 1990 .

[90]  A. P. Dawid,et al.  Independence properties of directed Markov fields. Networks, 20, 491-505 , 1990 .

[91]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[92]  N. Wermuth,et al.  Graphical Models for Associations between Variables, some of which are Qualitative and some Quantitative , 1989 .

[93]  T. Speed,et al.  Gaussian Markov Distributions over Finite Graphs , 1986 .

[94]  N. Wermuth,et al.  Graphical and recursive models for contingency tables , 1983 .

[95]  Howard Wainer,et al.  Social Indicators III: Selected Data on Social Conditions and Trends in the United States. , 1983 .

[96]  N. Wermuth Linear Recursive Equations, Covariance Selection, and Path Analysis , 1980 .

[97]  T. Speed,et al.  Markov Fields and Log-Linear Interaction Models for Contingency Tables , 1980 .

[98]  O. Barndorff-Nielsen Information and Exponential Families in Statistical Theory , 1980 .

[99]  A. Dawid Conditional Independence in Statistical Theory , 1979 .

[100]  Shelby J. Haberman,et al.  Maximum Likelihood Estimates in Exponential Response Models , 1977 .

[101]  N. Wermuth Model Search among Multiplicative Models , 1976 .

[102]  N. Wermuth Analogies between Multiplicative Models in Contingency Tables and Covariance Selection , 1976 .

[103]  T. W. Anderson Asymptotically Efficient Estimation of Covariance Matrices with Linear Structure , 1973 .

[104]  Robert E. Tarjan,et al.  Depth-First Search and Linear Graph Algorithms , 1972, SIAM J. Comput..

[105]  Douglas M. Hawkins,et al.  Elements of Continuous Multivariate Analysis , 1969 .

[106]  R. D. Bock,et al.  Analysis of covariance structures , 1966, Psychometrika.

[107]  M. W. Birch Maximum Likelihood in Three-Way Contingency Tables , 1963 .

[108]  R. H. Strotz,et al.  RECURSIVE VS. NONRECURSIVE SYSTEMS: AN ATTEMPT AT SYNTHESIS (PART I OF A TRIPTYCH ON CAUSAL CHAIN SYSTEMS) , 1960 .

[109]  T. W. Anderson,et al.  An Introduction to Multivariate Statistical Analysis , 1959 .

[110]  A. Ostrowski Determinanten mit überwiegender Hauptdiagonale und die absolute Konvergenz von linearen Iterationsprozessen , 1956 .

[111]  E. H. Simpson,et al.  The Interpretation of Interaction in Contingency Tables , 1951 .

[112]  W. G. Cochran The Omission or Addition of an Independent Variate in Multiple Linear Regression , 1938 .

[113]  A. Ostrowski Über die determinanten mit überwiegender Hauptdiagonale , 1937 .

[114]  S. Wright The Method of Path Coefficients , 1934 .

[115]  S. Wright,et al.  The Theory of Path Coefficients a Reply to Niles's Criticism. , 1923, Genetics.

[116]  R. Fisher,et al.  On the Mathematical Foundations of Theoretical Statistics , 1922 .

[117]  J. Schur,et al.  Über Potenzreihen, die im Innern des Einheitskreises beschränkt sind. , 1917 .

[118]  C. Neumann Vorlesungen uber Riemann's Theorie der Abel'schen Integrale , 1884 .