Graphical Markov models: overview

We describe how graphical Markov models emerged in the past 40 years, based on three essential concepts that had been developed independently more than a century ago. Sequences of joint or single regressions and their regression graphs are singled out as being the subclass that is best suited for analyzing longitudinal data and for tracing developmental pathways, both in observational and in intervention studies. Interpretations are illustrated using two sets of data. Furthermore, some of the more recent, important results for sequences of regressions are summarized.

[1]  J. Vandenbroucke.  The history of confounding , 2002 .

[2]  D. Edwards.  Introduction to graphical modelling , 1995 .

[3]  N. Wermuth,et al.  Triangular systems for symmetric binary variables , 2009 .

[4]  B. Everitt.  Log-linear models for contingency tables , 1992 .

[5]  Statistical Dependence and Independence , 2014 .

[6]  N. Wermuth,et al.  Matrix representations and independencies in directed acyclic graphs , 2009, 0904.0333.

[7]  N. Wermuth.  Linear Recursive Equations, Covariance Selection, and Path Analysis , 1980 .

[8]  R. Smith.  Issues Matter: A Case Study of Factors Influencing Voting Choices , 2014 .

[9]  J. N. R. Jeffers,et al.  Graphical Models in Applied Multivariate Statistics. , 1990 .

[10]  S. Lauritzen,et al.  Markov properties for mixed graphs , 2011, 1109.5909.

[11]  Nanny Wermuth,et al.  Multivariate Dependencies: Models, Analysis and Interpretation , 1996 .

[12]  R. P. McDonald,et al.  Structural Equations with Latent Variables , 1989 .

[13]  Milan Studený,et al.  Probabilistic conditional independence structures , 2006, Information science and statistics.

[14]  Wicher P. Bergsma,et al.  Marginal models for categorical data , 2002 .

[15]  S. Wright.  The Method of Path Coefficients , 1934 .

[16]  W. G. Cochran.  The Omission or Addition of an Independent Variate in Multiple Linear Regression , 1938 .

[17]  Steffen L. Lauritzen,et al.  Graphical models in R , 1996 .

[18]  P. Spirtes,et al.  Ancestral graph Markov models , 2002 .

[19]  Per Kragh Andersen,et al.  Regression with Linear Predictors , 2010 .

[20]  Tamás Rudas,et al.  On the Application of Discrete Marginal Graphical Models , 2013 .

[21]  P. McCullagh,et al.  Generalized Linear Models, 2nd Edn. , 1990 .

[22]  Kayvan Sadeghi.  Stable mixed graphs , 2011, 1110.4168.

[23]  John A. Nelder,et al.  Generalized linear models. 2nd ed. , 1993 .

[24]  T. Speed,et al.  Markov Fields and Log-Linear Interaction Models for Contingency Tables , 1980 .

[25]  Sin Yi Cheung,et al.  Time to Read: Family Resources and Educational Outcomes in Britain* , 2003 .

[26]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[27]  Piotr Zwiernik,et al.  Binary distributions of concentric rings , 2014, J. Multivar. Anal..

[28]  Dan Geiger,et al.  Identifying independence in bayesian networks , 1990, Networks.

[29]  T. Richardson,et al.  Multimodality of the likelihood in the bivariate seemingly unrelated regressions model , 2004 .

[30]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[31]  N. Wermuth,et al.  Partial inversion for linear systems and partial closure of independence graphs , 2006 .

[32]  N. Wermuth,et al.  Sequences of regressions and their independences , 2011, 1110.1986.

[33]  David R. Cox,et al.  PRINCIPLES OF STATISTICAL INFERENCE , 2017 .

[34]  N. Wermuth.  Analogies between Multiplicative Models in Contingency Tables and Covariance Selection , 1976 .

[35]  F. Petrak,et al.  Adaptation to life after surgical removal of the bladder—an application of graphical Markov models for analysing longitudinal data , 2004, Statistics in medicine.

[36]  U. Egle,et al.  Long-Term Sequelae of Emotional Parentification: A Cross-Validation Study Using Sequences of Regressions , 2015 .

[37]  N. Wermuth,et al.  Star graphs induce tetrad correlations: for Gaussian as well as for binary variables , 2013, 1307.5396.

[38]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[39]  Douglas M. Hawkins,et al.  Elements of Continuous Multivariate Analysis , 1969 .

[40]  A. Zellner.  An Efficient Method of Estimating Seemingly Unrelated Regressions and Tests for Aggregation Bias , 1962 .

[41]  James M. Robins,et al.  Single World Intervention Graphs : A Primer , 2013 .

[42]  P. Spirtes,et al.  Causation, prediction, and search , 1993 .

[43]  E. H. Simpson,et al.  The Interpretation of Interaction in Contingency Tables , 1951 .

[44]  Nanny Wermuth,et al.  Comment: Are Marginal Models Needed? , 2013 .

[45]  Kayvan Sadeghi,et al.  Graphical Markov Models with Mixed Graphs in R , 2012, R J..

[46]  J. Pearl.  TRYGVE HAAVELMO AND THE EMERGENCE OF CAUSAL CALCULUS , 2013, Econometric Theory.

[47]  Frantisek Matús,et al.  On Gaussian conditional independence structures , 2007, Kybernetika.

[48]  James M. Robins,et al.  Estimation of Effects of Sequential Treatments by Reparameterizing Directed Acyclic Graphs , 1997, UAI.

[49]  J. Hardt,et al.  Suicidal Ideation, Parent–Child Relationships, and Adverse Childhood Experiences: A Cross-Validation Study Using a Graphical Markov Model , 2011, Child psychiatry and human development.

[50]  N. Wermuth,et al.  Joint response graphs and separation induced by triangular systems , 2004 .

[51]  Michael I. Jordan,et al.  Probabilistic Networks and Expert Systems , 1999 .

[52]  N. Wermuth.  PROBABILITY DISTRIBUTIONS WITH SUMMARY GRAPH STRUCTURE , 2010, 1003.3259.

[53]  T. Haavelmo.  The Statistical Implications of a System of Simultaneous Equations , 1943 .

[54]  Po-Ling Loh,et al.  Structure estimation for discrete graphical models: Generalized covariance matrices and their inverses , 2012, NIPS.

[55]  N. Wermuth,et al.  Distortion of effects caused by indirect confounding , 2008 .

[57]  J. Koster.  Marginalizing and conditioning in graphical models , 2002 .

[58]  D. Cox.  The Analysis of Multivariate Binary Data , 1972 .

[59]  T. W. Anderson,et al.  An Introduction to Multivariate Statistical Analysis , 1959 .

[60]  J. Hardt,et al.  Childhood Adversities and Suicide Attempts: A Retrospective Study , 2008, Journal of Family Violence.

[61]  Nanny Wermuth,et al.  An approximation to maximum likelihood estimates in reduced models , 1990 .

[62]  G. M. Marchetti,et al.  Chain graph models of multivariate regression type for categorical data , 2009, 0906.2098.

[63]  J. Pearl.  Causality: Models, Reasoning and Inference , 2000 .

[64]  Martin H. Schmidt,et al.  Developmental outcome of infants born with biological and psychosocial risks. , 1997, Journal of child psychology and psychiatry, and allied disciplines.

[65]  Z. Geng,et al.  Qualitative Evaluation of Associations by the Transitivity of the Association Signs , 2014, 1405.4258.

[66]  Zhi Geng,et al.  Qualitative evaluation of associations and validation of surrogacy by association transitivity , 2015 .

[67]  N. Wermuth,et al.  Linear Dependencies Represented by Chain Graphs , 1993 .

[68]  N. Wermuth,et al.  Tests of Linearity, Multivariate Normality and the Adequacy of Linear Scores , 1994 .

[69]  N. Wermuth,et al.  Graphical Models for Associations between Variables, some of which are Qualitative and some Quantitative , 1989 .

[70]  S. Wright,et al.  The Theory of Path Coefficients a Reply to Niles's Criticism. , 1923, Genetics.

[71]  M. Mouchart,et al.  Ignorable Common Information, Null sets and Basu’s First Theorem , 2005 .

[72]  N. Wermuth.  Traceable Regressions , 2012 .

[73]  S. Lauritzen,et al.  The TM algorithm for maximising a conditional likelihood function , 2001 .

[74]  Nanny Wermuth,et al.  Concepts and a case study for a flexible class of graphical Markov models , 2013, 1303.1436.

[75]  M. Drton.  Discrete chain graph models , 2009, 0909.0843.

[76]  Steffen L. Lauritzen,et al.  Independence properties of directed markov fields , 1990, Networks.

[77]  P. McCullagh,et al.  Generalized Linear Models , 1984 .

[78]  T. Hassard,et al.  Applied Linear Regression , 2005 .

[79]  N. Wermuth,et al.  Graphical and recursive models for contingency tables , 1983 .