A SINful Approach to Model Selection for Gaussian Concentration Graphs

A multivariate Gaussian graphical Markov model for an undirected graph G, also called a covariance selection model or concentration graph model, is defined in terms of the Markov properties, i.e., conditional independences associated with G, which in turn are equivalent to specified zeroes among the set of pairwise partial correlation coefficients. By means of Fisher’s z-transformation and Šidák’s correlation inequality, conservative simultaneous confidence intervals for the entire set of partial correlations can be obtained, leading to a simple method for model selection that controls the overall error rate for incorrect edge inclusion. The simultaneous p-values corresponding to the partial correlations are partitioned into three disjoint sets, a significant set S, an indeterminate set I, and a non-significant set N. Our SIN model selection method selects two graphs, a graph ĜSI whose edges correspond to the set S ∪ I, and a more conservative graph ĜS whose edges correspond to S only. Prior information about the presence and/or absence of particular edges can be incorporated readily. Similar considerations apply to covariance graph models, which are defined in terms of marginal independence rather than conditional independence.

[1]  Calyampudi R. Rao,et al.  Tests of significance in multivariate analysis. , 1948, Biometrika.

[2]  Z. Šidák Rectangular Confidence Regions for the Means of Multivariate Normal Distributions , 1967 .

[3]  M. R. Leadbetter,et al.  Extremes and Related Properties of Random Sequences and Processes: Springer Series in Statistics , 1983 .

[4]  K. Larntz,et al.  A Simple Test for the Equality of Correlation Matrices , 1988 .

[5]  N. Wermuth,et al.  Linear Dependencies Represented by Chain Graphs , 1993 .

[6]  G. Kauermann On a dualization of graphical Gaussian models , 1996 .

[7]  Joe Whittaker,et al.  Standard errors for the parameters of graphical Gaussian models , 1996, Stat. Comput..

[8]  Michael I. Jordan Graphical Models , 2003 .

[9]  P. Green,et al.  Decomposable graphical Gaussian model determination , 1999 .

[10]  Valentina Leucari,et al.  Model determination for directed acyclic graphs , 2001 .

[11]  P. Spirtes,et al.  Ancestral graph Markov models , 2002 .

[12]  A. Roverato Hyper Inverse Wishart Distribution for Non-decomposable Graphs and its Application to Bayesian Inference for Gaussian Graphical Models , 2002 .

[13]  Graham J. Wills,et al.  Introduction to graphical modelling , 1995 .

[14]  G. Roberts,et al.  Bayesian Inference For Nondecomposable Graphical Gaussian Models. , 2003 .

[15]  G. Roberts,et al.  Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions , 2003 .

[16]  Thomas S. Richardson,et al.  A New Algorithm for Maximum Likelihood Estimation in Gaussian Graphical Models for Marginal Independence , 2002, UAI.

[17]  T. Richardson,et al.  Multimodality of the likelihood in the bivariate seemingly unrelated regressions model , 2004 .

[18]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .