Joint estimation of multiple network Granger causal models

Joint regularized modeling framework is presented for the estimation of multiple Granger causal networks. High-dimensional network Granger models focus on learning the corresponding causal effects amongst a large set of distinct time series. They are operationalized through the formalism of Vector Autoregressive Models (VAR). The latter represent a popular class of time series models that has been widely used in applied econometrics and finance. In particular, the setting of the same set of variables being measured on different entities over time is considered (e.g. same set of economic indicators for multiple US states). Moreover, the covariance structure of the error term is assumed to exhibit low rank structure which can be recovered by a factor model. The framework allows to account for both sparsity and potential similarities between the related networks by introducing appropriate structural penalties on the transition matrices of the corresponding VAR models. An alternating directions method of multipliers (ADMM) algorithm is developed for solving the underlying joint estimation optimization problem. The performance of the joint estimation method is evaluated on synthetic data and illustrated on an application involving economic indicators for multiple US states11Code and data are available as online supplement..

[1]  D. Giannone,et al.  Large Bayesian vector auto regressions , 2010 .

[2]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[3]  Li Yao,et al.  Comparative Study of SVM Methods Combined with Voxel Selection for Object Category Classification on fMRI Data , 2011, PloS one.

[4]  C. Granger Investigating Causal Relations by Econometric Models and Cross-Spectral Methods , 1969 .

[5]  Hongzhe Li,et al.  Joint Estimation of Multiple High-dimensional Precision Matrices. , 2016, Statistica Sinica.

[6]  George Michailidis,et al.  Regularized Estimation and Testing for High-Dimensional Multi-Block Vector-Autoregressive Models , 2017, J. Mach. Learn. Res..

[7]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[8]  Euhanna Ghadimi,et al.  Optimal Parameter Selection for the Alternating Direction Method of Multipliers (ADMM): Quadratic Problems , 2013, IEEE Transactions on Automatic Control.

[9]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[10]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[11]  S. Geer,et al.  Confidence intervals for high-dimensional inverse covariance estimation , 2014, 1403.6752.

[12]  Jing Ma,et al.  Joint Structural Estimation of Multiple Graphical Models , 2016, J. Mach. Learn. Res..

[13]  E. Levina,et al.  Joint estimation of multiple graphical models. , 2011, Biometrika.

[14]  G. Michailidis,et al.  Regularized estimation in sparse high-dimensional time series models , 2013, 1311.4175.

[15]  Mark W. Watson,et al.  Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics , 2016 .

[16]  Jianqing Fan,et al.  Large covariance estimation by thresholding principal orthogonal complements , 2011, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[17]  G. Michailidis,et al.  Autoregressive models for gene regulatory network inference: sparsity, stability and causality issues. , 2013, Mathematical biosciences.

[18]  F. Diebold,et al.  Forecasting the Term Structure of Government Bond Yields , 2002 .

[19]  Ali Shojaie,et al.  Network granger causality with inherent grouping structure , 2012, J. Mach. Learn. Res..

[20]  Harrison H. Zhou,et al.  Optimal rates of convergence for covariance matrix estimation , 2010, 1010.3866.

[21]  Jean Boivin,et al.  Measuring the Effects of Monetary Policy: A Factor-Augmented Vector Autoregressive (FAVAR) Approach , 2003 .

[22]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[23]  Glenn D. Rudebusch,et al.  Federal Reserve Bank of San Francisco Working Paper Series Macro-finance Models of Interest Rates and the Economy Macro-finance Models of Interest Rates and the Economy , 2022 .

[24]  James H. Stock,et al.  Dynamic Factor Models , 2011 .

[25]  Manfred Deistler,et al.  AR systems and AR processes: the singular case , 2011, Commun. Inf. Syst..

[26]  Brian D. O. Anderson,et al.  Autoregressive models of singular spectral matrices☆ , 2012, Autom..

[27]  Roman Liska,et al.  Dynamic factors in the presence of blocks , 2011 .

[28]  E. Fama,et al.  Common risk factors in the returns on stocks and bonds , 1993 .

[29]  Jianqing Fan,et al.  High Dimensional Covariance Matrix Estimation in Approximate Factor Models , 2011, Annals of statistics.

[30]  J. Stock,et al.  Forecasting Using Principal Components From a Large Number of Predictors , 2002 .

[31]  J. Bai,et al.  Large Dimensional Factor Analysis , 2008 .

[32]  N. Meinshausen,et al.  Stability selection , 2008, 0809.2932.