Granger Causality: A Review and Recent Advances

Introduced more than a half-century ago, Granger causality has become a popular tool for analyzing time series data in many application domains, from economics and finance to genomics and neuroscience. Despite this popularity, the validity of this framework for inferring causal relationships among time series has remained the topic of continuous debate. Moreover, while the original definition was general, limitations in computational tools have constrained the applications of Granger causality to primarily simple bivariate vector autoregressive processes. Starting with a review of early developments and debates, this article discusses recent advances that address various shortcomings of the earlier approaches, from models for high-dimensional time series to more recent developments that account for nonlinear and non-Gaussian observations and allow for subsampled and mixed-frequency time series. Expected final online publication date for the Annual Review of Statistics and Its Application, Volume 9 is March 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

[1]  G. Raskutti,et al.  Testing for high-dimensional network parameters in auto-regressive models , 2018, Electronic Journal of Statistics.

[2]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[3]  Mladen Kolar,et al.  Statistical Inference for Networks of High-Dimensional Point Processes , 2020, ArXiv.

[4]  Bernhard Pfaff,et al.  VAR, SVAR and SVEC Models: Implementation Within R Package vars , 2008 .

[5]  Y. Matsuda.  Graphical modelling for multivariate time series , 2004 .

[6]  L. Kilian,et al.  Structural Vector Autoregressive Analysis , 2017 .

[7]  C. Granger.  Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[8]  Emily B. Fox,et al.  The Convex Mixture Distribution: Granger Causality for Categorical Time Series , 2021, SIAM J. Math. Data Sci..

[9]  Aapo Hyvärinen,et al.  Estimation of a Structural Vector Autoregression Model Using Non-Gaussianity , 2010, J. Mach. Learn. Res..

[10]  A. Onatski.  Determining the Number of Factors from Empirical Distribution of Eigenvalues , 2010, The Review of Economics and Statistics.

[11]  Peter A. Zadrozny,et al.  AN EXTENDED YULE-WALKER METHOD FOR ESTIMATING A VECTOR AUTOREGRESSIVE MODEL WITH MIXED-FREQUENCEY DATA , 1999 .

[12]  Seung C. Ahn,et al.  Eigenvalue Ratio Test for the Number of Factors , 2013 .

[13]  D. Giannone,et al.  Large Bayesian vector auto regressions , 2010 .

[14]  Roberto Casarin,et al.  Bayesian nonparametric sparse VAR models , 2016, Journal of Econometrics.

[15]  Mingzhou Ding,et al.  Estimating Granger causality from fourier and wavelet transforms of time series data. , 2007, Physical review letters.

[16]  Timo Teräsvirta,et al.  Modelling nonlinear economic time series , 2010 .

[17]  W. Ching,et al.  A New Estimation Method for Multivariate Markov Chain Model with Application in Demand Predictions , 2010, 2010 Third International Conference on Business Intelligence and Financial Engineering.

[18]  M. Ng,et al.  A multivariate Markov chain model for categorical data sequences and its applications in demand predictions , 2002 .

[19]  Daniele Marinazzo,et al.  Advancing functional connectivity research from association to causation , 2019, Nature Neuroscience.

[20]  Jian Liu,et al.  Hierarchical Attention-Based Recurrent Highway Networks for Time Series Prediction , 2018, ArXiv.

[21]  Michael P. Clements,et al.  Dynamic Factor Models , 2011, Financial Econometrics.

[22]  Chenchuramaiah T. Bathala.  What Explains the Stock Market's Reaction to Federal Reserve Policy? , 2005 .

[23]  P. Spirtes,et al.  Review of Causal Discovery Methods Based on Graphical Models , 2019, Front. Genet..

[24]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.

[25]  David Cai,et al.  Analysis of sampling artifacts on the Granger causality analysis for topology extraction of neuronal dynamics , 2014, Front. Comput. Neurosci..

[26]  P. Bickel,et al.  Large Vector Auto Regressions , 2011, 1106.3915.

[27]  E. Fox,et al.  Neural Granger Causality for Nonlinear Time Series , 2018, 1802.05842.

[28]  Ke Zhu,et al.  Confidence intervals for parameters in high-dimensional sparse vector autoregression , 2020, Comput. Stat. Data Anal..

[29]  Norman R. Swanson,et al.  Temporal aggregation and spurious instantaneous causality in multiple time series models , 2002 .

[30]  Shouyang Wang,et al.  Granger Causality in Risk and Detection of Extreme Risk Spillover Between Financial Markets , 2009 .

[31]  Pedro D. Maia,et al.  Inferring connectivity in networked dynamical systems: Challenges using Granger causality. , 2016, Physical review. E.

[32]  C. Weiß,et al.  An Introduction to Discrete-Valued Time Series , 2018 .

[33]  Steven L. Bressler,et al.  Wiener–Granger Causality: A well established methodology , 2011, NeuroImage.

[34]  Kshitij Khare,et al.  High-Dimensional Posterior Consistency in Bayesian Vector Autoregressive Models , 2018, Journal of the American Statistical Association.

[35]  Hulin Wu,et al.  Sparse Additive Ordinary Differential Equations for Dynamic Gene Regulatory Network Modeling , 2014, Journal of the American Statistical Association.

[36]  J. Geweke,et al.  Measurement of Linear Dependence and Feedback between Multiple Time Series , 1982 .

[37]  Jean Boivin,et al.  Measuring the Effects of Monetary Policy: A Factor-Augmented Vector Autoregressive (FAVAR) Approach , 2003 .

[38]  G. Michailidis,et al.  Regularized estimation in sparse high-dimensional time series models , 2013, 1311.4175.

[39]  Eric T. Shea-Brown,et al.  The Multivariate Hawkes Process in High Dimensions: Beyond Mutual Excitation , 2017, 1707.04928.

[40]  Dongchu Sun,et al.  Bayesian stochastic search for VAR model restrictions , 2008 .

[41]  Emily B. Fox,et al.  Spatio-Temporal Low Count Processes with Application to Violent Crime Events , 2013, 1304.5642.

[42]  João Ricardo Sato,et al.  Modeling gene expression regulatory networks with the sparse vector autoregressive model , 2007, BMC Systems Biology.

[43]  Michael I. Jordan,et al.  Bayesian Nonparametric Inference of Switching Dynamic Linear Models , 2010, IEEE Transactions on Signal Processing.

[44]  William B. Nicholson,et al.  BigVAR: Tools for Modeling Sparse High-Dimensional Multivariate Time Series , 2017, 1702.07094.

[45]  Alan Agresti,et al.  Categorical Data Analysis , 2003 .

[46]  Bernhard Schölkopf,et al.  Discovering Temporal Causal Relations from Subsampled Data , 2015, ICML.

[47]  Fang Han,et al.  Robust Estimation of Transition Matrices in High Dimensional Heavy-tailed Vector Autoregressive Processes , 2015, ICML.

[48]  C. Sims.  MACROECONOMICS AND REALITY , 1977 .

[49]  M. Eichler.  Granger causality and path diagrams for multivariate time series , 2007 .

[50]  D. Stephenson,et al.  Granger Causality of Coupled Climate Processes: Ocean Feedback on the North Atlantic Oscillation , 2006 .

[51]  E. Fox,et al.  Identifiability and estimation of structural vector autoregressive models for subsampled and mixed-frequency time series. , 2017, Biometrika.

[52]  J. A. Stewart,et al.  Nonlinear Time Series Analysis , 2015 .

[53]  Ali Shojaie,et al.  Discovering graphical Granger causality using the truncating lasso penalty , 2010, Bioinform..

[54]  L. Bauwens,et al.  Multivariate GARCH Models: A Survey , 2003 .

[55]  R. Dahlhaus,et al.  Graphical Modeling for Multivariate Hawkes Processes with Nonparametric Link Functions , 2016, 1605.06759.

[56]  Ali Shojaie,et al.  Nearly assumptionless screening for the mutually-exciting multivariate Hawkes process. , 2017, Electronic journal of statistics.

[57]  David Veredas,et al.  Temporal Aggregation of Univariate and Multivariate Time Series Models: A Survey , 2008 .

[58]  Eric P. Xing,et al.  Tree-Guided Group Lasso for Multi-Task Regression with Structured Sparsity , 2009, ICML.

[59]  Lourens J. Waldorp,et al.  mgm: Estimating Time-Varying Mixed Graphical Models in High-Dimensional Data , 2015, Journal of Statistical Software.

[60]  João Nicolau.  A New Model for Multivariate Markov Chains , 2014 .

[61]  L. A. Cox,et al.  Has reducing fine particulate matter and ozone caused reduced mortality rates in the United States? , 2015, Annals of epidemiology.

[62]  Junzhou Huang,et al.  Learning with structured sparsity , 2009, ICML '09.

[63]  Gesa Hartwigsen,et al.  Inferring Causality from Noninvasive Brain Stimulation in Cognitive Neuroscience , 2020, Journal of Cognitive Neuroscience.

[64]  Le Song,et al.  Learning Social Infectivity in Sparse Low-rank Networks Using Multi-dimensional Hawkes Processes , 2013, AISTATS.

[65]  Ali Shojaie,et al.  Network granger causality with inherent grouping structure , 2012, J. Mach. Learn. Res..

[66]  Vince D. Calhoun,et al.  Rate-Agnostic (Causal) Structure Learning , 2015, NIPS.

[67]  Richard A. Davis,et al.  Sparse Vector Autoregressive Modeling , 2012, 1207.0520.

[68]  Joshua B. Tenenbaum,et al.  Infinite Dynamic Bayesian Networks , 2011, ICML.

[69]  Helmut Lütkepohl,et al.  Non-causality due to omitted variables , 1982 .

[70]  G. Karniadakis,et al.  Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systems , 2018, 1801.01236.

[71]  George Michailidis,et al.  Low Rank and Structured Modeling of High-Dimensional Vector Autoregressions , 2018, IEEE Transactions on Signal Processing.

[72]  J. Florens,et al.  A Note on Noncausality , 1982 .

[73]  G. Michailidis,et al.  Network Reconstruction Using Nonparametric Additive ODE Models , 2014, PloS one.

[74]  Richard G. Sheehan,et al.  Sunspots and Cycles: A Test of Causation , 1982 .

[75]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[76]  C. Granger.  Some recent development in a concept of causality , 1988 .

[77]  Robert B. Litterman.  Forecasting with Bayesian Vector Autoregressions-Five Years of Experience , 1984 .

[78]  Filippo Moauro,et al.  Temporal Disaggregation Using Multivariate Structural Time Series Models , 2005 .

[79]  Mariusz Maziarz,et al.  A review of the Granger-causality fallacy , 2015, Journal of Philosophical Economics.

[80]  Gary Chamberlain,et al.  The General Equivalence of Granger and Sims Causality , 1982 .

[81]  Helmut Ltkepohl,et al.  New Introduction to Multiple Time Series Analysis , 2007 .

[82]  S. Billings.  Nonlinear System Identification: NARMAX Methods in the Time, Frequency, and Spatio-Temporal Domains , 2013 .

[83]  C. Granger.  Testing for causality: a personal viewpoint , 1980 .

[84]  Patrick L Purdon,et al.  A study of problems encountered in Granger causality analysis from a neuroscience perspective , 2017, Proceedings of the National Academy of Sciences.

[85]  Hongyuan Zha,et al.  Learning Granger Causality for Hawkes Processes , 2016, ICML.

[86]  P. Saikkonen,et al.  Identification and estimation of non-Gaussian structural vector autoregressions , 2015 .

[87]  Nigar Hashimzade,et al.  Handbook of Research Methods and Applications in Empirical Macroeconomics Handbooks of Research Methods and Applications Handbook of Research Methods and Applications in Empirical Macroeconomics 22 Structural Vector Autoregressions* , 2022 .

[88]  Sarah Granger,et al.  Social Engineering Fundamentals, Part I: Hacker Tactics , 2003 .

[89]  Lasso and probabilistic inequalities for multivariate point processes , 2015, 1208.0570.

[90]  Jürgen Kurths,et al.  Escaping the curse of dimensionality in estimating multivariate transfer entropy. , 2012, Physical review letters.

[91]  D. Danks,et al.  Learning Causal Structure from Undersampled Time Series , 2013 .

[92]  Stephen A. Billings,et al.  The Determination of Multivariable Nonlinear Models for Dynamic Systems Using neural Networks , 1996 .

[93]  Ali Shojaie,et al.  Network Reconstruction From High-Dimensional Ordinary Differential Equations , 2016, Journal of the American Statistical Association.

[94]  B. Bernanke,et al.  The Federal Funds Rate and the Channels of Monetary Transnission , 1990 .

[95]  J. Boot,et al.  Further Methods of Derivation of Quarterly Figures from Annual Data , 1967 .

[96]  D. Stram,et al.  A METHODOLOGICAL NOTE ON THE DISAGGREGATION OF TIME SERIES TOTALS , 1986 .

[97]  Han Liu,et al.  A Unified Theory of Confidence Regions and Testing for High-Dimensional Estimating Equations , 2015, Statistical Science.

[98]  Mark W. Watson,et al.  Consistent Estimation of the Number of Dynamic Factors in a Large N and T Panel , 2007 .

[99]  Gordon Pipa,et al.  Transfer entropy—a model-free measure of effective connectivity for the neurosciences , 2010, Journal of Computational Neuroscience.

[100]  A. Raftery.  A model for high-order Markov chains , 1985 .

[101]  M. West,et al.  Bayesian Analysis of Latent Threshold Dynamic Models , 2013 .

[102]  P. Holland.  Statistics and Causal Inference , 1985 .

[103]  Alex Graves,et al.  Supervised Sequence Labelling , 2012 .

[104]  Sergey M. Plis,et al.  Causal Discovery from Subsampled Time Series Data by Constraint Optimization , 2016, Probabilistic Graphical Models.

[105]  B. Anderson,et al.  MULTIVARIATE AR SYSTEMS AND MIXED FREQUENCY DATA: G-IDENTIFIABILITY AND ESTIMATION , 2016, Econometric Theory.

[106]  M. Pesaran,et al.  Infinite Dimensional VARs and Factor Models , 2009, SSRN Electronic Journal.

[107]  Zhenyan Zhu,et al.  Economic growth and energy consumption revisited — Evidence from linear and nonlinear Granger causality , 2008 .

[108]  Zoubin Ghahramani,et al.  Learning Dynamic Bayesian Networks , 1997, Summer School on Neural Networks.

[109]  Naoki Abe,et al.  Grouped graphical Granger modeling for gene expression regulatory networks discovery , 2009, Bioinform..

[110]  Olivier J. J. Michel,et al.  On directed information theory and Granger causality graphs , 2010, Journal of Computational Neuroscience.

[111]  A. Seth,et al.  Granger Causality Analysis in Neuroscience and Neuroimaging , 2015, The Journal of Neuroscience.

[112]  William B. Nicholson,et al.  VARX-L: Structured Regularization for Large Vector Autoregressions with Exogenous Variables , 2015, 1508.07497.

[113]  Sunspots and Cycles: Comment , 1983 .

[114]  Rebecca Willett,et al.  Inference of High-dimensional Autoregressive Generalized Linear Models , 2016, ArXiv.

[115]  Ozgur Kisi,et al.  River Flow Modeling Using Artificial Neural Networks , 2004 .

[116]  George Michailidis,et al.  Multiple Change Points Detection in Low Rank and Sparse High Dimensional Vector Autoregressive Models , 2020, IEEE Transactions on Signal Processing.

[117]  Roberto Casarin,et al.  Sparse Graphical Vector Autoregression: A Bayesian Approach , 2014 .

[118]  A. Raftery,et al.  The Mixture Transition Distribution Model for High-Order Markov Chains and Non-Gaussian Time Series , 2002 .

[119]  Rahmat Shoureshi,et al.  Neural networks for system identification , 1989, IEEE Control Systems Magazine.

[120]  Frank Schorfheide,et al.  Real-Time Forecasting With a Mixed-Frequency VAR , 2013 .