Dynamical Structure Function and Granger Causality: Similarities and differences

Causal networks are essential in many applications to illustrate causal relations in dynamical systems. In a view of statistics, Granger Causality (GC) gives a definition for causal ordering of time series, which implies a parametric model for stationary processes. In a systematic view, Dynamical Structure Function (DSF) is proposed to provide a general parametric representation for linear causal networks based on state space representations. It is difficult to determine which definition should be adopted for a particular application. By introducing an intermediate form of DSF, this article connects GC for stationary processes with DSF. Both GC and DSF essentially represent the same notion of causality but with important differences with respect to how they encode latent variables. This article also addresses the relations between graphs defined by GC and DSF. Furthermore, the uniqueness of parametric representations is addressed, which is essential in network inference. Results from different fields are surveyed and categorized into two categories - networks with exogeneity and networks without exogeneity. Limitations on sufficient conditions to guarantee exact identification are discussed under different assumptions on systems. In the end, a figure is used to summarize the relationships between various representations of causal dynamical networks and their identifiability conditions in LTI systems.

[1]  Julius S. Bendat,et al.  Stationary Random Processes , 2012 .

[2]  Murti V. Salapaka,et al.  Network reconstruction of dynamical polytrees with unobserved nodes , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[3]  Eric Renault,et al.  Causality and separability , 2015 .

[4]  Sean Warnick,et al.  System-Theoretic Approaches to Network Reconstruction , 2009 .

[5]  Sean C. Warnick,et al.  Dynamical structure function identifiability conditions enabling signal structure reconstruction , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[6]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[7]  Sean C. Warnick,et al.  Necessary and Sufficient Conditions for Dynamical Structure Reconstruction of LTI Networks , 2008, IEEE Transactions on Automatic Control.

[8]  Samuel J. Mason,et al.  Feedback Theory-Some Properties of Signal Flow Graphs , 1953, Proceedings of the IRE.

[9]  C. Hsiao Autoregressive modeling and causal ordering of economic variables , 1982 .

[10]  John Geweke,et al.  Testing the exogeneity specification in the complete dynamic simultaneous equation model , 1978 .

[11]  C. Sims MACROECONOMICS AND REALITY , 1977 .

[12]  M. Eichler Granger causality and path diagrams for multivariate time series , 2007 .

[13]  S. J. Mason Feedback Theory-Further Properties of Signal Flow Graphs , 1956, Proceedings of the IRE.

[14]  P. Masani RECENT TRENDS IN MULTIVARIATE PREDICTION THEORY , 1966 .

[15]  U. Alon Network motifs: theory and experimental approaches , 2007, Nature Reviews Genetics.

[16]  C. Sims Money, Income, and Causality , 1972 .

[17]  S. Warnick,et al.  Mathematical relationships between representations of structure in linear interconnected dynamical systems , 2011, Proceedings of the 2011 American Control Conference.

[18]  Eric R. Ziegel,et al.  Analysis of Financial Time Series , 2002, Technometrics.

[19]  C J Isham,et al.  Methods of Modern Mathematical Physics, Vol 1: Functional Analysis , 1972 .

[20]  T. Richardson Markov Properties for Acyclic Directed Mixed Graphs , 2003 .

[21]  Ruey S. Tsay,et al.  Analysis of Financial Time Series: Tsay/Analysis of Financial Time Series , 2005 .

[22]  Pramod P. Khargonekar,et al.  A global identifiability condition for consensus networks on tree graphs , 2015, 2015 American Control Conference (ACC).

[23]  Ye Yuan,et al.  Network Reconstruction from Intrinsic Noise , 2013, ArXiv.

[24]  Richard A. Davis,et al.  Time Series: Theory and Methods , 2013 .

[25]  Donatello Materassi,et al.  Topological identification in networks of dynamical systems , 2008, 2008 47th IEEE Conference on Decision and Control.

[26]  Sean C. Warnick,et al.  Robust dynamical network structure reconstruction , 2011, Autom..

[27]  Henrik Sandberg,et al.  Representing structure in linear interconnected dynamical systems , 2010, 49th IEEE Conference on Decision and Control (CDC).

[28]  Gary R. Skoog Causality characterizations: bivariate, trivariate, and multivariate propositions , 1976 .

[29]  B. Anderson,et al.  Simulation of stationary stochastic processes , 1968 .

[30]  E. Hannan The identification of vector mixed autoregressive-moving average system , 1969 .

[31]  Michael Eichler,et al.  On the Evaluation of Information Flow in Multivariate Systems by the Directed Transfer Function , 2006, Biological Cybernetics.