Residual Predictive Information Flow in the Tight Coupling Limit: Analytic Insights from a Minimalistic Model

In a coupled system, predictive information flows from the causing to the caused variable. The amount of transferred predictive information can be quantified through the use of transfer entropy or, for Gaussian variables, equivalently via Granger causality. It is natural to expect and has been repeatedly observed that a tight coupling does not permit to reconstruct a causal connection between causing and caused variables. Here, we show that for a model of interacting social groups, carried from the master equation to the Fokker–Planck level, a residual predictive information flow can remain for a pair of uni-directionally coupled variables even in the limit of infinite coupling strength. We trace this phenomenon back to the question of how the synchronizing force and the noise strength scale with the coupling strength. A simplified model description allows us to derive analytic expressions that fully elucidate the interplay between deterministic and stochastic model parts.

[1]  A. Seth,et al.  Granger causality and transfer entropy are equivalent for Gaussian variables. , 2009, Physical review letters.

[2]  K. Vahala Handbook of stochastic methods for physics, chemistry and the natural sciences , 1986, IEEE Journal of Quantum Electronics.

[3]  Daniele Marinazzo,et al.  Radial basis function approach to nonlinear Granger causality of time series. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[4]  Edmund J. Crampin,et al.  Enzyme catalyzed reactions: From experiment to computational mechanism reconstruction , 2010, Comput. Biol. Chem..

[5]  Dirk Husmeier,et al.  Inferring species interaction networks from species abundance data: A comparative evaluation of various statistical and machine learning methods , 2010, Ecol. Informatics.

[6]  Klaus Lehnertz,et al.  Distinguishing between direct and indirect directional couplings in large oscillator networks: Partial or non-partial phase analyses? , 2016, Chaos.

[7]  Todd P. Coleman,et al.  Estimating the directed information to infer causal relationships in ensemble neural spike train recordings , 2010, Journal of Computational Neuroscience.

[8]  P. McSharry,et al.  Reconstructing biochemical pathways from time course data , 2007, Proteomics.

[9]  Wulfram Gerstner,et al.  Extraction of Network Topology From Multi-Electrode Recordings: Is there a Small-World Effect? , 2011, Front. Comput. Neurosci..

[10]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[11]  J. Peinke,et al.  Granger-causality maps of diffusion processes. , 2016, Physical review. E.

[12]  Daniele Marinazzo,et al.  Kernel method for nonlinear granger causality. , 2007, Physical review letters.

[13]  M Palus,et al.  Synchronization as adjustment of information rates: detection from bivariate time series. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  Klaus Lehnertz,et al.  Estimating nonlinear interdependences in dynamical systems using cellular nonlinear networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  Jed A. Fuhrman,et al.  Marine microbial community dynamics and their ecological interpretation , 2015, Nature Reviews Microbiology.

[16]  A. Seth,et al.  Granger causality for state-space models. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[17]  A. Seth,et al.  Behaviour of Granger causality under filtering: Theoretical invariance and practical application , 2011, Journal of Neuroscience Methods.

[18]  M. Rosenblum,et al.  Identification of coupling direction: application to cardiorespiratory interaction. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  Anil K. Seth,et al.  The MVGC multivariate Granger causality toolbox: A new approach to Granger-causal inference , 2014, Journal of Neuroscience Methods.

[20]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[21]  John Scott Social Network Analysis , 1988 .

[22]  Matthäus Staniek,et al.  Symbolic transfer entropy. , 2008, Physical review letters.

[23]  A. Neumaier,et al.  Multivariate Autoregressive and Ornstein-Uhlenbeck Processes: Estimates for Order, Parameters, Spect , 1997 .

[24]  Klaus Lehnertz,et al.  Measuring interdependences in dissipative dynamical systems with estimated Fokker-Planck coefficients. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  Fokker-Planck Equation Treatment of Interacting Social Groups , 1973 .

[26]  Helmut Ltkepohl,et al.  New Introduction to Multiple Time Series Analysis , 2007 .