A Statistical Framework to Infer Delay and Direction of Information Flow from Measurements of Complex Systems

In neuroscience, data are typically generated from neural network activity. The resulting time series represent measurements from spatially distributed subsystems with complex interactions, weakly coupled to a high-dimensional global system. We present a statistical framework to estimate the direction of information flow and its delay in measurements from systems of this type. Informed by differential topology, gaussian process regression is employed to reconstruct measurements of putative driving systems from measurements of the driven systems. These reconstructions serve to estimate the delay of the interaction by means of an analytical criterion developed for this purpose. The model accounts for a range of possible sources of uncertainty, including temporally evolving intrinsic noise, while assuming complex nonlinear dependencies. Furthermore, we show that if information flow is delayed, this approach also allows for inference in strong coupling scenarios of systems exhibiting synchronization phenomena. The validity of the method is demonstrated with a variety of delay-coupled chaotic oscillators. In addition, we show that these results seamlessly transfer to local field potentials in cat visual cortex.

[1]  Ingo Steinwart,et al.  On the Influence of the Kernel on the Consistency of Support Vector Machines , 2002, J. Mach. Learn. Res..

[2]  Carl de Boor,et al.  A Practical Guide to Splines , 1978, Applied Mathematical Sciences.

[3]  Pascal Fries,et al.  Communication through coherence with inter-areal delays , 2015, Current Opinion in Neurobiology.

[4]  A. E. Hoerl,et al.  Ridge regression: biased estimation for nonorthogonal problems , 2000 .

[5]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[6]  Hendrik Broer,et al.  Dynamical Systems and Chaos , 2010 .

[7]  J. Huke.  Embedding Nonlinear Dynamical Systems: A Guide to Takens' Theorem , 2006 .

[8]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[9]  Floris Takens,et al.  The reconstruction theorem for endomorphisms , 2002 .

[10]  S. Baker,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[11]  J. Berger.  Statistical Decision Theory and Bayesian Analysis , 1988 .

[12]  B. Efron,et al.  Second thoughts on the bootstrap , 2003 .

[13]  R. Baierlein.  Probability Theory: The Logic of Science , 2004 .

[14]  J. Stark,et al.  Delay Embeddings for Forced Systems. I. Deterministic Forcing , 1999 .

[15]  W. Rugh.  Nonlinear System Theory: The Volterra / Wiener Approach , 1981 .

[16]  Voss,et al.  Anticipating chaotic synchronization , 2000, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[17]  David S. Broomhead,et al.  Delay Embeddings for Forced Systems. II. Stochastic Forcing , 2003, J. Nonlinear Sci..

[18]  Bernhard Schölkopf,et al.  A Unifying View of Wiener and Volterra Theory and Polynomial Kernel Regression , 2006, Neural Computation.

[19]  Achim Klenke,et al.  Probability theory - a comprehensive course , 2008, Universitext.

[20]  C. Granger.  Investigating Causal Relations by Econometric Models and Cross-Spectral Methods , 1969 .

[21]  Vito Volterra.  Theory of Permutable Functions , 1915 .

[22]  Han Wang,et al.  Real-time corner detection algorithm for motion estimation , 1995, Image Vis. Comput..

[23]  D. Aeyels.  GENERIC OBSERVABILITY OF DIFFERENTIABLE SYSTEMS , 1981 .

[24]  A. Peters,et al.  Numerical relationships between geniculocortical afferents and pyramidal cell modules in cat primary visual cortex. , 1993, Cerebral cortex.

[25]  Edwin T. Jaynes.  Prior Probabilities , 2010, Encyclopedia of Machine Learning.

[26]  Viola Priesemann,et al.  Measuring Information-Transfer Delays , 2013, PloS one.

[27]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[28]  G. Sugihara,et al.  Generalized Theorems for Nonlinear State Space Reconstruction , 2011, PloS one.

[29]  Jaroslav Stark,et al.  Reconstruction and cross-prediction in coupled map lattices using spatio-temporal embedding techniques , 1998 .

[30]  C. Rasmussen,et al.  Gaussian Process Priors with Uncertain Inputs - Application to Multiple-Step Ahead Time Series Forecasting , 2002, NIPS.

[31]  S. Sundararajan,et al.  Predictive Approaches for Choosing Hyperparameters in Gaussian Processes , 1999, Neural Computation.

[32]  G. Kitagawa,et al.  Information Criteria and Statistical Modeling , 2007 .

[33]  Parlitz,et al.  Generalized synchronization, predictability, and equivalence of unidirectionally coupled dynamical systems. , 1996, Physical review letters.

[34]  M. Hallett,et al.  Identifying true brain interaction from EEG data using the imaginary part of coherency , 2004, Clinical Neurophysiology.

[35]  Gordon Pipa,et al.  Transfer entropy—a model-free measure of effective connectivity for the neurosciences , 2010, Journal of Computational Neuroscience.

[36]  H. Broer.  Dynamical systems and turbulence, Warwick 1980 , 1981 .

[37]  L. Shampine,et al.  Solving DDEs in MATLAB , 2001 .

[38]  A. N. Sharkovskiĭ.  Dynamic systems and turbulence , 1989 .

[39]  P. Fries.  Neuronal gamma-band synchronization as a fundamental process in cortical computation. , 2009, Annual review of neuroscience.

[40]  Pyragas,et al.  Weak and strong synchronization of chaos. , 1996, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[41]  K. Schmidt,et al.  Multiplicative mechanism of lateral interactions revealed by controlling interhemispheric input. , 2013, Cerebral cortex.

[42]  Jianhong Wu,et al.  Bifurcation Theory of Functional Differential Equations , 2013 .

[43]  George Sugihara,et al.  Detecting Causality in Complex Ecosystems , 2012, Science.

[44]  K. Harris.  Neural signatures of cell assembly organization , 2005, Nature Reviews Neuroscience.

[45]  Steven Roman.  Advanced Linear Algebra , 1992 .

[46]  W. Singer,et al.  Frontiers in Integrative Neuroscience Integrative Neuroscience Neural Synchrony in Cortical Networks: History, Concept and Current Status , 2022 .