Measuring spectrally-resolved information transfer for sender- and receiver-specific frequencies

Information transfer, measured by transfer entropy, is a key component of distributed computation. It is therefore important to understand the pattern of information transfer in order to unravel the distributed computational algorithms of a system. Since in many natural systems distributed computation is thought to rely on rhythmic processes a frequency resolved measure of information transfer is highly desirable. Here, we present a novel algorithm, and its efficient implementation, to identify separately frequencies sending and receiving information in a network. Our approach relies on the invertible maximum overlap discrete wavelet transform (MODWT) for the creation of surrogate data in the computation of transfer entropy and entirely avoids filtering of the original signals. The approach thereby avoids well-known problems due to phase shifts or the ineffectiveness of filtering in the information theoretic setting. We also show that measuring frequency-resolved information transfer is a partial information decomposition problem that cannot be fully resolved to date and discuss the implications of this issue. Last, we evaluate the performance of our algorithm on simulated data and apply it to human magnetoencephalography (MEG) recordings and to local field potential recordings in the ferret. In human MEG we demonstrate top-down information flow in temporal cortex from very high frequencies (above 100Hz) to both similarly high frequencies and to frequencies around 20Hz, i.e. a complex spectral configuration of cortical information transmission that has not been described before. In the ferret we show that the prefrontal cortex sends information at low frequencies (4-8 Hz) to early visual cortex (V1), while V1 receives the information at high frequencies (> 125 Hz). Author Summary Systems in nature that perform computations typically consist of a large number of relatively simple but interacting parts. In human brains, for example, billions of neurons work together to enable our cognitive abilities. This well-orchestrated teamwork requires information to be exchanged very frequently. In many cases this exchange happens rhythmically and, therefore, it seems beneficial for our understanding of physical systems if we could link the information exchange to specific rhythms. We here present a method to determine which rhythms send, and which rhythms receive information. Since many rhythms can interact at both sender and receiver side, we show that the interpretation of results always needs to consider that the above problem is tightly linked to partial information decomposition - an intriguing problem from information theory only solved recently, and only partly. We applied our novel method to information transfer in the human inferior temporal cortex, a brain region relevant for object perception, and unexpectedly found information transfer originating at very high frequencies at 100Hz and then forking to be received at both similarly high but also much lower frequencies around 20Hz. These results overturn the current standard assumption that low frequencies send information to high frequencies.

[1]  F. Takens Detecting strange attractors in turbulence , 1981 .

[2]  HighWire Press The journal of neuroscience : the official journal of the Society for Neuroscience. , 1981 .

[3]  W. Welch Algorithmic complexity: three NP- hard problems in computational statistics , 1982 .

[4]  A. Walden,et al.  Wavelet Methods for Time Series Analysis , 2000 .

[5]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[6]  Michael R. Chernick,et al.  Wavelet Methods for Time Series Analysis , 2001, Technometrics.

[7]  Mario Ragwitz,et al.  Markov models from data by simple nonlinear time series predictors in delay embedding spaces. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  M. Breakspear,et al.  Construction of multivariate surrogate sets from nonlinear data using the wavelet transform , 2003 .

[9]  G. Buzsáki Rhythms of the brain , 2006 .

[10]  C. Keylock,et al.  Constrained surrogate time series with preservation of the mean and variance structure. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  C. Bretherton,et al.  Maximal Overlap Wavelet Statistical Analysis With Application to Atmospheric Turbulence , 2006 .

[12]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[13]  D. Percival Analysis of Geophysical Time Series Using Discrete Wavelet Transforms: An Overview , 2008 .

[14]  A. Seth,et al.  Granger causality and transfer entropy are equivalent for Gaussian variables. , 2009, Physical review letters.

[15]  Vasily A. Vakorin,et al.  Confounding effects of indirect connections on causality estimation , 2009, Journal of Neuroscience Methods.

[16]  Joachim Gross,et al.  The effect of filtering on Granger causality based multivariate causality measures , 2010, NeuroImage.

[17]  C. Keylock Characterizing the structure of nonlinear systems using gradual wavelet reconstruction , 2010 .

[18]  Bernhard Schölkopf,et al.  Causal relationships between frequency bands of extracellular signals in visual cortex revealed by an information theoretic analysis , 2010, Journal of Computational Neuroscience.

[19]  Gordon Pipa,et al.  Transfer entropy—a model-free measure of effective connectivity for the neurosciences , 2010, Journal of Computational Neuroscience.

[20]  L. Faes,et al.  Information-based detection of nonlinear Granger causality in multivariate processes via a nonuniform embedding technique. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  A. Seth,et al.  Behaviour of Granger causality under filtering: Theoretical invariance and practical application , 2011, Journal of Neuroscience Methods.

[22]  Albert Y. Zomaya,et al.  The local information dynamics of distributed computation in complex systems , 2012 .

[23]  Albert Y. Zomaya,et al.  Local measures of information storage in complex distributed computation , 2012, Inf. Sci..

[24]  Joseph T. Lizier,et al.  Multivariate construction of effective computational networks from observational data , 2012 .

[25]  Viola Priesemann,et al.  Measuring Information-Transfer Delays , 2013, PloS one.

[26]  J. Matias Palva,et al.  Phase transfer entropy: A novel phase-based measure for directed connectivity in networks coupled by oscillatory interactions , 2014, NeuroImage.

[27]  Joseph T. Lizier,et al.  Directed Information Measures in Neuroscience , 2014 .

[28]  M. Wibral,et al.  Untangling cross-frequency coupling in neuroscience , 2014, Current Opinion in Neurobiology.

[29]  Ulrich Meyer,et al.  A Graph Algorithmic Approach to Separate Direct from Indirect Neural Interactions , 2015, PloS one.

[30]  H. Kennedy,et al.  Visual Areas Exert Feedforward and Feedback Influences through Distinct Frequency Channels , 2014, Neuron.

[31]  L. Levin,et al.  Biodiversity on the Rocks: Macrofauna Inhabiting Authigenic Carbonate at Costa Rica Methane Seeps , 2015, PloS one.

[32]  Danielle S. Bassett,et al.  Choosing Wavelet Methods, Filters, and Lengths for Functional Brain Network Construction , 2015, PloS one.

[33]  Michael Baldea,et al.  Root Cause Diagnosis of Plant-Wide Oscillations Based on Information Transfer in the Frequency Domain , 2016 .

[34]  Haley R Pipkins,et al.  Polyamine transporter potABCD is required for virulence of encapsulated but not nonencapsulated Streptococcus pneumoniae , 2017, PloS one.

[35]  A. Hyafil,et al.  Disharmony in neural oscillations. , 2017, Journal of neurophysiology.

[36]  Michael Wibral,et al.  Information-Theoretic Evidence for Predictive Coding in the Face-Processing System , 2016, The Journal of Neuroscience.

[37]  Yves Grenier,et al.  Non-linear auto-regressive models for cross-frequency coupling in neural time series , 2017, bioRxiv.

[38]  Niklaus J. Grünwald,et al.  Metacoder: An R package for visualization and manipulation of community taxonomic diversity data , 2016, bioRxiv.

[39]  L. Timmermann,et al.  The influence of filtering and downsampling on the estimation of transfer entropy , 2017, PloS one.

[40]  Viola Priesemann,et al.  Breakdown of local information processing may underlie isoflurane anesthesia effects , 2017, PLoS Comput. Biol..

[41]  Joseph T. Lizier,et al.  Information Decomposition of Target Effects from Multi-Source Interactions: Perspectives on Previous, Current and Future Work , 2018, Entropy.

[42]  Gemma Lancaster,et al.  Surrogate data for hypothesis testing of physical systems , 2018, Physics Reports.

[43]  Yang Hong,et al.  Cross-Frequency Transfer Entropy Characterize Coupling of Interacting Nonlinear Oscillators in Complex Systems , 2019, IEEE Transactions on Biomedical Engineering.

[44]  Milan Paluš,et al.  Coupling in complex systems as information transfer across time scales , 2019, Philosophical Transactions of the Royal Society A.

[45]  Joseph T. Lizier,et al.  Large-scale directed network inference with multivariate transfer entropy and hierarchical statistical testing , 2019, Network Neuroscience.

[46]  Joseph T. Lizier,et al.  IDTxl: The Information Dynamics Toolkit xl: a Python package for the efficient analysis of multivariate information dynamics in networks , 2018, J. Open Source Softw..