Transfer entropy—a model-free measure of effective connectivity for the neurosciences

Understanding causal relationships, or effective connectivity, between parts of the brain is of utmost importance because a large part of the brain’s activity is thought to be internally generated and, hence, quantifying stimulus response relationships alone does not fully describe brain dynamics. Past efforts to determine effective connectivity mostly relied on model based approaches such as Granger causality or dynamic causal modeling. Transfer entropy (TE) is an alternative measure of effective connectivity based on information theory. TE does not require a model of the interaction and is inherently non-linear. We investigated the applicability of TE as a metric in a test for effective connectivity to electrophysiological data based on simulations and magnetoencephalography (MEG) recordings in a simple motor task. In particular, we demonstrate that TE improved the detectability of effective connectivity for non-linear interactions, and for sensor level MEG signals where linear methods are hampered by signal-cross-talk due to volume conduction.

[1]  K. Hlavácková-Schindler,et al.  Causality detection based on information-theoretic approaches in time series analysis , 2007 .

[2]  C. Granger.  Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[3]  J. Martinerie,et al.  Statistical assessment of nonlinear causality: application to epileptic EEG signals , 2003, Journal of Neuroscience Methods.

[4]  C. Granger.  Long memory relationships and the aggregation of dynamic models , 1980 .

[5]  A. Schnitzler,et al.  The neural basis of intermittent motor control in humans , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[6]  H. Swadlow.  Efferent neurons and suspected interneurons in motor cortex of the awake rabbit: axonal properties, sensory receptive fields, and subthreshold synaptic inputs. , 1994, Journal of neurophysiology.

[7]  L. Cao.  Practical method for determining the minimum embedding dimension of a scalar time series , 1997 .

[8]  Rodrigo Quian Quiroga,et al.  Nonlinear multivariate analysis of neurophysiological signals , 2005, Progress in Neurobiology.

[9]  H. Swadlow.  Physiological properties of individual cerebral axons studied in vivo for as long as one year. , 1985, Journal of neurophysiology.

[10]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  F. Takens.  Detecting strange attractors in turbulence , 1981 .

[12]  Boris Gourévitch,et al.  Evaluating information transfer between auditory cortical neurons. , 2007, Journal of neurophysiology.

[13]  J. A. Stewart,et al.  Nonlinear Time Series Analysis , 2015 .

[14]  T. Schreiber,et al.  Information transfer in continuous processes , 2002 .

[15]  J. Donoghue,et al.  Neural discharge and local field potential oscillations in primate motor cortex during voluntary movements. , 1998, Journal of neurophysiology.

[16]  E. Fetz,et al.  Oscillatory activity in sensorimotor cortex of awake monkeys: synchronization of local field potentials and relation to behavior. , 1996, Journal of neurophysiology.

[17]  J. Victor.  Binless strategies for estimation of information from neural data. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[18]  D. Rand,et al.  Dynamical Systems and Turbulence, Warwick 1980 , 1981 .

[19]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[20]  G. Rangarajan,et al.  Mitigating the effects of measurement noise on Granger causality. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  Hans-Jochen Heinze,et al.  Directed information flow—A model free measure to analyze causal interactions in event related EEG‐MEG‐experiments , 2008, Human brain mapping.

[22]  H. Swadlow,et al.  Observations on impulse conduction along central axons. , 1975, Proceedings of the National Academy of Sciences of the United States of America.

[23]  Armin Fuchs,et al.  Neuromagnetic motor fields accompanying self-paced rhythmic finger movement at different rates , 2005, Experimental Brain Research.

[24]  Peter Brown,et al.  Boosting Cortical Activity at Beta-Band Frequencies Slows Movement in Humans , 2009, Current Biology.

[25]  Clifford Stein,et al.  Introduction to Algorithms, 2nd edition. , 2001 .

[26]  W. L. Root,et al.  Modern mathematics for the engineer , 1964 .

[27]  H. Swadlow,et al.  Characteristics of interhemispheric impulse conduction between prelunate gyri of the rhesus monkey , 1978, Experimental Brain Research.

[28]  K. Müller,et al.  Robustly estimating the flow direction of information in complex physical systems. , 2007, Physical review letters.

[29]  Karl J. Friston,et al.  Dynamic causal modelling , 2003, NeuroImage.

[30]  H Weinberg,et al.  Electroencephalographic and magnetoencephalographic studies of motor function. , 1990, Advances in neurology.

[31]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[32]  Viola Priesemann,et al.  TRENTOOL: an open source toolbox to estimate neural directed interactions with transfer entropy , 2011, BMC Neuroscience.

[33]  Masud Mansuripur,et al.  Introduction to information theory , 1986 .

[34]  Albert Y. Zomaya,et al.  Local information transfer as a spatiotemporal filter for complex systems. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  C. Christakos,et al.  Coherent motor unit rhythms in the 6-10 Hz range during time-varying voluntary muscle contractions: neural mechanism and relation to rhythmical motor control. , 2008, Journal of neurophysiology.

[36]  C. Vaughan,et al.  Rectification and non-linear pre-processing of EMG signals for cortico-muscular analysis , 2003, Journal of Neuroscience Methods.

[37]  Albert Gjedde,et al.  Origin of Human Motor Readiness Field Linked to Left Middle Frontal Gyrus by MEG and PET , 1998, NeuroImage.

[38]  Robert Oostenveld,et al.  Imaging the human motor system’s beta-band synchronization during isometric contraction , 2008, NeuroImage.

[39]  Karl J. Friston.  Functional and effective connectivity in neuroimaging: A synthesis , 1994 .

[40]  J. Palva,et al.  Phase Synchrony among Neuronal Oscillations in the Human Cortex , 2005, The Journal of Neuroscience.

[41]  Mario Ragwitz,et al.  Markov models from data by simple nonlinear time series predictors in delay embedding spaces. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[42]  W. Singer,et al.  Testing non-linearity and directedness of interactions between neural groups in the macaque inferotemporal cortex , 1999, Journal of Neuroscience Methods.

[43]  A. N. Sharkovskiĭ.  Dynamic systems and turbulence , 1989 .

[44]  R. Hari,et al.  Movement-related slow cortical magnetic fields and changes of spontaneous MEG- and EEG-brain rhythms. , 1996, Electroencephalography and clinical neurophysiology.

[45]  A. Grinvald,et al.  Dynamics of Ongoing Activity: Explanation of the Large Variability in Evoked Cortical Responses , 1996, Science.

[46]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[47]  M. Hallett,et al.  Functional coupling of human right and left cortical motor areas demonstrated with partial coherence analysis , 2000, Neuroscience Letters.

[48]  Karl J. Friston,et al.  Dynamic causal modeling , 2010, Scholarpedia.

[49]  J. A. Scott Kelso,et al.  Brain coordination dynamics: True and false faces of phase synchrony and metastability , 2009, Progress in Neurobiology.

[50]  M Palus,et al.  Synchronization as adjustment of information rates: detection from bivariate time series. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[51]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.