Measuring Connectivity in Linear Multivariate Processes: Definitions, Interpretation, and Practical Analysis

This tutorial paper introduces a common framework for the evaluation of widely used frequency-domain measures of coupling (coherence, partial coherence) and causality (directed coherence, partial directed coherence) from the parametric representation of linear multivariate (MV) processes. After providing a comprehensive time-domain definition of the various forms of connectivity observed in MV processes, we particularize them to MV autoregressive (MVAR) processes and derive the corresponding frequency-domain measures. Then, we discuss the theoretical interpretation of these MVAR-based connectivity measures, showing that each of them reflects a specific time-domain connectivity definition and how this results in the description of peculiar aspects of the information transfer in MV processes. Furthermore, issues related to the practical utilization of these measures on real-time series are pointed out, including MVAR model estimation and significance assessment. Finally, limitations and pitfalls arising from model mis-specification are discussed, indicating possible solutions and providing practical recommendations for a safe computation of the connectivity measures. An example of estimation of the presented measures from multiple EEG signals recorded during a combined visuomotor task is also reported, showing how evaluation of coupling and causality in the frequency domain may help describing specific neurophysiological mechanisms.

[1]  K. Kendrick,et al.  Partial Granger causality—Eliminating exogenous inputs and latent variables , 2008, Journal of Neuroscience Methods.

[2]  Jianfeng Feng,et al.  Is partial coherence a viable technique for identifying generators of neural oscillations? , 2004, Biological Cybernetics.

[3]  Jens Timmer,et al.  Direct or indirect? Graphical models for neural oscillators , 2004, Journal of Physiology-Paris.

[4]  Sune Karlsson,et al.  Introduction to multiple time series : H. Lutkepohl, 1991, (Springer, New York), 552 pp., paperback US$59.00, ISBN 0-387-53194-7 , 1993 .

[5]  Gordon Pipa,et al.  Transfer entropy—a model-free measure of effective connectivity for the neurosciences , 2010, Journal of Computational Neuroscience.

[6]  Hualou Liang,et al.  Short-window spectral analysis of cortical event-related potentials by adaptive multivariate autoregressive modeling: data preprocessing, model validation, and variability assessment , 2000, Biological Cybernetics.

[7]  Daniel Chicharro,et al.  Reliable detection of directional couplings using rank statistics. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  Luca Faes,et al.  Robust estimation of Partial Directed Coherence by the vector optimal parameter search algorithm , 2009, 2009 4th International IEEE/EMBS Conference on Neural Engineering.

[9]  Luca Faes,et al.  Extended causal modeling to assess Partial Directed Coherence in multiple time series with significant instantaneous interactions , 2010, Biological Cybernetics.

[10]  Luca Faes,et al.  Exploring directionality in spontaneous heart period and systolic pressure variability interactions in humans: implications in the evaluation of baroreflex gain. , 2005, American journal of physiology. Heart and circulatory physiology.

[11]  Hualou Liang,et al.  Causal influence: advances in neurosignal analysis. , 2005, Critical reviews in biomedical engineering.

[12]  Mingzhou Ding,et al.  Estimating Granger causality from fourier and wavelet transforms of time series data. , 2007, Physical review letters.

[13]  Vadas Gintautas,et al.  Identification of functional information subgraphs in complex networks. , 2007, Physical review letters.

[14]  Helmut Lütkepohl,et al.  Introduction to multiple time series analysis , 1991 .

[15]  Luiz A. Baccalá,et al.  Comments on ‘Is Partial Coherence a Viable Technique for Identifying Generators of Neural Oscillations?’ , 2006, Biological Cybernetics.

[16]  F. Babiloni,et al.  Estimation of the cortical connectivity patterns during the intention of limb movements , 2006, IEEE Engineering in Medicine and Biology Magazine.

[17]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[18]  P. G. Larsson,et al.  Reducing the bias of causality measures. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[19]  Luca Faes,et al.  Testing Frequency-Domain Causality in Multivariate Time Series , 2010, IEEE Transactions on Biomedical Engineering.

[20]  Régine Le Bouquin-Jeannès,et al.  Linear and nonlinear causality between signals: methods, examples and neurophysiological applications , 2006, Biological Cybernetics.

[21]  Michael Eichler,et al.  Abstract Journal of Neuroscience Methods xxx (2005) xxx–xxx Testing for directed influences among neural signals using partial directed coherence , 2005 .

[22]  K. Sameshima,et al.  Connectivity Inference between Neural Structures via Partial Directed Coherence , 2007 .

[23]  L.A. Baccald,et al.  Generalized Partial Directed Coherence , 2007, 2007 15th International Conference on Digital Signal Processing.

[24]  Driss Boussaoud,et al.  Functional connectivity during real vs imagined visuomotor tasks: an EEG study , 2004, Neuroreport.

[25]  Karl J. Friston.  Functional and Effective Connectivity: A Review , 2011, Brain Connect..

[26]  Lester Melie-García,et al.  Estimating brain functional connectivity with sparse multivariate autoregression , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[27]  Barry Horwitz,et al.  The elusive concept of brain connectivity , 2003, NeuroImage.

[28]  M. Rosenblum,et al.  Identification of coupling direction: application to cardiorespiratory interaction. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[29]  M. Gevers,et al.  Representations of jointly stationary stochastic feedback processes , 1981 .

[30]  Joachim Gross,et al.  Reliability of multivariate causality measures for neural data , 2011, Journal of Neuroscience Methods.

[31]  C. Granger.  Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[32]  Mingzhou Ding,et al.  Evaluating causal relations in neural systems: Granger causality, directed transfer function and statistical assessment of significance , 2001, Biological Cybernetics.

[33]  Arun K. Tangirala,et al.  Quantitative analysis of directional strengths in jointly stationary linear multivariate processes , 2010, Biological Cybernetics.

[34]  Magnus Mossberg,et al.  An Overview of Important Practical Aspects of Continuous-Time ARMA System Identification , 2006 .

[35]  Xiaoping Hu,et al.  Assessing and Compensating for Zero-Lag Correlation Effects in Time-Lagged Granger Causality Analysis of fMRI , 2010, IEEE Transactions on Biomedical Engineering.

[36]  Luca Faes,et al.  Multivariate EEG spectral analysis evidences the functional link between motor and visual cortex during integrative sensorimotor tasks , 2012, Biomed. Signal Process. Control..

[37]  Luiz A Baccalá,et al.  Frequency domain connectivity identification: An application of partial directed coherence in fMRI , 2009, Human brain mapping.

[38]  Rainer Dahlhaus,et al.  Partial correlation analysis for the identification of synaptic connections , 2003, Biological Cybernetics.

[39]  Luca Faes,et al.  Surrogate data analysis for assessing the significance of the coherence function , 2004, IEEE Transactions on Biomedical Engineering.

[40]  M. Kaminski,et al.  Topographic analysis of coherence and propagation of EEG activity during sleep and wakefulness. , 1997, Electroencephalography and clinical neurophysiology.

[41]  J. Timmer,et al.  High functional connectivity of tremor related subthalamic neurons in Parkinson’s disease , 2009, Clinical Neurophysiology.

[42]  Katarzyna J. Blinowska,et al.  Determination of EEG activity propagation: pair-wise versus multichannel estimate , 2004, IEEE Transactions on Biomedical Engineering.

[43]  H. L. Bryant,et al.  Identification of synaptic interactions , 1976, Biological Cybernetics.

[44]  J. Bendat,et al.  Random Data: Analysis and Measurement Procedures , 1971 .

[45]  Paul Sajda,et al.  Causal Influences in the Human Brain During Face Discrimination: A Short-Window Directed Transfer Function Approach , 2006, IEEE Transactions on Biomedical Engineering.

[46]  Wei Liao,et al.  Nonlinear connectivity by Granger causality , 2011, NeuroImage.

[47]  M. Eichler,et al.  Assessing the strength of directed influences among neural signals using renormalized partial directed coherence , 2009, Journal of Neuroscience Methods.

[48]  S. Bressler,et al.  Frequency decomposition of conditional Granger causality and application to multivariate neural field potential data , 2006, Journal of Neuroscience Methods.

[49]  Karin Schwab,et al.  Comparison of linear signal processing techniques to infer directed interactions in multivariate neural systems , 2005, Signal Process..

[50]  H. Akaike.  A new look at the statistical model identification , 1974 .

[51]  Luiz A. Baccalá,et al.  Partial directed coherence: a new concept in neural structure determination , 2001, Biological Cybernetics.

[52]  Anthony L Bertapelle.  Spectral Analysis of Time Series. , 1979 .

[53]  L Mainardi,et al.  Linear multivariate models for physiological signal analysis: theory. , 1996, Computer methods and programs in biomedicine.

[54]  Katarzyna J. Blinowska,et al.  A new method of the description of the information flow in the brain structures , 1991, Biological Cybernetics.

[55]  Stanley Fahn.  Recent Advances in EEG and EMG Data Processing , 1983, Neurology.

[56]  Xiaoping Hu,et al.  Effective connectivity during haptic perception: A study using Granger causality analysis of functional magnetic resonance imaging data , 2008, NeuroImage.

[57]  L. Faes,et al.  Information-based detection of nonlinear Granger causality in multivariate processes via a nonuniform embedding technique. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[58]  Daniele Marinazzo,et al.  Redundant variables and Granger causality. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[59]  S. Bressler,et al.  Beta oscillations in a large-scale sensorimotor cortical network: directional influences revealed by Granger causality. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[60]  C. L. Nikias,et al.  Higher-order spectra analysis : a nonlinear signal processing framework , 1993 .

[61]  Luca Faes,et al.  An identifiable model to assess frequency-domain granger causality in the presence of significant instantaneous interactions , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[62]  C. Granger.  Testing for causality: a personal viewpoint , 1980 .

[63]  C. Grebogi,et al.  Inference of Granger causal time-dependent influences in noisy multivariate time series , 2012, Journal of Neuroscience Methods.

[64]  M. B. Priestley,et al.  Non-linear and non-stationary time series analysis , 1990 .

[65]  G. Baselli,et al.  Spectral decomposition in multichannel recordings based on multivariate parametric identification , 1997, IEEE Transactions on Biomedical Engineering.

[66]  Dimitris Kugiumtzis,et al.  Non-uniform state space reconstruction and coupling detection , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[67]  Luiz A. Baccalá,et al.  Information theoretic interpretation of frequency domain connectivity measures , 2010, Biological Cybernetics.

[68]  R. Dahlhaus.  Graphical interaction models for multivariate time series1 , 2000 .

[69]  Steven L. Bressler,et al.  Wiener–Granger Causality: A well established methodology , 2011, NeuroImage.

[70]  Joachim Gross,et al.  The effect of filtering on Granger causality based multivariate causality measures , 2010, NeuroImage.

[71]  Alois Schlögl,et al.  A comparison of multivariate autoregressive estimators , 2006, Signal Process..

[72]  Aapo Hyvärinen,et al.  Estimation of a Structural Vector Autoregression Model Using Non-Gaussianity , 2010, J. Mach. Learn. Res..

[73]  G. A. Miller,et al.  Comparison of different cortical connectivity estimators for high‐resolution EEG recordings , 2007, Human brain mapping.

[74]  Joydeep Bhattacharya,et al.  Phase synchrony analysis of EEG during music perception reveals changes in functional connectivity due to musical expertise , 2005, Signal Process..

[75]  Luca Faes,et al.  Multivariate Autoregressive Model with Instantaneous Effects to Improve Brain Connectivity Estimation , 2009 .

[76]  W. J. Nowack.  Neocortical Dynamics and Human EEG Rhythms , 1995, Neurology.

[77]  Luiz A. Baccalá,et al.  Studying the Interaction Between Brain Structures via Directed Coherence and Granger Causality , 1998 .

[78]  Jens Timmer,et al.  Inferring direct directed-information flow from multivariate nonlinear time series. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[79]  Luca Faes,et al.  Mutual nonlinear prediction as a tool to evaluate coupling strength and directionality in bivariate time series: comparison among different strategies based on k nearest neighbors. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[80]  Rodrigo Quian Quiroga,et al.  Nonlinear multivariate analysis of neurophysiological signals , 2005, Progress in Neurobiology.

[81]  Mahmood Karimi,et al.  Order selection criteria for vector autoregressive models , 2011, Signal Process..

[82]  T. Schreiber,et al.  Surrogate time series , 1999, chao-dyn/9909037.

[83]  W. Singer,et al.  Testing non-linearity and directedness of interactions between neural groups in the macaque inferotemporal cortex , 1999, Journal of Neuroscience Methods.

[84]  Michael Eichler,et al.  On the Evaluation of Information Flow in Multivariate Systems by the Directed Transfer Function , 2006, Biological Cybernetics.