Optimization of relative parameters in transfer entropy estimation and application to corticomuscular coupling in humans

BACKGROUND As a non-modeled information theoretical measure, the transfer entropy (TE) could be applied to quantitatively analyze the linear and nonlinear coupling characteristics between two observations. However, the parameters selection of TE (the parameters used in state space reconstruction and estimating Shannon entropy) has a serious influence on the accuracy of its results. NEW METHOD In this study, the hybrid particle swarm optimization (HPSO) was applied to improve the accuracy of TE by optimizing its parameters. In HPSO, the TE calculation and significant analysis were integrated into the fitness function, and the optimal parameters group within the parameter space could be automatically found through an iteration process. RESULTS The TE results computed under the parameters optimized by HPSO (HPSO-TE), was assessed with a numerical non-linear model, the neural mass model and the recorded electroencephalogram (EEG) and electromyogram (EMG) signals. Compared with TE, HPSO-TE could reduce the 'false positive' in non-linear model, and 'spurious coupling', i.e. two nonzero TEs for unidirectionally coupled systems, especially when coupling strength was weak. The robustness against noise and long time-delay was improved. Moreover, the experimental data analysis showed HPSO-TE revealed the dominant direction (EEG → EMG) in corticomuscular coupling, and had higher values than TE which showed the same dominant direction. COMPARISON WITH EXISTING METHOD The implication of HPSO improved the accuracy of TE in estimating the coupling strength and direction. CONCLUSIONS The efficiency of TE could be improved by HPSO for estimating coupling relationships, especially for weakly coupled, strong noisy and long time-delay series.

[1]  R. Lemon,et al.  Human Cortical Muscle Coherence Is Directly Related to Specific Motor Parameters , 2000, The Journal of Neuroscience.

[2]  Chunfeng Yang,et al.  A New Strategy for Model Order Identification and Its Application to Transfer Entropy for EEG Signals Analysis , 2013, IEEE Transactions on Biomedical Engineering.

[3]  Yuan Yang,et al.  Unveiling neural coupling within the sensorimotor system: directionality and nonlinearity , 2017, The European journal of neuroscience.

[4]  D. Hoffman,et al.  Muscle and movement representations in the primary motor cortex. , 1999, Science.

[5]  Mario Fulcheri,et al.  Prosody and synchronization in cognitive neuroscience , 2013 .

[6]  Ben H. Jansen,et al.  A neurophysiologically-based mathematical model of flash visual evoked potentials , 2004, Biological Cybernetics.

[7]  O. Bertrand,et al.  Oscillatory Synchrony between Human Extrastriate Areas during Visual Short-Term Memory Maintenance , 2001, The Journal of Neuroscience.

[8]  Viola Priesemann,et al.  Measuring Information-Transfer Delays , 2013, PloS one.

[9]  E. Kandel,et al.  Essentials of Neural Science and Behavior , 1996 .

[10]  E. Olivier,et al.  Coherent oscillations in monkey motor cortex and hand muscle EMG show task‐dependent modulation , 1997, The Journal of physiology.

[11]  Jingyuan E. Chen,et al.  NIRS-Based Hyperscanning Reveals Inter-brain Neural Synchronization during Cooperative Jenga Game with Face-to-Face Communication , 2016, Front. Hum. Neurosci..

[12]  L. Zhang,et al.  Finding direction of oscillation propagation using non-parametric transfer entropy method , 2013, 2013 IEEE 8th Conference on Industrial Electronics and Applications (ICIEA).

[13]  G. Lambert-Torres,et al.  A hybrid particle swarm optimization applied to loss power minimization , 2005, IEEE Transactions on Power Systems.

[14]  Atul Malhotra,et al.  Transfer Entropy Estimation and Directional Coupling Change Detection in Biomedical Time Series , 2012, Biomedical engineering online.

[15]  S. Baker,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[16]  Jürgen Kurths,et al.  Escaping the curse of dimensionality in estimating multivariate transfer entropy. , 2012, Physical review letters.

[17]  F. Varela,et al.  Perception's shadow: long-distance synchronization of human brain activity , 1999, Nature.

[18]  Gabriel Curio,et al.  Corticomuscular coherence in acute and chronic stroke , 2014, Clinical Neurophysiology.

[19]  Gordon Pipa,et al.  Assessing coupling dynamics from an ensemble of time series , 2010, Entropy.

[20]  Petre Stoica,et al.  Performance analysis of an adaptive notch filter with constrained poles and zeros , 1988, IEEE Trans. Acoust. Speech Signal Process..

[21]  Ben H. Jansen,et al.  Electroencephalogram and visual evoked potential generation in a mathematical model of coupled cortical columns , 1995, Biological Cybernetics.

[22]  Jochen Kaiser,et al.  Transfer entropy in magnetoencephalographic data: quantifying information flow in cortical and cerebellar networks. , 2011, Progress in biophysics and molecular biology.

[23]  Raul Vicente,et al.  Transfer Entropy in Neuroscience , 2014 .

[24]  J. Matias Palva,et al.  Phase transfer entropy: A novel phase-based measure for directed connectivity in networks coupled by oscillatory interactions , 2014, NeuroImage.

[25]  G. Yue,et al.  Single-Trial EEG-EMG Coherence Analysis Reveals Muscle Fatigue-Related Progressive Alterations in Corticomuscular Coupling , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Babiloni Claudio,et al.  Synchronization of gamma oscillations increases functional connectivity of human hippocampus and inferior‐middle temporal cortex during repetitive visuomotor events , 2004 .

[27]  Dmitry A Smirnov,et al.  Spurious causalities with transfer entropy. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  J. Martinerie,et al.  The brainweb: Phase synchronization and large-scale integration , 2001, Nature Reviews Neuroscience.

[29]  Jing Z. Liu,et al.  Effects of surface EMG rectification on power and coherence analyses: An EEG and MEG study , 2007, Journal of Neuroscience Methods.

[30]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[31]  Fabrice Wendling,et al.  Relevance of nonlinear lumped-parameter models in the analysis of depth-EEG epileptic signals , 2000, Biological Cybernetics.

[32]  Gordon Pipa,et al.  Transfer entropy—a model-free measure of effective connectivity for the neurosciences , 2010, Journal of Computational Neuroscience.

[33]  Mikhail Prokopenko,et al.  Transfer entropy in continuous time, with applications to jump and neural spiking processes , 2016, Physical review. E.

[34]  M. Rosenblum,et al.  Estimation of delay in coupling from time series. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  Xiaoli Li,et al.  Estimating coupling direction between neuronal populations with permutation conditional mutual information , 2010, NeuroImage.

[36]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[37]  L. Tsimring,et al.  Generalized synchronization of chaos in directionally coupled chaotic systems. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[38]  Luca Faes,et al.  Lag-Specific Transfer Entropy as a Tool to Assess Cardiovascular and Cardiorespiratory Information Transfer , 2014, IEEE Transactions on Biomedical Engineering.

[39]  F. L. D. Silva,et al.  Dynamics of the human alpha rhythm: evidence for non-linearity? , 1999, Clinical Neurophysiology.

[40]  Rihui Li,et al.  Electroencephalogram–Electromyography Coupling Analysis in Stroke Based on Symbolic Transfer Entropy , 2018, Front. Neurol..

[41]  F. H. Lopes da Silva,et al.  Model of brain rhythmic activity , 1974, Kybernetik.

[42]  Chengyu Liu,et al.  Testing pattern synchronization in coupled systems through different entropy-based measures , 2013, Medical & biological engineering & computing.

[43]  Du Yihao,et al.  Functional coupling analyses of electroencephalogram and electromyogram based on multiscale transfer entropy , 2015 .

[44]  Jarno M. A. Tanskanen,et al.  Spectral Entropy Based Neuronal Network Synchronization Analysis Based on Microelectrode Array Measurements , 2016, Front. Comput. Neurosci..

[45]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[46]  P. Rossini,et al.  Synchronization of gamma oscillations increases functional connectivity of human hippocampus and inferior-middle temporal cortex during repetitive visuomotor events. , 2004, The European journal of neuroscience.

[47]  Karl J. Friston,et al.  Evaluation of different measures of functional connectivity using a neural mass model , 2004, NeuroImage.

[48]  Donald C. Cox,et al.  Robust frequency and timing synchronization for OFDM , 1997, IEEE Trans. Commun..

[49]  Michael Breakspear,et al.  The reorganization of corticomuscular coherence during a transition between sensorimotor states , 2014, NeuroImage.

[50]  Vadim Ushakov,et al.  Causal Interactions Within the Default Mode Network as Revealed by Low-Frequency Brain Fluctuations and Information Transfer Entropy , 2016 .

[51]  D. Rand.  Dynamical Systems and Turbulence , 1982 .

[52]  Yuan Feng,et al.  Abnormal Resting-State Functional Connectivity of the Anterior Cingulate Cortex in Unilateral Chronic Tinnitus Patients , 2018, Front. Neurosci..

[53]  K. Hlavácková-Schindler,et al.  Causality detection based on information-theoretic approaches in time series analysis , 2007 .

[54]  M. Hallett,et al.  Information flow from the sensorimotor cortex to muscle in humans , 2001, Clinical Neurophysiology.

[55]  Wim Van Paesschen,et al.  Canonical Correlation Analysis Applied to Remove Muscle Artifacts From the Electroencephalogram , 2006, IEEE Transactions on Biomedical Engineering.

[56]  L. Cao.  Practical method for determining the minimum embedding dimension of a scalar time series , 1997 .

[57]  Chin-Teng Lin,et al.  Identifying changes in EEG information transfer during drowsy driving by transfer entropy , 2015, Front. Hum. Neurosci..

[58]  L. Vaina,et al.  Mapping the signal‐to‐noise‐ratios of cortical sources in magnetoencephalography and electroencephalography , 2009, Human brain mapping.

[59]  Kaustubh Supekar,et al.  Reconceptualizing functional brain connectivity in autism from a developmental perspective , 2013, Front. Hum. Neurosci..

[60]  Viola Priesemann,et al.  TRENTOOL: A Matlab open source toolbox to analyse information flow in time series data with transfer entropy , 2011, BMC Neuroscience.

[61]  Rodrigo Quian Quiroga,et al.  Nonlinear multivariate analysis of neurophysiological signals , 2005, Progress in Neurobiology.

[62]  Jukka Kortelainen,et al.  Experimental comparison of connectivity measures with simulated EEG signals , 2012, Medical & Biological Engineering & Computing.

[63]  Régine Le Bouquin-Jeannès,et al.  Linear and nonlinear causality between signals: methods, examples and neurophysiological applications , 2006, Biological Cybernetics.

[64]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[65]  S. Saigal,et al.  Relative performance of mutual information estimation methods for quantifying the dependence among short and noisy data. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[66]  Mario Ragwitz,et al.  Markov models from data by simple nonlinear time series predictors in delay embedding spaces. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[67]  Dimitris Kugiumtzis,et al.  Non-uniform state space reconstruction and coupling detection , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[68]  Matthäus Staniek,et al.  Symbolic transfer entropy. , 2008, Physical review letters.