Neuromorphic applications in medicine

Objective. Transfer entropy (TE) has been widely used to infer causal relationships among dynamical systems, especially in neuroscience. Kendall transformation provides a novel quantization method for estimating information-theoretic measures and shows potential advantages for small-sample neural signals. But it has yet to be introduced into the framework of TE estimation, which commonly suffers from the limitation of small sample sizes. This paper aims to introduce the idea of Kendall correlation into TE estimation and verify its effect. Approach. We proposed the Kendall TE (KTE) which combines the improved Kendall transformation and the TE estimation. To confirm its effectiveness, we compared KTE with two common TE estimation techniques: the adaptive partitioning algorithm (D-V partitioning) and the symbolic TE. Their performances were estimated by simulation experiments which included linear, nonlinear, linear + nonlinear models and neural mass models. Moreover, the KTE was also applied to real electroencephalography (EEG) recordings to quantify the directional connectivity between frontal and parietal regions with propofol-induced general anesthesia. Main results. The simulation results showed that the KTE outperformed the other two methods by many measures: (1) identifying the coupling direction under a small sample size; (2) the sensitivity to coupling strength; (3) noise resistance; and (4) the sensitivity to time-dependent coupling changes. For real EEG recordings, the KTE clearly detected the disrupted frontal-to-parietal connectivity in propofol-induced unconsciousness, which is in agreement with previous findings. Significance. We reveal that the proposed KTE method is a robust and powerful tool for estimating TE, and is particularly suitable for small sample sizes. The KTE also provides an innovative form of quantizing continuous time series for information-theoretic measures.

[1]  Zhenhu Liang,et al.  Tracking the effects of propofol, sevoflurane and (S)-ketamine anesthesia using an unscented Kalman filter-based neural mass model , 2023, Journal of neural engineering.

[2]  C. Räth,et al.  Identifying causality drivers and deriving governing equations of nonlinear complex systems. , 2022, Chaos.

[3]  Baki Ünal Causality Analysis for COVID-19 among Countries Using Effective Transfer Entropy , 2022, Entropy.

[4]  N. Gaspard,et al.  Sepsis modulates cortical excitability and alters the local and systemic hemodynamic response to seizures , 2022, Scientific Reports.

[5]  A. Meyer,et al.  Neural dynamics differentially encode phrases and sentences during spoken language comprehension , 2022, PLoS biology.

[6]  M. Kursa Kendall transformation brings a robust categorical representation of ordinal data , 2022, Scientific Reports.

[7]  Zhenhu Liang,et al.  Cortical complexity and connectivity during isoflurane-induced general anesthesia: a rat study , 2022, Journal of neural engineering.

[8]  M. Paluš,et al.  Compression complexity with ordinal patterns for robust causal inference in irregularly sampled time series , 2022, Scientific Reports.

[9]  Sabine Van Huffel,et al.  Benchmarking Transfer Entropy Methods for the Study of Linear and Nonlinear Cardio-Respiratory Interactions , 2021, Entropy.

[10]  M. Mohammadi,et al.  Direction of information flow between brain regions in ADHD and healthy children based on EEG by using directed phase transfer entropy , 2021, Cognitive Neurodynamics.

[11]  Jason S. Chan,et al.  Predictive Coding Over the Lifespan: Increased Reliance on Perceptual Priors in Older Adults—A Magnetoencephalography and Dynamic Causal Modeling Study , 2021, Frontiers in Aging Neuroscience.

[12]  Yuxi Luo,et al.  Characterization of the abnormal cortical effective connectivity in patients with sleep apnea hypopnea syndrome during sleep , 2021, Comput. Methods Programs Biomed..

[13]  Jing Wang,et al.  EEGG: An Analytic Brain-Computer Interface Algorithm , 2021, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  Pengjian Shang,et al.  Dispersion conditional mutual information: a novel measure to estimate coupling direction between complex systems , 2021 .

[15]  Xiaoli Li,et al.  Multiscale multivariate transfer entropy and application to functional corticocortical coupling , 2020, Journal of neural engineering.

[16]  Xiaoli Li,et al.  Measuring the Coupling Direction between Neural Oscillations with Weighted Symbolic Transfer Entropy , 2020, Entropy.

[17]  W. K. Simmons,et al.  Beyond synchrony: the capacity of fMRI hyperscanning for the study of human social interaction , 2020, Social cognitive and affective neuroscience.

[18]  Wei Chen,et al.  Effective brain connectivity for fNIRS data analysis based on multi-delays symbolic phase transfer entropy , 2020, Journal of neural engineering.

[19]  Pengjian Shang,et al.  Measuring information transfer by dispersion transfer entropy , 2020, Commun. Nonlinear Sci. Numer. Simul..

[20]  Wen Wen,et al.  Theta oscillations in prolactinomas: Neurocognitive deficits in executive controls , 2020, NeuroImage: Clinical.

[21]  W. Hardt,et al.  Elucidating host–microbe interactions in vivo by studying population dynamics using neutral genetic tags , 2020, Immunology.

[22]  Gang Liu,et al.  Dendrite Net: A White-Box Module for Classification, Regression, and System Identification , 2020, IEEE Transactions on Cybernetics.

[23]  G. Fourel,et al.  Dynamics as a cause for the nanoscale organization of the genome , 2020, bioRxiv.

[24]  Zhiyong Gao,et al.  Adaptive symbolic transfer entropy and its applications in modeling for complex industrial systems. , 2019, Chaos.

[25]  G. Mashour,et al.  Dynamic Cortical Connectivity during General Anesthesia in Surgical Patients , 2019, Anesthesiology.

[26]  Inga Stolz,et al.  Algorithmics, Possibilities and Limits of Ordinal Pattern Based Entropies , 2019, Entropy.

[27]  Mohamed Almekkawy,et al.  Normalized Transfer Entropy as a Tool to Identify Multisource Functional Epileptic Networks , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[28]  David Darmon,et al.  Specific transfer entropy and other state-dependent transfer entropies for continuous-state input-output systems. , 2017, Physical review. E.

[29]  Girijesh Prasad,et al.  Propofol-induced sedation diminishes the strength of frontal-parietal-occipital EEG network , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[30]  Joseph T. Lizier,et al.  An Introduction to Transfer Entropy: Information Flow in Complex Systems , 2016 .

[31]  Heonsoo Lee,et al.  Neural Correlates of Wakefulness, Sleep, and General Anesthesia: An Experimental Study in Rat , 2016, Anesthesiology.

[32]  Mikhail Prokopenko,et al.  Transfer entropy in physical systems and the arrow of time. , 2016, Physical review. E.

[33]  Kazuyuki Aihara,et al.  Detecting Causality by Combined Use of Multiple Methods: Climate and Brain Examples , 2016, PloS one.

[34]  Hamed Azami,et al.  Dispersion Entropy: A Measure for Time-Series Analysis , 2016, IEEE Signal Processing Letters.

[35]  Luca Faes,et al.  Multiscale analysis of information dynamics for linear multivariate processes , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[36]  Gholam-Ali Hossein-Zadeh,et al.  Estimation of direct nonlinear effective connectivity using information theory and multilayer perceptron , 2014, Journal of Neuroscience Methods.

[37]  Gerhard Schneider,et al.  Fronto-Parietal Connectivity Is a Non-Static Phenomenon with Characteristic Changes during Unconsciousness , 2014, PloS one.

[38]  UnCheol Lee,et al.  Disruption of Frontal–Parietal Communication by Ketamine, Propofol, and Sevoflurane , 2013, Anesthesiology.

[39]  Viola Priesemann,et al.  Measuring Information-Transfer Delays , 2013, PloS one.

[40]  Atul Malhotra,et al.  Transfer Entropy Estimation and Directional Coupling Change Detection in Biomedical Time Series , 2012, Biomedical engineering online.

[41]  UnCheol Lee,et al.  Preferential Inhibition of Frontal-to-Parietal Feedback Connectivity Is a Neurophysiologic Correlate of General Anesthesia in Surgical Patients , 2011, PloS one.

[42]  Xiaoli Li,et al.  Estimating coupling direction between neuronal populations with permutation conditional mutual information , 2010, NeuroImage.

[43]  Matthäus Staniek,et al.  Symbolic transfer entropy. , 2008, Physical review letters.

[44]  H Kantz,et al.  Direction of coupling from phases of interacting oscillators: a permutation information approach. , 2008, Physical review letters.

[45]  Jürgen Kayser,et al.  Principal components analysis of Laplacian waveforms as a generic method for identifying ERP generator patterns: I. Evaluation with auditory oddball tasks , 2006, Clinical Neurophysiology.

[46]  S. Bressler,et al.  Beta oscillations in a large-scale sensorimotor cortical network: directional influences revealed by Granger causality. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[47]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[48]  Mario Ragwitz,et al.  Markov models from data by simple nonlinear time series predictors in delay embedding spaces. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[49]  B. Pompe,et al.  Permutation entropy: a natural complexity measure for time series. , 2002, Physical review letters.

[50]  Luiz A. Baccalá,et al.  Partial directed coherence: a new concept in neural structure determination , 2001, Biological Cybernetics.

[51]  Fabrice Wendling,et al.  Relevance of nonlinear lumped-parameter models in the analysis of depth-EEG epileptic signals , 2000, Biological Cybernetics.

[52]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[53]  T. Schreiber,et al.  Surrogate time series , 1999, chao-dyn/9909037.

[54]  Schreiber,et al.  Improved Surrogate Data for Nonlinearity Tests. , 1996, Physical review letters.

[55]  Ben H. Jansen,et al.  Electroencephalogram and visual evoked potential generation in a mathematical model of coupled cortical columns , 1995, Biological Cybernetics.

[56]  Katarzyna J. Blinowska,et al.  A new method of the description of the information flow in the brain structures , 1991, Biological Cybernetics.

[57]  Raul Vicente,et al.  Transfer Entropy in Neuroscience , 2014 .