Ordinal symbolic analysis and its application to biomedical recordings

Ordinal symbolic analysis opens an interesting and powerful perspective on time-series analysis. Here, we review this relatively new approach and highlight its relation to symbolic dynamics and representations. Our exposition reaches from the general ideas up to recent developments, with special emphasis on its applications to biomedical recordings. The latter will be illustrated with epilepsy data.

[1]  Julius Georgiou,et al.  Entropy measures for discrimination of ‘awake’ Vs ‘anaesthetized’ state in recovery from general anesthesia , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  G. Keller,et al.  Entropy of interval maps via permutations , 2002 .

[3]  Evon M. O. Abu-Taieh,et al.  Comparative Study , 2020, Definitions.

[4]  Liam Paninski,et al.  Estimation of Entropy and Mutual Information , 2003, Neural Computation.

[5]  Zhenhu Liang,et al.  Multiscale permutation entropy analysis of EEG recordings during sevoflurane anesthesia , 2010, Journal of neural engineering.

[6]  Schreiber,et al.  Measuring information transfer , 2000, Physical review letters.

[7]  Miguel A. F. Sanjuán,et al.  Permutation complexity of spatiotemporal dynamics , 2010 .

[8]  W. McCulloch,et al.  The limiting information capacity of a neuronal link , 1952 .

[9]  José Amigó,et al.  Permutation Complexity in Dynamical Systems , 2010 .

[10]  L M Hively,et al.  Detecting dynamical changes in time series using the permutation entropy. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[11]  K. Keller,et al.  Kolmogorov-Sinai entropy via separation properties of order-generated $\sigma$-algebras , 2013, 1304.4450.

[12]  N. Montano,et al.  Complexity and Nonlinearity in Short-Term Heart Period Variability: Comparison of Methods Based on Local Nonlinear Prediction , 2007, IEEE Transactions on Biomedical Engineering.

[13]  Karsten Keller,et al.  Conditional entropy of ordinal patterns , 2014, 1407.5390.

[14]  Karsten Keller.  Permutations and the Kolmogorov-Sinai entropy , 2011 .

[15]  Fraser,et al.  Independent coordinates for strange attractors from mutual information. , 1986, Physical review. A, General physics.

[16]  Miguel A. F. Sanjuán,et al.  True and false forbidden patterns in deterministic and random dynamics , 2007 .

[17]  Xiaoli Li,et al.  Estimating coupling direction between neuronal populations with permutation conditional mutual information , 2010, NeuroImage.

[18]  M. Mirzakhani,et al.  Introduction to Ergodic theory , 2010 .

[19]  Symbolic dynamics , 2008, Scholarpedia.

[20]  Andreas Groth.  Visualization of coupling in time series by order recurrence plots. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  J. Sprott.  Chaos and time-series analysis , 2001 .

[22]  Wolfram Bunk,et al.  Characterizing synchronization in time series using information measures extracted from symbolic representations. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  J. Kurths,et al.  Quantitative analysis of heart rate variability. , 1995, Chaos.

[24]  Kohei Nakajima,et al.  Symbolic local information transfer , 2013, The European Physical Journal Special Topics.

[25]  Aura Silva,et al.  Performance of electroencephalogram-derived parameters in prediction of depth of anaesthesia in a rabbit model. , 2011, British journal of anaesthesia.

[26]  N. Birbaumer,et al.  Permutation entropy to detect vigilance changes and preictal states from scalp EEG in epileptic patients. A preliminary study , 2008, Neurological Sciences.

[27]  J. M. Amigó,et al.  Permutation complexity of interacting dynamical systems , 2013, 1305.1735.

[28]  Francesco Carlo Morabito,et al.  Multivariate Multi-Scale Permutation Entropy for Complexity Analysis of Alzheimer's Disease EEG , 2012, Entropy.

[29]  P. Grassberger.  Finite sample corrections to entropy and dimension estimates , 1988 .

[30]  Matthäus Staniek,et al.  Symbolic transfer entropy. , 2008, Physical review letters.

[31]  H. Abarbanel,et al.  Determining embedding dimension for phase-space reconstruction using a geometrical construction. , 1992, Physical review. A, Atomic, molecular, and optical physics.

[32]  B. Pompe,et al.  Momentary information transfer as a coupling measure of time series. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[33]  A. Porta,et al.  Quantifying heart rate dynamics using different approaches of symbolic dynamics , 2013 .

[34]  Gudrun Stockmanns,et al.  Electroencephalographic Order Pattern Analysis for the Separation of Consciousness and Unconsciousness: An Analysis of Approximate Entropy, Permutation Entropy, Recurrence Rate, and Phase Coupling of Order Recurrence Plots , 2008, Anesthesiology.

[35]  José M. Amigó,et al.  The equality of Kolmogorov–Sinai entropy and metric permutation entropy generalized , 2012 .

[36]  Carlos Venâncio,et al.  Performance of Anesthetic Depth Indexes in Rabbits under Propofol Anesthesia: Prediction Probabilities and Concentration-effect Relations , 2011, Anesthesiology.

[37]  Miguel A. F. Sanjuán,et al.  Combinatorial detection of determinism in noisy time series , 2008 .

[38]  Karsten Keller,et al.  Symbolic Analysis of High-Dimensional Time Series , 2003, Int. J. Bifurc. Chaos.

[39]  J. Amigó,et al.  A new perspective on transcripts by means of their matrix representation , 2013 .

[40]  L. Voss,et al.  Using Permutation Entropy to Measure the Electroencephalographic Effects of Sevoflurane , 2008, Anesthesiology.

[41]  Tarmo Lipping,et al.  Entropy of the EEG in transition to burst suppression in deep anesthesia: Surrogate analysis , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[42]  Karsten Keller,et al.  Efficiently Measuring Complexity on the Basis of Real-World Data , 2013, Entropy.

[43]  P. Walters.  Introduction to Ergodic Theory , 1977 .

[44]  K. Keller,et al.  Ordinal analysis of EEG time series , 2005 .

[45]  Ali Karimpour,et al.  Fast and Robust Detection of Epilepsy in Noisy EEG Signals Using Permutation Entropy , 2007, 2007 IEEE 7th International Symposium on BioInformatics and BioEngineering.

[46]  Julius Georgiou,et al.  Permutation Entropy: A new feature for Brain-Computer Interfaces , 2010, 2010 Biomedical Circuits and Systems Conference (BioCAS).

[47]  M. Koskinen,et al.  Effect of remifentanil on the nonlinear electroencephalographic entropy parameters in propofol anesthesia , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[48]  Ljupco Kocarev,et al.  Order patterns and chaos , 2006 .

[49]  M. Masè,et al.  An integrated approach based on uniform quantization for the evaluation of complexity of short-term heart period variability: Application to 24 h Holter recordings in healthy and heart failure humans. , 2007, Chaos.

[50]  Jürgen Kurths,et al.  Order patterns recurrence plots in the analysis of ERP data , 2007, Cognitive Neurodynamics.

[51]  Katharina Wittfeld,et al.  Distances of Time Series Components by Means of Symbolic Dynamics , 2004, Int. J. Bifurc. Chaos.

[52]  Gaoxiang Ouyang,et al.  Ordinal pattern based similarity analysis for EEG recordings , 2010, Clinical Neurophysiology.

[53]  Danuta Makowiec,et al.  Ordinal pattern statistics for the assessment of heart rate variability , 2013 .

[54]  Julius Georgiou,et al.  Detection of epileptic electroencephalogram based on Permutation Entropy and Support Vector Machines , 2012, Expert Syst. Appl..

[55]  Dimitris Kugiumtzis,et al.  Partial transfer entropy on rank vectors , 2013, ArXiv.

[56]  Ethan M. Coven,et al.  On the genesis of symbolic dynamics as we know it , 2006, math/0611322.

[57]  B. Pompe,et al.  Permutation entropy: a natural complexity measure for time series. , 2002, Physical review letters.

[58]  J. Hadamard,et al.  Les surfaces a courbures opposees et leurs lignes geodesique , 1898 .

[59]  Dimitris Kugiumtzis,et al.  Transfer Entropy on Rank Vectors , 2010, ArXiv.

[60]  Liu Xiao-feng,et al.  Fine-grained permutation entropy as a measure of natural complexity for time series , 2009 .

[61]  A Voss,et al.  Improved analysis of heart rate variability by methods of nonlinear dynamics. , 1995, Journal of electrocardiology.

[62]  N. Nicolaou,et al.  The Use of Permutation Entropy to Characterize Sleep Electroencephalograms , 2011, Clinical EEG and neuroscience.

[63]  V. Galhardo,et al.  Comparison of Anesthetic Depth Indexes Based on Thalamocortical Local Field Potentials in Rats , 2010, Anesthesiology.

[64]  Wolfram Bunk,et al.  Information directionality in coupled time series using transcripts. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[65]  Jos Amig.  Permutation Complexity in Dynamical Systems: Ordinal Patterns, Permutation Entropy and All That , 2010 .

[66]  Kaspar Anton Schindler,et al.  Forbidden ordinal patterns of periictal intracranial EEG indicate deterministic dynamics in human epileptic seizures , 2011, Epilepsia.

[67]  Kaspar Anton Schindler,et al.  Ordinal patterns in epileptic brains: Analysis of intracranial EEG and simultaneous EEG-fMRI , 2013, The European Physical Journal Special Topics.

[68]  Enrico Rogora,et al.  Independence and symbolic independence of nonstationary heartbeat series during atrial fibrillation , 2005 .

[69]  Niels Wessel,et al.  Practical considerations of permutation entropy , 2013, The European Physical Journal Special Topics.

[70]  Dirk Hoyer,et al.  Permutation entropy improves fetal behavioural state classification based on heart rate analysis from biomagnetic recordings in near term fetuses , 2006, Medical and Biological Engineering and Computing.

[71]  J. Sleigh,et al.  Permutation entropy of the electroencephalogram: a measure of anaesthetic drug effect. , 2008, British journal of anaesthesia.

[72]  Qianli D. Y. Ma,et al.  Modified permutation-entropy analysis of heartbeat dynamics. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[73]  José María Amigó,et al.  Detecting Determinism in Time Series with Ordinal Patterns: a Comparative Study , 2010, Int. J. Bifurc. Chaos.

[74]  Niels Wessel,et al.  Classifying cardiac biosignals using ordinal pattern statistics and symbolic dynamics , 2012, Comput. Biol. Medicine.

[75]  Geon Ho Choe,et al.  Computational Ergodic Theory , 2005 .

[76]  Massimiliano Zanin,et al.  Permutation Entropy and Its Main Biomedical and Econophysics Applications: A Review , 2012, Entropy.

[77]  Wolfram Bunk,et al.  Transcripts: an algebraic approach to coupled time series. , 2012, Chaos.

[78]  G. Ouyang,et al.  Predictability analysis of absence seizures with permutation entropy , 2007, Epilepsy Research.

[79]  K. Keller,et al.  TIME SERIES FROM THE ORDINAL VIEWPOINT , 2007 .

[80]  G. Bergey,et al.  Characterization of early partial seizure onset: Frequency, complexity and entropy , 2012, Clinical Neurophysiology.

[81]  Mathieu Sinn,et al.  Estimation of ordinal pattern probabilities in Gaussian processes with stationary increments , 2011, Comput. Stat. Data Anal..

[82]  Gaoxiang Ouyang,et al.  Deterministic dynamics of neural activity during absence seizures in rats. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[83]  Sergio Cerutti,et al.  Entropy, entropy rate, and pattern classification as tools to typify complexity in short heart period variability series , 2001, IEEE Transactions on Biomedical Engineering.

[84]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[85]  C. Finney,et al.  A review of symbolic analysis of experimental data , 2003 .

[86]  H. Kantz,et al.  Nonlinear time series analysis , 1997 .