Entropy-Based Pattern Learning Based on Singular Spectrum Analysis Components for Assessment of Physiological Signals

Measures of predictability in physiological signals based on entropy metrics have been widely used in the application domain of medical assessment and clinical diagnosis. In this paper, we propose a new entropy-based pattern learning by a combination of singular spectrum analysis (SSA) and entropy measures for assessment of physiological signals. Physiological signals are first represented as a series of SSA components, and then well-established entropy measures are extracted from the resulting SSA components that can help to facilitate the features extraction from physiological signals. The entropy measures of notable SSA components are used to form input features and fed into pattern classifier. To demonstrate its validity, applicability, and versatility, the proposed entropy-based pattern learning is used to perform medical assessments with three kinds of classical physiological signals, that is, electroencephalogram (EEG), electromyogram (EMG), and RR-interval signals. Experiments demonstrate that in all cases, the proposed entropy-based pattern learning can effectively capture specific biosignal patterns of physiological signals and achieve excellent identification performances for the assessments of EEG, EMG, and RR-interval signals. Besides, through the comparison of the identification performances for entropy-based pattern learning based on the physiological signals themselves and the SSA components, it is concluded that the discriminating power of entropy-based pattern learning based on the SSA components is much stronger than that based on the physiological signals themselves. Since it can be easily extended to any other physiological signal analysis, the proposed entropy-based pattern learning may use as an efficient approach to reveal biosignal patterns for medical assessment of physiological signals.

[1]  S M Pincus,et al.  Approximate entropy as a measure of system complexity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[2]  S. Sanei,et al.  An adaptive singular spectrum analysis approach to murmur detection from heart sounds. , 2011, Medical engineering & physics.

[3]  Bao-Liang Lu,et al.  Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks , 2015, IEEE Transactions on Autonomous Mental Development.

[4]  Wei Wu,et al.  Bayesian Machine Learning: EEG\/MEG signal processing measurements , 2016, IEEE Signal Processing Magazine.

[5]  Marimuthu Palaniswami,et al.  Classification of 5-S Epileptic EEG Recordings Using Distribution Entropy and Sample Entropy , 2016, Front. Physiol..

[6]  Peng Wang,et al.  Embedding Dimension Selection for Adaptive Singular Spectrum Analysis of EEG Signal , 2018, Sensors.

[7]  J. Dudley,et al.  Machine-Learning Algorithms to Automate Morphological and Functional Assessments in 2D Echocardiography. , 2016, Journal of the American College of Cardiology.

[8]  Wangxin Yu,et al.  Characterization of Surface EMG Signal Based on Fuzzy Entropy , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  Mawada Abdellatif,et al.  A Novel approach for predicting monthly water demand by combining singular spectrum analysis with neural networks , 2018, Journal of Hydrology.

[10]  U. Rajendra Acharya,et al.  Deep learning for healthcare applications based on physiological signals: A review , 2018, Comput. Methods Programs Biomed..

[11]  Shivnarayan Patidar,et al.  Detection of epileptic seizure using Kraskov entropy applied on tunable-Q wavelet transform of EEG signals , 2017, Biomed. Signal Process. Control..

[12]  Javier Gomez-Pilar,et al.  Neural Network Reorganization Analysis During an Auditory Oddball Task in Schizophrenia Using Wavelet Entropy , 2015, Entropy.

[13]  Natarajan Sriraam,et al.  A Novel Approach for Real-Time Recognition of Epileptic Seizures Using Minimum Variance Modified Fuzzy Entropy , 2018, IEEE Transactions on Biomedical Engineering.

[14]  Roberto Hornero,et al.  Decreased entropy modulation of EEG response to novelty and relevance in schizophrenia during a P300 task , 2015, European Archives of Psychiatry and Clinical Neuroscience.

[15]  A. Zhigljavsky,et al.  Forecasting European industrial production with singular spectrum analysis , 2009 .

[16]  Erich Sorantin,et al.  Local-Entropy Based Approach for X-Ray Image Segmentation and Fracture Detection , 2019, Entropy.

[17]  Madalena Costa,et al.  Multiscale entropy analysis of complex physiologic time series. , 2002, Physical review letters.

[18]  Boualem Boashash,et al.  Estimating the number of components of a multicomponent nonstationary signal using the short-term time-frequency Rényi entropy , 2011, EURASIP J. Adv. Signal Process..

[19]  Mingjiang Wang,et al.  Identification of Auditory Object-Specific Attention from Single-Trial Electroencephalogram Signals via Entropy Measures and Machine Learning , 2018, Entropy.

[20]  U. Rajendra Acharya,et al.  Tunable-Q Wavelet Transform Based Multivariate Sub-Band Fuzzy Entropy with Application to Focal EEG Signal Analysis , 2017, Entropy.

[21]  Nicoletta Saulig,et al.  Algorithm based on the short-term Rényi entropy and IF estimation for noisy EEG signals analysis , 2017, Comput. Biol. Medicine.

[22]  Aydin Akan,et al.  Emotion recognition from EEG signals by using multivariate empirical mode decomposition , 2018, Pattern Analysis and Applications.

[23]  Javier Gomez-Pilar,et al.  Neurofeedback training with a motor imagery-based BCI: neurocognitive improvements and EEG changes in the elderly , 2016, Medical & Biological Engineering & Computing.

[24]  Emmanuel Jammeh,et al.  Complexity Measures for Quantifying Changes in Electroencephalogram in Alzheimer's Disease , 2018, Complex..

[25]  Yong Zhang,et al.  Classification of EEG Signals Based on Autoregressive Model and Wavelet Packet Decomposition , 2017, Neural Processing Letters.

[26]  Nicoletta Saulig,et al.  Effects of TFD thresholding on EEG signal analysis based on the local Rényi entropy , 2017, 2017 2nd International Multidisciplinary Conference on Computer and Energy Science (SpliTech).

[27]  Chengyu Liu,et al.  Multiscale Entropy Analysis of the Differential RR Interval Time Series Signal and Its Application in Detecting Congestive Heart Failure , 2017, Entropy.

[28]  Yudong Zhang,et al.  Entropy Analysis of Short-Term Heartbeat Interval Time Series during Regular Walking , 2017, Entropy.

[29]  Bin Hu,et al.  Exploring EEG Features in Cross-Subject Emotion Recognition , 2018, Front. Neurosci..

[30]  P. Falkai,et al.  Machine Learning Approaches for Clinical Psychology and Psychiatry. , 2018, Annual review of clinical psychology.

[31]  Kandala N. V. P. S. Rajesh,et al.  Classification of ECG heartbeats using nonlinear decomposition methods and support vector machine , 2017, Comput. Biol. Medicine.

[32]  Lu Cao,et al.  A New ECG Signal Classification Based on WPD and ApEn Feature Extraction , 2016, Circuits Syst. Signal Process..

[33]  Nicoletta Saulig,et al.  Number of EEG signal components estimated using the short-term Renyi entropy , 2016, 2016 International Multidisciplinary Conference on Computer and Energy Science (SpliTech).

[34]  Tingxi Wen,et al.  Deep Convolution Neural Network and Autoencoders-Based Unsupervised Feature Learning of EEG Signals , 2018, IEEE Access.

[35]  U. Rajendra Acharya,et al.  An Integrated Index for the Identification of Focal Electroencephalogram Signals Using Discrete Wavelet Transform and Entropy Measures , 2015, Entropy.

[36]  Yuting Zhang,et al.  Comparison of classification methods on EEG signals based on wavelet packet decomposition , 2014, Neural Computing and Applications.

[37]  U. Rajendra Acharya,et al.  Author's Personal Copy Biomedical Signal Processing and Control Automated Diagnosis of Epileptic Eeg Using Entropies , 2022 .

[38]  Javier Gomez-Pilar,et al.  Functional EEG network analysis in schizophrenia: Evidence of larger segregation and deficit of modulation , 2017, Progress in Neuro-Psychopharmacology and Biological Psychiatry.

[39]  Javier Gomez-Pilar,et al.  Altered predictive capability of the brain network EEG model in schizophrenia during cognition , 2018, Schizophrenia Research.

[40]  Tuan D. Pham,et al.  Time-Shift Multiscale Entropy Analysis of Physiological Signals , 2017, Entropy.

[41]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[42]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[43]  K. Cheng,et al.  Analysis of EEG entropy during visual evocation of emotion in schizophrenia , 2017, Annals of General Psychiatry.

[44]  M. L. Dewal,et al.  Epileptic seizure detection using DWT based fuzzy approximate entropy and support vector machine , 2014, Neurocomputing.

[45]  U. Rajendra Acharya,et al.  An automatic detection of focal EEG signals using new class of time-frequency localized orthogonal wavelet filter banks , 2017, Knowl. Based Syst..

[46]  U. Rajendra Acharya,et al.  Use of features from RR-time series and EEG signals for automated classification of sleep stages in deep neural network framework , 2018 .

[47]  Kipp W. Johnson,et al.  Machine learning in cardiovascular medicine: are we there yet? , 2018, Heart.

[48]  U. Rajendra Acharya,et al.  Automated detection of focal EEG signals using features extracted from flexible analytic wavelet transform , 2017, Pattern Recognit. Lett..

[49]  Joël M. H. Karel,et al.  Singular Spectrum Decomposition: a New Method for Time Series Decomposition , 2014, Adv. Data Sci. Adapt. Anal..

[50]  Roberto Sassi,et al.  Bubble Entropy: An Entropy Almost Free of Parameters , 2017, IEEE Transactions on Biomedical Engineering.

[51]  B. Pompe,et al.  Permutation entropy: a natural complexity measure for time series. , 2002, Physical review letters.

[52]  S. Sawilowsky New Effect Size Rules of Thumb , 2009 .

[53]  U. Rajendra Acharya,et al.  Application of Entropy Measures on Intrinsic Mode Functions for the Automated Identification of Focal Electroencephalogram Signals , 2015, Entropy.

[54]  K Lehnertz,et al.  Indications of nonlinear deterministic and finite-dimensional structures in time series of brain electrical activity: dependence on recording region and brain state. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[55]  Luca Faes,et al.  Efficient Computation of Multiscale Entropy over Short Biomedical Time Series Based on Linear State-Space Models , 2017, Complex..