Performance evaluation of time-frequency image feature sets for improved classification and analysis of non-stationary signals: Application to newborn EEG seizure detection

Abstract This study demonstrates that a time-frequency (TF) image pattern recognition approach offers significant advantages over standard signal classification methods that use t-domain only or f-domain only features. Two approaches are considered and compared. The paper describes the significance of the standard TF approach for non-stationary signals; TF signal (TFS) features are defined by extending t-domain or f-domain features to a joint (t, f) domain resulting in e.g. TF flatness and TF flux. The performance of the extended TFS features is comparatively assessed using Receiver Operating Characteristic (ROC) analysis Area Under the Curve (AUC) measure. Experimental results confirm that the extended TFS features generally yield improved performance (up to 19%) when compared to the corresponding t-domain and f-domain features. The study also explores a second approach based on novel TF image (TFI) features that further improves TF-based classification of non-stationary signals. New TFI features are defined and extracted from the (t, f) domain; they include TF Hu invariant moments, TF Haralick features, and TF Local Binary Patterns (LBP). Using a state-of-the-art classifier, different metrics based on confusion matrix performance are compared for all extended TFS features and TFI features. Experimental results show the improved performance of TFI features over both TFS features and t-domain only or f-domain only features, for all TF representations and for all the considered performance metrics. The experiment is validated by comparing this new proposed methodology with a recent study, utilizing the same large and complex data set of EEG signals, and the same experimental setup. The resulting classification results confirm the superior performance of the proposed TFI features with accuracy improvement up to 5.52%.

[1]  A. Flisberg,et al.  Automatic classification of background EEG activity in healthy and sick neonates , 2010, Journal of neural engineering.

[2]  Srdjan Stankovic Time-Frequency Analysis and Its Application in Digital Watermarking , 2010, EURASIP J. Adv. Signal Process..

[3]  Maria Petrou,et al.  The Use of Boolean Model for Texture Analysis of Grey Images , 1999, Comput. Vis. Image Underst..

[4]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[6]  Jan-Olof Eklundh,et al.  Shape Representation by Multiscale Contour Approximation , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Ernesto Bribiesca,et al.  A new chain code , 1999, Pattern Recognit..

[8]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[10]  Mostefa Mesbah,et al.  Time-Frequency Feature Extraction of Newborn EEG Seizure Using SVD-Based Techniques , 2004, EURASIP J. Adv. Signal Process..

[11]  Dheeraj Sharma,et al.  Time-frequency image based features for classification of epileptic seizures from EEG signals , 2017 .

[12]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ma Yuchao,et al.  Damage Detection Based on Cross-Term Extraction from Bilinear Time-Frequency Distributions , 2014 .

[14]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[15]  Boualem Boashash,et al.  A review of time-frequency matched filter design with application to seizure detection in multichannel newborn EEG , 2014, Digit. Signal Process..

[16]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Axel Röbel,et al.  Syll-O-Matic: An adaptive time-frequency representation for the automatic segmentation of speech into syllables , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[18]  Herbert Freeman,et al.  On the Encoding of Arbitrary Geometric Configurations , 1961, IRE Trans. Electron. Comput..

[19]  Stéphane Mallat,et al.  Audio Denoising by Time-Frequency Block Thresholding , 2008, IEEE Transactions on Signal Processing.

[20]  Dimitrios I. Fotiadis,et al.  Automatic Seizure Detection Based on Time-Frequency Analysis and Artificial Neural Networks , 2007, Comput. Intell. Neurosci..

[21]  Boualem Boashash,et al.  Estimating the number of components of a multicomponent nonstationary signal using the short-term time-frequency Rényi entropy , 2011, EURASIP J. Adv. Signal Process..

[22]  Boualem Boashash,et al.  Image fusion-based contrast enhancement , 2012, EURASIP Journal on Image and Video Processing.

[23]  Boualem Boashash,et al.  An Improved Design of High-Resolution Quadratic Time–Frequency Distributions for the Analysis of Nonstationary Multicomponent Signals Using Directional Compact Kernels , 2017, IEEE Transactions on Signal Processing.

[24]  Ervin Sejdic,et al.  Pattern Recognition in Time-Frequency Domain: Selective Regional Correlation and Its Applications , 2008 .

[25]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[26]  A. Liu,et al.  Detection of neonatal seizures through computerized EEG analysis. , 1992, Electroencephalography and clinical neurophysiology.

[27]  Guang Deng,et al.  Theory and application of general linear image processing , 2012, EURASIP J. Adv. Signal Process..

[28]  U. Rajendra Acharya,et al.  Author's Personal Copy Biomedical Signal Processing and Control Automated Diagnosis of Epileptic Eeg Using Entropies , 2022 .

[29]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[30]  Yi Chai,et al.  Classification of seizure based on the time-frequency image of EEG signals using HHT and SVM , 2014, Biomed. Signal Process. Control..

[31]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[32]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[33]  Qingsheng Liu,et al.  Geoelectric Stratigraphy Recognition in Transient Electromagnetic Signal Based on Time-Frequency Analysis and Image Classification , 2009, 2009 2nd International Congress on Image and Signal Processing.

[34]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[35]  Boualem Boashash,et al.  A methodology for time-frequency image processing applied to the classification of non-stationary multichannel signals using instantaneous frequency descriptors with application to newborn EEG signals , 2012, EURASIP J. Adv. Signal Process..

[36]  Sridhar Krishnan,et al.  Time-Frequency Analysis and Its Applications to Multimedia Signals , 2011 .

[37]  Richard C. Dubes,et al.  Performance evaluation for four classes of textural features , 1992, Pattern Recognit..

[38]  Mark S. Nixon,et al.  Parameterizing Arbitrary Shapes via Fourier Descriptors for Evidence-Gathering Extraction , 1998, Comput. Vis. Image Underst..

[39]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[40]  Boualem Boashash,et al.  Time-Frequency Signal Analysis and Processing , 2002 .

[41]  Hamid Hassanpour A time-frequency approach for noise reduction , 2008, Digit. Signal Process..

[42]  Boualem Boashash,et al.  Automatic signal abnormality detection using time-frequency features and machine learning: A newborn EEG seizure case study , 2016, Knowl. Based Syst..

[43]  Mandyam D. Srinath,et al.  Invariant planar shape recognition using dynamic alignment , 1988, Pattern Recognit..

[44]  Selin Aviyente,et al.  Time-Frequency Data Reduction for Event Related Potentials: Combining Principal Component Analysis and Matching Pursuit , 2010, EURASIP J. Adv. Signal Process..

[45]  Abdul Jalil,et al.  Ensemble classification of colon biopsy images based on information rich hybrid features , 2014, Comput. Biol. Medicine.

[46]  Ping Wei,et al.  Adaptive short time fractional Fourier transform for time–frequency segmentation , 2016 .

[47]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[48]  R.M. Haralick,et al.  Statistical and structural approaches to texture , 1979, Proceedings of the IEEE.

[49]  Mohan M. Trivedi,et al.  Segmentation of a high-resolution urban scene using texture operators , 1984, Comput. Vis. Graph. Image Process..

[50]  Hiram H. López-Valdez,et al.  A new relative chain code in 3D , 2014, Pattern Recognit..

[51]  G. Lightbody,et al.  Detecting Neonatal Seizures With Computer Algorithms. , 2016, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[52]  Ramón M. Rodríguez-Dagnino,et al.  Efficiency of chain codes to represent binary objects , 2007, Pattern Recognit..

[53]  Christoforos Panayiotou,et al.  Improved coverage in WSNs by exploiting spatial correlation: the two sensor case , 2011, EURASIP J. Adv. Signal Process..

[54]  Afonso Ferreira,et al.  Computing the Medial Axis Transform in Parallel With Eight Scan Operations , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[55]  H. Abdi,et al.  Principal component analysis , 2010 .

[56]  Li WangDong-Chen He,et al.  Texture classification using texture spectrum , 1990, Pattern Recognit..

[57]  U. Rajendra Acharya,et al.  Automated Diagnosis of epilepsy using CWT, HOS and Texture parameters , 2013, Int. J. Neural Syst..

[58]  Stefan M. Rüger,et al.  Evaluation of Texture Features for Content-Based Image Retrieval , 2004, CIVR.

[59]  Trevor J. Davis Fast Decomposition of Digital Curves into Polygons Using the Haar Transform , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  John M. O'Toole,et al.  Time-Frequency Processing of Nonstationary Signals: Advanced TFD Design to Aid Diagnosis with Highlights from Medical Applications , 2013, IEEE Signal Processing Magazine.

[61]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[62]  Boualem Boashash,et al.  An automatic fast optimization of Quadratic Time-frequency Distribution using the hybrid genetic algorithm , 2017, Signal Process..

[63]  Reinhard Klette,et al.  A Comparative Evaluation of Length Estimators of Digital Curves , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[64]  Yilmaz Kaya,et al.  1D-local binary pattern based feature extraction for classification of epileptic EEG signals , 2014, Appl. Math. Comput..

[65]  Leen-Kiat Soh,et al.  Texture analysis of SAR sea ice imagery using gray level co-occurrence matrices , 1999, IEEE Trans. Geosci. Remote. Sens..

[66]  Kun-Ching Wang,et al.  The Feature Extraction Based on Texture Image Information for Emotion Sensing in Speech , 2014, Sensors.

[67]  Joakim Lindblad,et al.  High-Precision Boundary Length Estimation by Utilizing Gray-Level Information , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[68]  Marina L. Gavrilova,et al.  Gauss–Laguerre wavelet textural feature fusion with geometrical information for facial expression identification , 2012, EURASIP J. Image Video Process..

[69]  D Forrester,et al.  Time-Frequency Analysis in Machine Fault-Detection , 1992 .

[70]  Calvin C. Gotlieb,et al.  Texture descriptors based on co-occurrence matrices , 1990, Comput. Vis. Graph. Image Process..

[71]  Guojun Lu,et al.  Review of shape representation and description techniques , 2004, Pattern Recognit..

[72]  Jean-Jacques E. Slotine,et al.  Audio classification from time-frequency texture , 2008, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[73]  Ram Bilas Pachori,et al.  Automatic classification of sleep stages based on the time-frequency image of EEG signals , 2013, Comput. Methods Programs Biomed..

[74]  Deniz Erdogmus,et al.  Clustering Approach to Quantify Long-Term Spatio-Temporal Interactions in Epileptic Intracranial Electroencephalography , 2007, Comput. Intell. Neurosci..

[75]  Jinhee Chun,et al.  Distance interior ratio: A new shape signature for 2D shape retrieval , 2016, Pattern Recognit. Lett..

[76]  J. Gotman,et al.  Evaluation of an automatic seizure detection method for the newborn EEG. , 1997, Electroencephalography and clinical neurophysiology.

[77]  Mostefa Mesbah,et al.  Detection of seizures in newborns using time-frequency analysis of EEG signals , 2000, Proceedings of the Tenth IEEE Workshop on Statistical Signal and Array Processing (Cat. No.00TH8496).

[78]  Mostefa Mesbah,et al.  EEG spike detection using time-frequency signal analysis , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.