Sleep Staging Using Plausibility Score: A Novel Feature Selection Method Based on Metric Learning

As an effective method, feature selection can reduce computational complexity and improve classification performance. A number of criteria exist for feature selection using labeled data, unlabeled data and pairwise constraints, most of which are based on the Euclidean distance. In this paper, we propose a filter method for feature selection with pairwise constraints, aiming to jointly evaluate a feature subset based on metric learning. Two criteria are designed based on the well-known Kullback-Leibler divergence for measuring the difference between must-link constraints and cannot-link constraints that can indicate the feature subset discrimination based on Keep It Simple and Straightforward (KISS) metric learning and Cross-view Quadratic Discriminant Analysis (XQDA) metric learning. To address the challenging feature selection problem, we formulate a sequential search algorithm guided by indicators that are simplified from the proposed criteria. Furthermore, we conducted several experiments on sleep staging based on electroencephalogram (EEG) recordings from the Sleep-EDF Database Expanded. The experimental results demonstrate the effectiveness of the proposed method compared with nine representative feature selection methods. On the data set from healthy volunteers and the data set from volunteers that had mild difficulty falling asleep, the classification average accuracies achieve 97.66% and 93.57% by using the proposed method, respectively.

[1]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[2]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[3]  Xiaoli Z. Fern,et al.  Active Learning of Constraints for Semi-Supervised Clustering , 2014, IEEE Transactions on Knowledge and Data Engineering.

[4]  Jan Komorowski,et al.  BIOINFORMATICS ORIGINAL PAPER doi:10.1093/bioinformatics/btm486 Data and text mining Monte Carlo , 2022 .

[5]  Homer Nazeran,et al.  Wavelet-based EEG denoising for automatic sleep stage classification , 2011, CONIELECOMP 2011, 21st International Conference on Electrical Communications and Computers.

[6]  Ravinesh C. Deo,et al.  Sleep EEG signal analysis based on correlation graph similarity coupled with an ensemble extreme machine learning algorithm , 2019, Expert Syst. Appl..

[7]  Aeilko H. Zwinderman,et al.  Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG , 2000, IEEE Transactions on Biomedical Engineering.

[8]  Masashi Sugiyama,et al.  Feature Selection via L1-Penalized Squared-Loss Mutual Information , 2012, IEICE Trans. Inf. Syst..

[9]  Musa Peker,et al.  A Comparative Study on Classification of Sleep Stage Based on EEG Signals Using Feature Selection and Classification Algorithms , 2014, Journal of Medical Systems.

[10]  Feiping Nie,et al.  Trace Ratio Criterion for Feature Selection , 2008, AAAI.

[11]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[12]  Kazuyuki Murase,et al.  A new wrapper feature selection approach using neural network , 2010, Neurocomputing.

[13]  Enrique Vidal,et al.  Learning prototypes and distances (LPD). A prototype reduction technique based on nearest neighbor error minimization , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[14]  Feiping Nie,et al.  Efficient and Robust Feature Selection via Joint ℓ2, 1-Norms Minimization , 2010, NIPS.

[15]  Abdulhamit Subasi,et al.  A decision support system for automated identification of sleep stages from single-channel EEG signals , 2017, Knowl. Based Syst..

[16]  Horst Bischof,et al.  Large scale metric learning from equivalence constraints , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Abdulhamit Subasi,et al.  Surface EMG signal classification using ternary pattern and discrete wavelet transform based feature extraction for hand movement recognition , 2020, Biomed. Signal Process. Control..

[18]  Necmettin Sezgin,et al.  Estimation of Sleep Stages by an Artificial Neural Network Employing EEG, EMG and EOG , 2010, Journal of Medical Systems.

[19]  Amy Loutfi,et al.  Sleep Stage Classification Using Unsupervised Feature Learning , 2012, Adv. Artif. Neural Syst..

[20]  Jinwei Sun,et al.  An improved simulated annealing genetic algorithm of EEG feature selection in sleep stage , 2016, 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[21]  Suzanne Lesecq,et al.  Feature selection for sleep/wake stages classification using data driven methods , 2007, Biomed. Signal Process. Control..

[22]  Umberto Castellani,et al.  Infinite Latent Feature Selection: A Probabilistic Latent Graph-Based Ranking Approach , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[23]  Gérard Cornuéjols,et al.  Valid inequalities for mixed integer linear programs , 2007, Math. Program..

[24]  Zi Huang,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence ℓ2,1-Norm Regularized Discriminative Feature Selection for Unsupervised Learning , 2022 .

[25]  Jiawei Han,et al.  Generalized Fisher Score for Feature Selection , 2011, UAI.

[26]  Inderjit S. Dhillon,et al.  Information-theoretic metric learning , 2006, ICML '07.

[27]  Daoqiang Zhang,et al.  Constraint Score: A new filter method for feature selection with pairwise constraints , 2008, Pattern Recognit..

[28]  Derek Greene,et al.  Constraint Selection by Committee: An Ensemble Approach to Identifying Informative Constraints for Semi-supervised Clustering , 2007, ECML.

[29]  Ram Bilas Pachori,et al.  Automatic classification of sleep stages based on the time-frequency image of EEG signals , 2013, Comput. Methods Programs Biomed..

[30]  M. A. Mohd Ali,et al.  Compatibility of mother wavelet functions with the electroencephalographic signal , 2012, 2012 IEEE-EMBS Conference on Biomedical Engineering and Sciences.

[31]  Syed Anas Imtiaz,et al.  A Low Computational Cost Algorithm for REM Sleep Detection Using Single Channel EEG , 2014, Annals of Biomedical Engineering.

[32]  Dirk Van Compernolle,et al.  Minimum classification error training in example based speech and pattern recognition using sparse weight matrices , 2009, J. Comput. Appl. Math..

[33]  Yan Li,et al.  EEG Sleep Stages Classification Based on Time Domain Features and Structural Graph Similarity , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  E. Wolpert A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects. , 1969 .

[35]  Hiok Chai Quek,et al.  MCES: A Novel Monte Carlo Evaluative Selection Approach for Objective Feature Selections , 2007, IEEE Transactions on Neural Networks.

[36]  Ted K. Ralphs,et al.  Integer and Combinatorial Optimization , 2013 .

[37]  Huy Phan,et al.  Metric learning for automatic sleep stage classification , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[38]  Urbano Nunes,et al.  Efficient feature selection for sleep staging based on maximal overlap discrete wavelet transform and SVM , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[39]  Fenlin Liu,et al.  Selection of image features for steganalysis based on the Fisher criterion , 2014, Digit. Investig..

[40]  Huan Liu,et al.  Toward integrating feature selection algorithms for classification and clustering , 2005, IEEE Transactions on Knowledge and Data Engineering.

[41]  Abdulhamit Subasi,et al.  Ensemble SVM Method for Automatic Sleep Stage Classification , 2018, IEEE Transactions on Instrumentation and Measurement.

[42]  Claude Le Pape,et al.  Exploring relaxation induced neighborhoods to improve MIP solutions , 2005, Math. Program..

[43]  Seral Özsen,et al.  Classification of sleep stages using class-dependent sequential feature selection and artificial neural network , 2012, Neural Computing and Applications.

[44]  Anna Krakovská,et al.  Automatic sleep scoring: A search for an optimal combination of measures , 2011, Artif. Intell. Medicine.

[45]  Mohammed Imamul Hassan Bhuiyan,et al.  Automated identification of sleep states from EEG signals by means of ensemble empirical mode decomposition and random under sampling boosting , 2017, Comput. Methods Programs Biomed..

[46]  Shengcai Liao,et al.  Person re-identification by Local Maximal Occurrence representation and metric learning , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Daniel Lemire,et al.  Time series classification by class-specific Mahalanobis distance measures , 2010, Adv. Data Anal. Classif..

[48]  Geoffrey E. Hinton,et al.  Neighbourhood Components Analysis , 2004, NIPS.

[49]  Rajeev Sharma,et al.  Automatic sleep stages classification based on iterative filtering of electroencephalogram signals , 2017, Neural Computing and Applications.

[50]  Cheng-Lung Huang,et al.  A GA-based feature selection and parameters optimizationfor support vector machines , 2006, Expert Syst. Appl..

[51]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[52]  José Luis Rodríguez-Sotelo,et al.  Automatic Sleep Stages Classification Using EEG Entropy Features and Unsupervised Pattern Analysis Techniques , 2014, Entropy.

[53]  Timo Berthold Primal Heuristics for Mixed Integer Programs , 2006 .

[54]  Marek Kretowski,et al.  Evolutionary Learning of Linear Trees with Embedded Feature Selection , 2006, ICAISC.

[55]  Marko Robnik-Sikonja,et al.  Theoretical and Empirical Analysis of ReliefF and RReliefF , 2003, Machine Learning.

[56]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.