Automated feature learning using deep convolutional auto-encoder neural network for clustering electroencephalograms into sleep stages

Deep neural networks have emerged as popular machine learning tools due to their ability to automatically learn feature representations from raw input data. An auto-encoder neural network is a special network that can be trained in an unsupervised manner for automated feature learning. Unsupervised analysis of EEG signals is highly desirable since supervised analysis requires manual labeling of EEG signals which can be labor intensive and time consuming given the large amount of EEG data collected. We present a deep convolutional auto-encoder neural network to automatically learn feature representations from raw EEG signals in an unsupervised manner. We use the features extracted from the auto-encoder neural network for clustering EEG signals into sleep stages. For clustering, we test two algorithms: K-means – which is a single-membership model, and the latent Dirichlet allocation (LDA) topic model – which is a mixed membership model. Results are presented demonstrating an improvement in clustering performance using auto-encoder features compared to standard manually extracted features.

[1]  Honglak Lee,et al.  Unsupervised feature learning for audio classification using convolutional deep belief networks , 2009, NIPS.

[2]  Amy Loutfi,et al.  Sleep Stage Classification Using Unsupervised Feature Learning , 2012, Adv. Artif. Neural Syst..

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Mark Steyvers,et al.  Finding scientific topics , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[5]  E. Wolpert A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects. , 1969 .

[6]  J. Sackellares,et al.  Quantitative EEG analysis for automated detection of nonconvulsive seizures in intensive care units , 2011, Epilepsy & Behavior.

[7]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[8]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[9]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[10]  M R Nuwer,et al.  Quantitative EEG: I. Techniques and Problems of Frequency Analysis and Topographic Mapping , 1988, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[11]  P. Welch The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[12]  C. Mallows,et al.  A Method for Comparing Two Hierarchical Clusterings , 1983 .

[13]  Suzanne Lesecq,et al.  Feature selection for sleep/wake stages classification using data driven methods , 2007, Biomed. Signal Process. Control..

[14]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[15]  U. Rajendra Acharya,et al.  Automated EEG analysis of epilepsy: A review , 2013, Knowl. Based Syst..

[16]  Ruslan Salakhutdinov,et al.  Evaluation methods for topic models , 2009, ICML '09.

[17]  M. Nuwer Quantitative EEG: II. Frequency Analysis and Topographic Mapping in Clinical Settings , 1988, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[18]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[19]  Mannes Poel,et al.  Comparison of feature and classifier algorithms for online automatic sleep staging based on a single EEG signal , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Chao Wu,et al.  DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.