An E-Health Solution for Automatic Sleep Classification according to Rechtschaffen and Kales: Validation Study of the Somnolyzer 24 × 7 Utilizing the Siesta Database

To date, the only standard for the classification of sleep-EEG recordings that has found worldwide acceptance are the rules published in 1968 by Rechtschaffen and Kales. Even though several attempts have been made to automate the classification process, so far no method has been published that has proven its validity in a study including a sufficiently large number of controls and patients of all adult age ranges. The present paper describes the development and optimization of an automatic classification system that is based on one central EEG channel, two EOG channels and one chin EMG channel. It adheres to the decision rules for visual scoring as closely as possible and includes a structured quality control procedure by a human expert. The final system (Somnolyzer 24 × 7™) consists of a raw data quality check, a feature extraction algorithm (density and intensity of sleep/wake-related patterns such as sleep spindles, delta waves, SEMs and REMs), a feature matrix plausibility check, a classifier designed as an expert system, a rule-based smoothing procedure for the start and the end of stages REM, and finally a statistical comparison to age- and sex-matched normal healthy controls (Siesta Spot Report™). The expert system considers different prior probabilities of stage changes depending on the preceding sleep stage, the occurrence of a movement arousal and the position of the epoch within the NREM/REM sleep cycles. Moreover, results obtained with and without using the chin EMG signal are combined. The Siesta polysomnographic database (590 recordings in both normal healthy subjects aged 20–95 years and patients suffering from organic or nonorganic sleep disorders) was split into two halves, which were randomly assigned to a training and a validation set, respectively. The final validation revealed an overall epoch-by-epoch agreement of 80% (Cohen’s kappa: 0.72) between the Somnolyzer 24 × 7 and the human expert scoring, as compared with an inter-rater reliability of 77% (Cohen’s kappa: 0.68) between two human experts scoring the same dataset. Two Somnolyzer 24 × 7 analyses (including a structured quality control by two human experts) revealed an inter-rater reliability close to 1 (Cohen’s kappa: 0.991), which confirmed that the variability induced by the quality control procedure, whereby approximately 1% of the epochs (in 9.5% of the recordings) are changed, can definitely be neglected. Thus, the validation study proved the high reliability and validity of the Somnolyzer 24 × 7 and demonstrated its applicability in clinical routine and sleep studies.

[1]  A. Rechtschaffen.  A manual of standardized terminology, techniques and scoring system for sleep of human subjects , 1968 .

[2]  Itil Tm.  Automatic classification of sleep stages and the discrimination of vigilance changes using digital computer methods. , 1969 .

[3]  E. Wolpert.  A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects. , 1969 .

[4]  J R Smith,et al.  EEG sleep stage scoring by an automatic hybrid system. , 1971, Electroencephalography and clinical neurophysiology.

[5]  P. Ktonas,et al.  Spectral analysis vs. period-amplitude analysis of narrowband EEG activity: a comparison based on the sleep delta-frequency band. , 1981, Sleep.

[6]  R. Hoffmann,et al.  Quantitative description of sleep stage electrophysiology using digital period analytic techniques. , 1984, Sleep.

[7]  S. Kubicki,et al.  Sleep EEG evaluation: a comparison of results obtained by visual scoring and automatic analysis with the Oxford sleep stager. , 1989, Sleep.

[8]  F. H. Lopes da Silva,et al.  A model-based detector of vertex waves and K complexes in sleep electroencephalogram. , 1991, Electroencephalography and clinical neurophysiology.

[9]  P. Berg,et al.  Dipole models of eye movements and blinks. , 1991, Electroencephalography and clinical neurophysiology.

[10]  L H Larsen,et al.  EKG artifacts suppression from the EEG. , 1991, Electroencephalography and clinical neurophysiology.

[11]  A Värri,et al.  A simple format for exchange of digitized polygraphic recordings. , 1992, Electroencephalography and clinical neurophysiology.

[12]  H. Schulz,et al.  Pattern recognition by matched filtering: an analysis of sleep spindle and K-complex density under the influence of lormetazepam and zopiclone. , 1992, Neuropsychobiology.

[13]  A Värri,et al.  The effect of small differences in electrode position on EOG signals: application to vigilance studies. , 1993, Electroencephalography and clinical neurophysiology.

[14]  T. Penzel,et al.  Empfehlungen zur Durchführung und Auswertung polygraphischer Ableitungen im diagnostischen Schlaflabor , 1993 .

[15]  J P Macher,et al.  Neural network model: application to automatic analysis of human sleep. , 1993, Computers and biomedical research, an international journal.

[16]  R J Sclabassi,et al.  A comparison of conventional and matched filtering techniques for rapid eye movement detection of the newborn. , 1994, IEEE transactions on bio-medical engineering.

[17]  R.J. Sclabassi,et al.  A comparison of conventional and matched filtering techniques for rapid eye movement detection of the newborn [electro-oculography] , 1994, IEEE Transactions on Biomedical Engineering.

[18]  MARC JOBERT,et al.  Wavelets—a new tool in sleep biosignal analysis , 1994, Journal of sleep research.

[19]  B Saletu,et al.  Automatic Sleep-Spindle Detection Procedure: Aspects of Reliability and Validity , 1994, Clinical EEG.

[20]  M. Vitiello,et al.  C STAGE, automated sleep scoring: development and comparison with human sleep scoring for healthy older men and women. , 1994, Sleep.

[21]  F Wallner,et al.  [Detection of rapid eye movement with rapidly adapting neuronal fuzzy systems in imprecise REM syntax]. , 1996, Biomedizinische Technik. Biomedical engineering.

[22]  David J. C. MacKay,et al.  BAYESIAN NON-LINEAR MODELING FOR THE PREDICTION COMPETITION , 1996 .

[23]  R. Vasko,et al.  Muscle artifacts in the sleep EEG: Automated detection and effect on all‐night EEG power spectra , 1996, Journal of sleep research.

[24]  L. Tarassenko,et al.  A new approach to the analysis of the human sleep/wakefulness continuum , 1996, Journal of sleep research.

[25]  A. Muzet,et al.  Sleep stage scoring using the neural network model: comparison between visual and automatic analysis in normal subjects and patients. , 1996, Sleep.

[26]  W. Herrmann,et al.  On the Use of Neural Network Techniques to Analyze Sleep EEG Data , 1997, Neuropsychobiology.

[27]  W. Herrmann,et al.  On the use of neural network techniques to analyze sleep EEG data. Third communication: robustification of the classificator by applying an algorithm obtained from 9 different networks. , 1998, Neuropsychobiology.

[28]  D. White,et al.  Evaluation of a computerized polysomnographic system. , 1998, Sleep.

[29]  C Strungaru,et al.  Neural Network for Sleep EEG K-Complex Detection , 1998, Biomedizinische Technik. Biomedical engineering.

[30]  S. J. Roberts,et al.  Independent Component Analysis: Source Assessment Separation, a Bayesian Approach , 1998 .

[31]  Peter Achermann,et al.  Temporal evolution of coherence and power in the human sleep electroencephalogram , 1998, Journal of sleep research.

[32]  G. Pfurtscheller,et al.  Quality control of polysomnographic sleep data by histogram and entropy analysis , 1999, Clinical Neurophysiology.

[33]  I. Feinberg,et al.  A Comparison of Period Amplitude Analysis and FFT Power Spectral Analysis of All-Night Human Sleep EEG , 1999, Physiology & Behavior.

[34]  A. Schlögl,et al.  Artifact Processing in Computerized Analysis of Sleep EEG – A Review , 1999, Neuropsychobiology.

[35]  Aeilko H. Zwinderman,et al.  Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG , 2000, IEEE Transactions on Biomedical Engineering.

[36]  S. Himanen,et al.  Limitations of Rechtschaffen and Kales. , 2000, Sleep medicine reviews.

[37]  Y Tsuji,et al.  Automatic detection of rapid eye movements by discrete wavelet transform , 2000, Psychiatry and clinical neurosciences.

[38]  T. Penzel,et al.  Computer based sleep recording and analysis. , 2000, Sleep medicine reviews.

[39]  I. Feinberg,et al.  A simple method for computer quantification of stage REM eye movement potentials. , 2001, Psychophysiology.

[40]  Jean Gotman,et al.  Computer-assisted sleep staging , 2001, IEEE Trans. Biomed. Eng..

[41]  A. Varri,et al.  The SIESTA project polygraphic and clinical database , 2001, IEEE Engineering in Medicine and Biology Magazine.

[42]  Kazuhiko Fukuda,et al.  Proposed supplements and amendments to ‘A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects’, the Rechtschaffen & Kales (1968) standard , 2001, Psychiatry and clinical neurosciences.

[43]  A Flexer,et al.  Unsupervised continuous sleep analysis. , 2002, Methods and findings in experimental and clinical pharmacology.

[44]  Georg Dorffner,et al.  An automatic, continuous and probabilistic sleep stager based on a hidden markov model , 2002, Appl. Artif. Intell..

[45]  A Bolz,et al.  AUTOMATED SLEEP STAGE DETECTION WITH A CLASSICAL AND A NEURAL LEARNING ALGORITHM – METHODOLOGICAL ASPECTS , 2002, Biomedizinische Technik. Biomedical engineering.

[46]  Thomas Penzel,et al.  Knowledge-based automatic sleep-stage recognition - reduction in the interpretation variability , 2003 .

[47]  T. Penzel,et al.  Reliablität der visuellen Schlafauswertung nach Rechtschaffen und Kales von acht Aufzeichnungen durch neun Schlaflabore , 2003 .

[48]  Max Hirshkowitz,et al.  Normal human sleep: an overview. , 2004, The Medical clinics of North America.

[49]  Koby Todros,et al.  Assessment of automated scoring of polysomnographic recordings in a population with suspected sleep-disordered breathing. , 2004, Sleep.

[50]  A. Schlögl,et al.  Interrater reliability between scorers from eight European sleep laboratories in subjects with different sleep disorders , 2004, Journal of sleep research.

[51]  M. Lehtokangas,et al.  Autoassociative MLP in Sleep Spindle Detection , 2004, Journal of Medical Systems.

[52]  Georg Dorffner,et al.  A reliable probabilistic sleep stager based on a single EEG signal , 2005, Artif. Intell. Medicine.

[53]  Mary A. Carskadon,et al.  Chapter 116 – Monitoring and Staging Human Sleep , 2005 .

[54]  J. Lorenzo,et al.  Sleep Laboratory Study on Single and Repeated Dose Effects of Paroxetine, Alprazolam and Their Combination in Healthy Young Volunteers , 2005, Neuropsychobiology.

[55]  P. Anderer,et al.  Insomnia in Somatoform Pain Disorder: Sleep Laboratory Studies on Differences to Controls and Acute Effects of Trazodone, Evaluated by the Somnolyzer 24 × 7 and the Siesta Database , 2005, Neuropsychobiology.