Computer-Assisted Sleep Classification according to the Standard of the American Academy of Sleep Medicine : Validation Study of the AASM Version of the Somnolyzer 24 ! 7

Background: In 2007, the AASM Manual for the Scoring of Sleep and Associated Events was published by the American Academy of Sleep Medicine (AASM). Concerning the visual classification of sleep stages, these new rules are intended to replace the rules by Rechtschaffen and Kales (R&K). Methods: We adapted the automatic R&K sleep scoring system Somnolyzer 24 × 7 to comply with the AASM rules and subsequently performed a validation study based on 72 polysomnographies from the Siesta database (56 healthy subjects, 16 patients, 38 females, 34 males, aged 21–86 years). Scorings according to the AASM rules were performed manually by experienced sleep scorers and semi-automatically by the AASM version of the Somnolyzer. Manual scorings and Somnolyzer reviews were performed independently by at least 2 out of 8 experts from 4 sleep centers. Results: In the quality control process, sleep experts corrected 4.8 and 3.7% of the automatically assigned epochs, resulting in a reliability between 2 Somnolyzer-assisted scorings of 99% (Cohen’s kappa: 0.99). In contrast, the reliability between the 2 manual scorings was 82% (kappa: 0.76). The agreement between the 2 Somnolyzer-assisted and the 2 visual scorings was between 81% (kappa: 0.75) and 82% (kappa: 0.76). Conclusion: The AASM version of the Somnolyzer revealed an agreement between semi-automated and human expert scoring comparable to that published for the R&K version with a validity comparable to that of human experts, but with a reliability close to 1, thereby reducing interrater variability as well as scoring time to a minimum.

[1]  A. Rechtschaffen.  A manual of standardized terminology, techniques and scoring system for sleep of human subjects , 1968 .

[2]  Itil Tm.  Automatic classification of sleep stages and the discrimination of vigilance changes using digital computer methods. , 1969 .

[3]  Automatic classification of sleep stages and the discrimination of vigilance changes using digital computer methods. , 1969, Agressologie: revue internationale de physio-biologie et de pharmacologie appliquees aux effets de l'agression.

[4]  E. Wolpert.  A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects. , 1969 .

[5]  J R Smith,et al.  EEG sleep stage scoring by an automatic hybrid system. , 1971, Electroencephalography and clinical neurophysiology.

[6]  R. Hoffmann,et al.  Quantitative description of sleep stage electrophysiology using digital period analytic techniques. , 1984, Sleep.

[7]  S. Kubicki,et al.  Sleep EEG evaluation: a comparison of results obtained by visual scoring and automatic analysis with the Oxford sleep stager. , 1989, Sleep.

[8]  A Värri,et al.  A simple format for exchange of digitized polygraphic recordings. , 1992, Electroencephalography and clinical neurophysiology.

[9]  M. Vitiello,et al.  C STAGE, automated sleep scoring: development and comparison with human sleep scoring for healthy older men and women. , 1994, Sleep.

[10]  A. Muzet,et al.  Sleep stage scoring using the neural network model: comparison between visual and automatic analysis in normal subjects and patients. , 1996, Sleep.

[11]  W. Herrmann,et al.  On the Use of Neural Network Techniques to Analyze Sleep EEG Data , 1997, Neuropsychobiology.

[12]  W. Herrmann,et al.  On the use of neural network techniques to analyze sleep EEG data. Third communication: robustification of the classificator by applying an algorithm obtained from 9 different networks. , 1998, Neuropsychobiology.

[13]  Jean Gotman,et al.  Computer-assisted sleep staging , 2001, IEEE Trans. Biomed. Eng..

[14]  A. Varri,et al.  The SIESTA project polygraphic and clinical database , 2001, IEEE Engineering in Medicine and Biology Magazine.

[15]  A Bolz,et al.  AUTOMATED SLEEP STAGE DETECTION WITH A CLASSICAL AND A NEURAL LEARNING ALGORITHM – METHODOLOGICAL ASPECTS , 2002, Biomedizinische Technik. Biomedical engineering.

[16]  Koby Todros,et al.  Assessment of automated scoring of polysomnographic recordings in a population with suspected sleep-disordered breathing. , 2004, Sleep.

[17]  A. Schlögl,et al.  Interrater reliability between scorers from eight European sleep laboratories in subjects with different sleep disorders , 2004, Journal of sleep research.

[18]  J. Lorenzo,et al.  Sleep Laboratory Study on Single and Repeated Dose Effects of Paroxetine, Alprazolam and Their Combination in Healthy Young Volunteers , 2005, Neuropsychobiology.

[19]  P. Anderer,et al.  Insomnia in Somatoform Pain Disorder: Sleep Laboratory Studies on Differences to Controls and Acute Effects of Trazodone, Evaluated by the Somnolyzer 24 × 7 and the Siesta Database , 2005, Neuropsychobiology.

[20]  A. Schlögl,et al.  An E-Health Solution for Automatic Sleep Classification according to Rechtschaffen and Kales: Validation Study of the Somnolyzer 24 × 7 Utilizing the Siesta Database , 2005, Neuropsychobiology.

[21]  J. Röschke,et al.  Percentile reference charts for selected sleep parameters for 20- to 80-Year-Old healthy subjects from the SIESTA database , 2005 .

[22]  N. Butkov,et al.  Digital analysis and technical specifications. , 2007, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[23]  Junshui Ma,et al.  Evaluation of automated and semi-automated scoring of polysomnographic recordings from a clinical trial using zolpidem in the treatment of insomnia. , 2007, Sleep.

[24]  A. Chesson,et al.  The American Academy of Sleep Medicine (AASM) Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications , 2007 .

[25]  G. Zammit.  Insufficient evidence for the use of automated and semi-automated scoring of polysomnographic recordings. , 2008, Sleep.

[26]  S. Doran,et al.  Automated Sleep Scoring with Human Supervision Adds Value Compared with Human Scoring Alone: A reply to Zammit G. K. Insufficient evidence for the use of automated and semi-automated scoring of polysomnographic recordings. SLEEP 2008:31;449–50. , 2008 .

[27]  L. Parrino,et al.  Commentary from the Italian Association of Sleep Medicine on the AASM manual for the scoring of sleep and associated events: for debate and discussion. , 2009, Sleep medicine.

[28]  P. Anderer,et al.  Interrater reliability for sleep scoring according to the Rechtschaffen & Kales and the new AASM standard , 2009, Journal of sleep research.

[29]  P. Anderer,et al.  Sleep classification according to AASM and Rechtschaffen & Kales: effects on sleep scoring parameters. , 2009, Sleep.