Computer-Assisted Automated Scoring of Polysomnograms Using the Somnolyzer System.

STUDY OBJECTIVES Manual scoring of polysomnograms is a time-consuming and tedious process. To expedite the scoring of polysomnograms, several computerized algorithms for automated scoring have been developed. The overarching goal of this study was to determine the validity of the Somnolyzer system, an automated system for scoring polysomnograms. DESIGN The analysis sample comprised of 97 sleep studies. Each polysomnogram was manually scored by certified technologists from four sleep laboratories and concurrently subjected to automated scoring by the Somnolyzer system. Agreement between manual and automated scoring was examined. Sleep staging and scoring of disordered breathing events was conducted using the 2007 American Academy of Sleep Medicine criteria. SETTING Clinical sleep laboratories. MEASUREMENTS AND RESULTS A high degree of agreement was noted between manual and automated scoring of the apnea-hypopnea index (AHI). The average correlation between the manually scored AHI across the four clinical sites was 0.92 (95% confidence interval: 0.90-0.93). Similarly, the average correlation between the manual and Somnolyzer-scored AHI values was 0.93 (95% confidence interval: 0.91-0.96). Thus, interscorer correlation between the manually scored results was no different than that derived from manual and automated scoring. Substantial concordance in the arousal index, total sleep time, and sleep efficiency between manual and automated scoring was also observed. In contrast, differences were noted between manually and automated scored percentages of sleep stages N1, N2, and N3. CONCLUSION Automated analysis of polysomnograms using the Somnolyzer system provides results that are comparable to manual scoring for commonly used metrics in sleep medicine. Although differences exist between manual versus automated scoring for specific sleep stages, the level of agreement between manual and automated scoring is not significantly different than that between any two human scorers. In light of the burden associated with manual scoring, automated scoring platforms provide a viable complement of tools in the diagnostic armamentarium of sleep medicine.

[1]  S. Ancoli-Israel,et al.  Night-to-night arousal variability and interscorer reliability of arousal measurements. , 1999, Sleep.

[2]  H. Zwick,et al.  Quantification of sleep disordered breathing by computerized analysis of oximetry, heart rate and snoring. , 1991, The European respiratory journal.

[3]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[4]  Junshui Ma,et al.  Evaluation of automated and semi-automated scoring of polysomnographic recordings from a clinical trial using zolpidem in the treatment of insomnia. , 2007, Sleep.

[5]  S. Redline,et al.  Reliability of scoring respiratory disturbance indices and sleep staging. , 1998, Sleep.

[6]  W A Whitelaw,et al.  Automated analysis of digital oximetry in the diagnosis of obstructive sleep apnoea , 2000, Thorax.

[7]  Parmjit Singh,et al.  The new AASM criteria for scoring hypopneas: impact on the apnea hypopnea index. , 2009, Sleep.

[8]  David Gozal,et al.  The scoring of respiratory events in sleep: reliability and validity. , 2007, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[9]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[10]  Thomas Penzel,et al.  Agreement in the scoring of respiratory events and sleep among international sleep centers. , 2013, Sleep.

[11]  C. Guilleminault,et al.  Investigations of an automatic screening device (MESAM) for obstructive sleep apnoea. , 1990, The European respiratory journal.

[12]  Helena Chmura Kraemer,et al.  Measurement error in visually scored electrophysiological data: respiration during sleep , 1984, Journal of Neuroscience Methods.

[13]  Koby Todros,et al.  Assessment of automated scoring of polysomnographic recordings in a population with suspected sleep-disordered breathing. , 2004, Sleep.

[14]  R. Fonseca-Pinto,et al.  Screening of obstructive sleep apnea using Hilbert-Huang decomposition of oronasal airway pressure recordings. , 2010, Medical engineering & physics.

[15]  Atul Malhotra,et al.  Agreement in computer-assisted manual scoring of polysomnograms across sleep centers. , 2013, Sleep.

[16]  H Nakano,et al.  Automatic detection of sleep-disordered breathing from a single-channel airflow record , 2007, European Respiratory Journal.

[17]  S. Quan,et al.  Rules for scoring respiratory events in sleep: update of the 2007 AASM Manual for the Scoring of Sleep and Associated Events. Deliberations of the Sleep Apnea Definitions Task Force of the American Academy of Sleep Medicine. , 2012, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[18]  T Penzel,et al.  MESAM: a heart rate and snoring recorder for detection of obstructive sleep apnea. , 1990, Sleep.

[19]  N. Collop.  Scoring variability between polysomnography technologists in different sleep laboratories. , 2002, Sleep medicine.

[20]  C Guilleminault,et al.  MESAM 4: an ambulatory device for the detection of patients at risk for obstructive sleep apnea syndrome (OSAS). , 1992, Chest.

[21]  Zoltán Benyó,et al.  A novel method for the detection of apnea and hypopnea events in respiration signals , 2002, IEEE Transactions on Biomedical Engineering.

[22]  A. Beckett,et al.  AKUFO AND IBARAPA. , 1965, Lancet.

[23]  J. Lorenzo,et al.  Sleep Laboratory Study on Single and Repeated Dose Effects of Paroxetine, Alprazolam and Their Combination in Healthy Young Volunteers , 2005, Neuropsychobiology.

[24]  N. Butkov,et al.  Digital analysis and technical specifications. , 2007, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[25]  Roberto Hornero,et al.  Multivariate Analysis of Blood Oxygen Saturation Recordings in Obstructive Sleep Apnea Diagnosis , 2010, IEEE Transactions on Biomedical Engineering.

[26]  A. Walters,et al.  The scoring of arousal in sleep: reliability, validity, and alternatives. , 2007, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[27]  P. Anderer,et al.  Computer-Assisted Sleep Classification according to the Standard of the American Academy of Sleep Medicine : Validation Study of the AASM Version of the Somnolyzer 24 ! 7 , 2010 .

[28]  A. Schlögl,et al.  An E-Health Solution for Automatic Sleep Classification according to Rechtschaffen and Kales: Validation Study of the Somnolyzer 24 × 7 Utilizing the Siesta Database , 2005, Neuropsychobiology.

[29]  J Zieliński,et al.  Hand-scoring of MESAM 4 recordings is more accurate than automatic analysis in screening for obstructive sleep apnoea. , 1994, The European respiratory journal.

[30]  A. Pack,et al.  Performance of an automated polysomnography scoring system versus computer-assisted manual scoring. , 2013, Sleep.

[31]  P. Anderer,et al.  Insomnia in Somatoform Pain Disorder: Sleep Laboratory Studies on Differences to Controls and Acute Effects of Trazodone, Evaluated by the Somnolyzer 24 × 7 and the Siesta Database , 2005, Neuropsychobiology.