Home sleep apnea testing: comparison of manual and automated scoring across international sleep centers

PurposeTo determine the agreement between the manual scoring of home sleep apnea tests (HSATs) by international sleep technologists and automated scoring systems.MethodsFifteen HSATs, previously recorded using a type 3 monitor, were saved in European Data Format. The studies were scored by nine experienced technologists from the sleep centers of the Sleep Apnea Global Interdisciplinary Consortium (SAGIC) using the locally available software. Each study was scored separately by human scorers using the nasal pressure (NP), flow derived from the NP signal (transformed NP), or respiratory inductive plethysmography (RIP) flow. The same procedure was followed using two automated scoring systems: Remlogic (RLG) and Noxturnal (NOX).ResultsThe intra-class correlation coefficients (ICCs) of the apnea-hypopnea index (AHI) scoring using the NP, transformed NP, and RIP flow were 0.96 [95% CI 0.93–0.99], 0.98 [0.96–0.99], and 0.97 [0.95–0.99], respectively. Using the NP signal, the mean differences in AHI between the average of the manual scoring and the automated systems were − 0.9 ± 3.1/h (AHIRLG vs AHIMANUAL) and − 1.3 ± 2.6/h (AHINOX vs AHIMANUAL). Using the transformed NP, the mean differences in AHI were − 1.9 ± 3.3/h (AHIRLG vs AHIMANUAL) and 1.6 ± 3.0/h (AHINOX vs AHIMANUAL). Using the RIP flow, the mean differences in AHI were − 2.7 ± 4.5/h (AHIRLG vs AHIMANUAL) and 2.3 ± 3.4/h (AHINOX vs AHIMANUAL).ConclusionsThere is very strong agreement in the scoring of the AHI for HSATs between the automated systems and experienced international technologists. Automated scoring of HSATs using commercially available software may be useful to standardize scoring in future endeavors involving international sleep centers.

[1]  Ricardo Pereira,et al.  Therapeutic decision-making for sleep apnea and hypopnea syndrome using home respiratory polygraphy: a large multicentric study. , 2011, American journal of respiratory and critical care medicine.

[2]  Georg Dorffner,et al.  Computer-Assisted Automated Scoring of Polysomnograms Using the Somnolyzer System. , 2015, Sleep.

[3]  A Värri,et al.  A simple format for exchange of digitized polygraphic recordings. , 1992, Electroencephalography and clinical neurophysiology.

[4]  D. Newby,et al.  Diagnosis of sleep‐disordered breathing in patients with chronic heart failure: evaluation of a portable limited sleep study system , 2007, Journal of sleep research.

[5]  S. Quan,et al.  Rules for scoring respiratory events in sleep: update of the 2007 AASM Manual for the Scoring of Sleep and Associated Events. Deliberations of the Sleep Apnea Definitions Task Force of the American Academy of Sleep Medicine. , 2012, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[6]  A. Pack,et al.  Agreement in the Scoring of Respiratory Events Among International Sleep Centers for Home Sleep Testing. , 2016, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[7]  Clete Kushida,et al.  An official ATS/AASM/ACCP/ERS workshop report: Research priorities in ambulatory management of adults with obstructive sleep apnea. , 2011, Proceedings of the American Thoracic Society.

[8]  B. Munro.  Statistical methods for health care research , 1986 .

[9]  G Parati,et al.  The European Sleep Apnoea Database (ESADA): report from 22 European sleep laboratories , 2011, European Respiratory Journal.

[10]  N. Punjabi,et al.  Misclassification of OSA severity with automated scoring of home sleep recordings. , 2015, Chest.

[11]  A. Pack,et al.  Performance of an automated polysomnography scoring system versus computer-assisted manual scoring. , 2013, Sleep.

[12]  N. Douglas,et al.  Evaluation of a portable device for diagnosing the sleep apnoea/hypopnoea syndrome , 2003, European Respiratory Journal.

[13]  Koby Todros,et al.  Assessment of automated scoring of polysomnographic recordings in a population with suspected sleep-disordered breathing. , 2004, Sleep.

[14]  Rui Chen,et al.  CPAP for Prevention of Cardiovascular Events in Obstructive Sleep Apnea. , 2016, The New England journal of medicine.

[15]  A. Chesson,et al.  The American Academy of Sleep Medicine (AASM) Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications , 2007 .

[16]  D. Altman,et al.  Measuring agreement in method comparison studies , 1999, Statistical methods in medical research.

[17]  K. Bloch,et al.  Accuracy of nasal cannula pressure recordings for assessment of ventilation during sleep. , 2001, American journal of respiratory and critical care medicine.

[18]  W. Tsai,et al.  Reproducibility of sonographic measurement of thickness and echogenicity of the plantar fascia , 2012, Journal of clinical ultrasound : JCU.

[19]  W. Flemons,et al.  Home diagnosis of sleep apnea: a systematic review of the literature. An evidence review cosponsored by the American Academy of Sleep Medicine, the American College of Chest Physicians, and the American Thoracic Society. , 2003, Chest.

[20]  D. Navajas,et al.  Relevance of linearizing nasal prongs for assessing hypopneas and flow limitation during sleep. , 2001, American journal of respiratory and critical care medicine.

[21]  Thomas Penzel,et al.  Agreement in the scoring of respiratory events and sleep among international sleep centers. , 2013, Sleep.

[22]  N J Douglas,et al.  Use of home sleep studies for diagnosis of the sleep apnoea/hypopnoea syndrome. , 1997, Thorax.

[23]  J. Montserrat,et al.  Effectiveness of sequential automatic-manual home respiratory polygraphy scoring , 2012, European Respiratory Journal.

[24]  Miguel A Negrín,et al.  Effectiveness of home respiratory polygraphy for the diagnosis of sleep apnoea and hypopnoea syndrome , 2011, Thorax.

[25]  Keshishian Jm,et al.  THE U.S. PUBLIC HEALTH SERVICE TASK FORCE REPORT ON TUBERCULOSIS CONTROL; JOINT STATEMENT BY THE AMERICAN COLLEGE OF CHEST PHYSICIANS AND THE AMERICAN THORACIC SOCIETY. , 1965 .