External validation of the APPS, a new and simple outcome prediction score in patients with the acute respiratory distress syndrome

BackgroundA recently developed prediction score based on age, arterial oxygen partial pressure to fractional inspired oxygen ratio (PaO2/FiO2) and plateau pressure (abbreviated as ‘APPS’) was shown to accurately predict mortality in patients diagnosed with the acute respiratory distress syndrome (ARDS). After thorough temporal external validation of the APPS, we tested the spatial external validity in a cohort of ARDS patients recruited during 3 years in two hospitals in the Netherlands.MethodsConsecutive patients with moderate or severe ARDS according to the Berlin definition were included in this observational multicenter cohort study from the mixed medical-surgical ICUs of two university hospitals. The APPS was calculated per patient with the maximal airway pressure instead of the plateau pressure as all patients were ventilated in pressure-controlled mode. The predictive accuracy for hospital mortality was evaluated by calculating the area under the receiver operating characteristics curve (AUC-ROC). Additionally, the score was recalibrated and reassessed.ResultsIn total, 439 patients with moderate or severe ARDS were analyzed. All-cause hospital mortality was 43 %. The APPS predicted all-cause hospital mortality with moderate accuracy, with an AUC-ROC of 0.62 [95 % confidence interval (CI) 0.56–0.67]. Calibration was moderate using the original cutoff values (Hosmer–Lemeshow goodness of fit P < 0.001), and recalibration was performed for the cutoff value for age and plateau pressure. This resulted in good calibration (P = 1.0), but predictive accuracy did not improve (AUC-ROC 0.63, 95 % CI 0.58–0.68).ConclusionsThe predictive accuracy for all-cause hospital mortality of the APPS was moderate, also after recalibration of the score, and thus the APPS does not seem to be fitted for that purpose. The APPS might serve as simple tool for stratification of mortality in patients with moderate or severe ARDS. Without recalibrations, the performance of the APPS was moderate and we should therefore hesitate to blindly apply the score to other cohorts of ARDS patients.

[1]  M. Lamy,et al.  The American-European Consensus Conference on ARDS. Definitions, mechanisms, relevant outcomes, and clinical trial coordination. , 1994, American journal of respiratory and critical care medicine.

[2]  D. Schoenfeld,et al.  Ventilation with lower tidal volumes as compared with traditional tidal volumes for acute lung injury and the acute respiratory distress syndrome. , 2000, The New England journal of medicine.

[3]  M. Schultz,et al.  Prone or PEEP, PEEP and prone , 2010, Intensive Care Medicine.

[4]  Jesús Blanco,et al.  Age, PaO2/FIO2, and Plateau Pressure Score: A Proposal for a Simple Outcome Score in Patients With the Acute Respiratory Distress Syndrome* , 2016, Critical care medicine.

[5]  S. Lemeshow,et al.  A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. , 1993, JAMA.

[6]  Jan O Friedrich,et al.  Pressure-Controlled vs Volume-Controlled Ventilation in Acute Respiratory Failure: A Physiology-Based Narrative and Systematic Review. , 2015, Chest.

[7]  L. Blanch,et al.  Assessment of PaO2/FiO2 for stratification of patients with moderate and severe acute respiratory distress syndrome , 2015, BMJ Open.

[8]  Gordon R. Bernard,et al.  Comparison of two fluid-management strategies in acute lung injury. , 2009 .

[9]  R. Chatburn,et al.  Documentation issues for mechanical ventilation in pressure-control modes. , 2010, Respiratory care.

[10]  J. Vincent,et al.  Multicenter, randomized, controlled trials evaluating mortality in intensive care: Doomed to fail? , 2008, Critical care medicine.

[11]  M. Bonten,et al.  Plasma suPAR as a prognostic biological marker for ICU mortality in ARDS patients , 2015, Intensive Care Medicine.

[12]  N. Obuchowski,et al.  Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures , 2010, Epidemiology.

[13]  A. Ishizaka,et al.  Time to change diagnostic criteria of ARDS: towards the disease entity-based subgrouping. , 2005, Pulmonary pharmacology & therapeutics.

[14]  M. Woodward,et al.  Risk prediction models: II. External validation, model updating, and impact assessment , 2012, Heart.

[15]  R. Bellomo,et al.  Acute renal failure – definition, outcome measures, animal models, fluid therapy and information technology needs: the Second International Consensus Conference of the Acute Dialysis Quality Initiative (ADQI) Group , 2004, Critical care.

[16]  Tracheotomy does not affect reducing sedation requirements of patients in intensive care – a retrospective study , 2006, Critical care.

[17]  Gordon R Bernard,et al.  Comparison of two fluid-management strategies in acute lung injury. , 2006, The New England journal of medicine.

[18]  Arthur S Slutsky,et al.  Acute Respiratory Distress Syndrome The Berlin Definition , 2012 .

[19]  John A Kellum,et al.  Acute Kidney Injury Network: report of an initiative to improve outcomes in acute kidney injury , 2007, Critical care.

[20]  T. Rimmele,et al.  An attempt to validate the modification of the American-European consensus definition of acute lung injury/acute respiratory distress syndrome by the Berlin definition in a university hospital , 2013, Intensive Care Medicine.

[21]  L. Blanch,et al.  Assessment of PaO2/FiO2 for stratification of patients with moderate and severe acute respiratory distress syndrome , 2015, BMJ Open.

[22]  J. McPeake,et al.  Validation and analysis of prognostic scoring systems for critically ill patients with cirrhosis admitted to ICU , 2015, Critical Care.

[23]  E. Draper,et al.  APACHE II: A severity of disease classification system , 1985, Critical care medicine.