The Spillover Effects of Quality Improvement Beyond Target Populations in Mechanical Ventilation

OBJECTIVES: To assess the impact of a mechanical ventilation quality improvement program on patients who were excluded from the intervention. DESIGN: Before-during-and-after implementation interrupted time series analysis to assess the effect of the intervention between coronary artery bypass grafting (CABG) surgery patients (included) and left-sided valve surgery patients (excluded). SETTING: Academic medical center. PATIENTS: Patients undergoing CABG and left-sided valve procedures were analyzed. INTERVENTIONS: A postoperative mechanical ventilation quality improvement program was developed for patients undergoing CABG. MEASUREMENTS AND MAIN RESULTS: Patients undergoing CABG had a median mechanical ventilation time of 11 hours during P0 (“before” phase) and 6.22 hours during P2 (“after” phase; p < 0.001). A spillover effect was observed because mechanical ventilation times also decreased from 10 hours during P0 to 6 hours during P2 among valve patients who were excluded from the protocol (p < 0.001). The interrupted time series analysis demonstrated a significant level of change for ventilation time from P0 to P2 for both CABG (p < 0.0001) and valve patients (p < 0.0001). There was no significant difference in the slope of change between the CABG and valve patient populations across time cohorts (P0 vs P1 [p = 0.8809]; P1 vs P2 [p = 0.3834]; P0 vs P2 [p = 0.7672]), which suggests that the rate of change in mechanical ventilation times was similar between included and excluded patients. CONCLUSIONS: Decreased mechanical ventilation times for patients who were not included in a protocol suggests a spillover effect of quality improvement and demonstrates that quality improvement can have benefits beyond a target population.

[1]  S. Nicolson,et al.  Spillover of Early Extubation Practices From the Pediatric Heart Network Collaborative Learning Study. , 2020, Pediatric critical care medicine : a journal of the Society of Critical Care Medicine and the World Federation of Pediatric Intensive and Critical Care Societies.

[2]  B. Guthrie,et al.  A balanced approach to identifying, prioritising and evaluating all potential consequences of quality improvement: modified Delphi study , 2019, BMJ Open.

[3]  J. Aldrich,et al.  Interprofessional Care and Teamwork in the ICU , 2018, Critical care medicine.

[4]  B. Guthrie,et al.  Balancing measures or a balanced accounting of improvement impact: a qualitative analysis of individual and focus group interviews with improvement experts in Scotland , 2017, BMJ Quality & Safety.

[5]  M. Banerjee,et al.  Duration of Postoperative Mechanical Ventilation as a Quality Metric for Pediatric Cardiac Surgical Programs. , 2017, The Annals of thoracic surgery.

[6]  Deborah L. Lauseng,et al.  A Systematic Review of the Unintended Consequences of Clinical Interventions to Reduce Adverse Outcomes , 2016, Journal of patient safety.

[7]  E. Haut,et al.  Beneficial "halo effects" of surgical resident performance feedback. , 2016, The Journal of surgical research.

[8]  C. Tan,et al.  Multidisciplinary Extubation Protocol in Cardiac Surgical Patients Reduces Ventilation Time and Length of Stay in the Intensive Care Unit. , 2016, The Annals of thoracic surgery.

[9]  L. Rozmovits,et al.  A qualitative study of the variable effects of audit and feedback in the ICU , 2015, BMJ Quality & Safety.

[10]  Trilochan Tripathy,et al.  Program Evaluation and Spillover Effects , 2010, SSRN Electronic Journal.

[11]  Wei Li,et al.  Ventilator-associated pneumonia after cardiac surgery: a meta-analysis and systematic review. , 2014, The Journal of thoracic and cardiovascular surgery.

[12]  J. Dearani,et al.  Standardized Practice Design With Electronic Support Mechanisms for Surgical Process Improvement: Reducing Mechanical Ventilation Time , 2014, Annals of surgery.

[13]  M. Scholz,et al.  A specialized post-anaesthetic care unit improves fast-track management in cardiac surgery: a prospective randomized trial , 2014, Critical Care.

[14]  D. Maucort-Boulch,et al.  Reduction in the use of diagnostic tests in infants with risk factors for early-onset neonatal sepsis does not delay antibiotic treatment. , 2014, Swiss medical weekly.

[15]  Sean M. O'Brien,et al.  Variation in ventilation time after coronary artery bypass grafting: an analysis from the society of thoracic surgeons adult cardiac surgery database. , 2013, The Annals of thoracic surgery.

[16]  M. Dixon-Woods,et al.  Ten challenges in improving quality in healthcare: lessons from the Health Foundation's programme evaluations and relevant literature , 2012, BMJ quality & safety.

[17]  G. Martin,et al.  Protocols in the management of critical illness , 2011, Critical Care.

[18]  Steen Andreassen,et al.  Improving empirical antibiotic treatment using TREAT, a computerized decision support system: cluster randomized trial. , 2006, The Journal of antimicrobial chemotherapy.

[19]  Michel Wensing,et al.  The relationship between organisational characteristics and the effects of clinical guidelines on medical performance in hospitals, a meta-analysis , 2006, BMC Health Services Research.

[20]  D. Foxcroft,et al.  Early extubation for adult cardiac surgical patients. , 2003, The Cochrane database of systematic reviews.

[21]  F. Battistella,et al.  Protocol weaning of mechanical ventilation in medical and surgical patients by respiratory care practitioners and nurses: effect on weaning time and incidence of ventilator-associated pneumonia. , 2000, Chest.

[22]  R. Allman,et al.  Alabama coronary artery bypass grafting Cooperative Project: baseline data. Alabama CABG Cooperative Project Study Group. , 1999, The Annals of thoracic surgery.

[23]  C. Peniston,et al.  Early Tracheal Extubation after Coronary Artery Bypass Graft Surgery Reduces Costs and Improves Resource Use: A Prospective, Randomized, Controlled Trial , 1996, Anesthesiology.

[24]  G. Randolph,et al.  Improving Culture, One Quality Improvement Project at a Time , 2018, Journal of public health management and practice : JPHMP.

[25]  M. Aldemir,et al.  Predictors of postoperative atrial fibrillation after on-pump coronary artery bypass grafting: is duration of mechanical ventilation time a risk factor? , 2014, Annals of thoracic and cardiovascular surgery : official journal of the Association of Thoracic and Cardiovascular Surgeons of Asia.

[26]  K. Lobdell,et al.  Can timing of tracheal extubation predict improved outcomes after cardiac surgery? , 2009, HSR proceedings in intensive care & cardiovascular anesthesia.