Development of actionable quality indicators and an action implementation toolbox for appropriate antibiotic use at intensive care units: A modified-RAND Delphi study

Introduction Extensive antibiotic use makes the intensive care unit (ICU) an important focus for antibiotic stewardship programs. The aim of this study was to develop a set of actionable quality indicators for appropriate antibiotic use at ICUs and an implementation toolbox, which can be used to assess and improve the appropriateness of antibiotic use in the treatment of adult patients at an ICU. Methods A four round modified-RAND Delphi procedure was used. Potential indicators were identified by a multidisciplinary panel of 15 Dutch experts, from international literature and guidelines. Using an online survey, the identified indicators were rated on three criteria: relevance, actionability and feasibility. Experts discussed and rated the indicators for the second time during a face-to-face consensus meeting. During a final consensus meeting the toolbox was developed, containing potential barriers and improvement strategies which were identified using a validated checklist by Flottorp et al., and if available also containing supporting material. Results The first round resulted in 24 potential indicators. After the final meeting a set of three process indicators, one structure indicator and one quantity metric remained: 1) perform at least two sets of blood cultures before start of empirical systemic therapy; 2) perform therapeutic drug monitoring in patients treated with vancomycin or aminoglycosides; 3) perform surveillance cultures if selective digestive or oropharyngeal decontamination is applied at the ICU; 4) biannual face-to-face meetings between ICU and microbiology staff in which local resistance rates are discussed; and 5) quantitative antibiotic use at the ICU expressed in days of therapy (DOT). The toolbox contains 24 unique barriers and 37 improvement strategies. Conclusions Our study identified a set of four actionable quality indicators and one quantity metric, together with an implementation toolbox, to improve appropriate antibiotic use at ICUs.

[1]  M. Hulscher,et al.  Antibiotic stewardship: does it work in hospital practice? A review of the evidence base. , 2017, Clinical microbiology and infection : the official publication of the European Society of Clinical Microbiology and Infectious Diseases.

[2]  N. D. de Keizer,et al.  Electronic audit and feedback intervention with action implementation toolbox to improve pain management in intensive care: protocol for a laboratory experiment and cluster randomised trial , 2017, Implementation Science.

[3]  Monique W. M. Jaspers,et al.  Effect of a web-based audit and feedback intervention with outreach visits on the clinical performance of multidisciplinary teams: a cluster-randomized trial in cardiac rehabilitation , 2016, Implementation Science.

[4]  J. Prins,et al.  Applicability of generic quality indicators for appropriate antibiotic use in daily hospital practice: a cross-sectional point-prevalence multicenter study. , 2016, Clinical microbiology and infection : the official publication of the European Society of Clinical Microbiology and Infectious Diseases.

[5]  Jeremy M. Grimshaw,et al.  Practice Feedback Interventions: 15 Suggestions for Optimizing Effectiveness , 2016, Annals of Internal Medicine.

[6]  N. D. de Keizer,et al.  Data Resource Profile: the Dutch National Intensive Care Evaluation (NICE) Registry of Admissions to Adult Intensive Care Units. , 2015, International journal of epidemiology.

[7]  S. Geerlings,et al.  Quality indicators to measure appropriate antibiotic use in hospitalized adults. , 2015, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[8]  S. Geerlings,et al.  Development of quality indicators for antimicrobial treatment in adults with sepsis , 2014, BMC Infectious Diseases.

[9]  S. Geerlings,et al.  Appropriate antibiotic use for patients with urinary tract infections reduces length of hospital stay. , 2014, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[10]  Richard Baker,et al.  A checklist for identifying determinants of practice: A systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice , 2013, Implementation Science.

[11]  Nicolette F de Keizer,et al.  Process evaluation of a tailored multifaceted feedback program to improve the quality of intensive care by using quality indicators , 2013, BMJ quality & safety.

[12]  Jane M. Young,et al.  Audit and feedback: effects on professional practice and healthcare outcomes. , 2012, The Cochrane database of systematic reviews.

[13]  M. Scherer,et al.  Methods for the guideline-based development of quality indicators--a systematic review , 2012, Implementation Science.

[14]  J. Grimshaw,et al.  Tailored implementation for chronic diseases (TICD): A project protocol , 2011, Implementation science : IS.

[15]  J. Bartlett,et al.  A call to arms: the imperative for antimicrobial stewardship. , 2011, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[16]  Nicolette de Keizer,et al.  Modified Rand Method to Derive Quality Indicators: a Case Study in Cardiac Rehabilitation , 2011, MIE.

[17]  R. Grol,et al.  Antibiotic prescribing in hospitals: a social and behavioural scientific approach. , 2010, The Lancet. Infectious diseases.

[18]  Jordi Rello,et al.  International study of the prevalence and outcomes of infection in intensive care units. , 2009, JAMA.

[19]  Jay Steingrub,et al.  International study of the prevalence and outcomes of infection in intensive care units , 2009 .

[20]  S. Geerlings,et al.  Development of quality indicators for the antibiotic treatment of complicated urinary tract infections: a first step to measure and improve care. , 2008, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[21]  G. Westert,et al.  Quality measurement at intensive care units: which indicators should we use? , 2007, Journal of critical care.

[22]  P. Pronovost,et al.  Developing quality measures for sepsis care in the ICU. , 2007, Joint Commission journal on quality and patient safety.

[23]  Robert Steele,et al.  Implementation of a bundle of quality indicators for the early management of severe sepsis and septic shock is associated with decreased mortality* , 2007, Critical care medicine.

[24]  R. Polk,et al.  Measurement of adult antibacterial drug use in 130 US hospitals: comparison of defined daily dose and days of therapy. , 2007, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[25]  Jeremy Hurst,et al.  Health Care Quality Indicators Project Conceptual Framework Paper , 2006 .

[26]  R. Grol,et al.  Quality of antibiotic use for lower respiratory tract infections at hospitals: (how) can we measure it? , 2005, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[27]  S. Flottorp,et al.  Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. , 2005, The Cochrane database of systematic reviews.

[28]  S. Lemon,et al.  A Public Health Action Plan to Combat Antimicrobial Resistance , 2003 .

[29]  B. Burnand,et al.  The RAND/UCLA Appropriateness Method User's Manual , 2001 .