Process evaluation of a tailored multifaceted feedback program to improve the quality of intensive care by using quality indicators

Background In multisite trials evaluating a complex quality improvement (QI) strategy the ‘same’ intervention may be implemented and adopted in different ways. Therefore, in this study we investigated the exposure to and experiences with a multifaceted intervention aimed at improving the quality of intensive care, and explore potential explanations for why the intervention was effective or not. Methods We conducted a process evaluation investigating the effect of a multifaceted improvement intervention including establishment of a local multidisciplinary QI team, educational outreach visits and periodical indicator feedback on performance measures such as intensive care unit length of stay, mechanical ventilation duration and glucose regulation. Data were collected among participants receiving the intervention. We used standardised forms to record time investment and a questionnaire and focus group to collect data on perceived barriers and satisfaction. Results The monthly time invested per QI team member ranged from 0.6 to 8.1 h. Persistent problems were: not sharing feedback with other staff; lack of normative standards and benchmarks; inadequate case-mix adjustment; lack of knowledge on how to apply the intervention for QI; and insufficient allocated time and staff. The intervention effectively targeted the lack of trust in data quality, and was reported to motivate participants to use indicators for QI activities. Conclusions Time and resource constraints, difficulties to translate feedback into effective actions and insufficient involvement of other staff members hampered the impact of the intervention. However, our study suggests that a multifaceted feedback program stimulates clinicians to use indicators as input for QI, and is a promising first step to integrating systematic QI in daily care.

[1]  N. D. de Keizer,et al.  Effect of a Multifaceted Performance Feedback Strategy on Length of Stay Compared With Benchmark Reports Alone: A Cluster Randomized Trial in Intensive Care* , 2013, Critical care medicine.

[2]  Jane M. Young,et al.  Audit and feedback: effects on professional practice and healthcare outcomes. , 2012, The Cochrane database of systematic reviews.

[3]  N. D. de Keizer,et al.  Translating knowledge on best practice into improving quality of RRT care: a systematic review of implementation strategies. , 2011, Kidney international.

[4]  N. D. de Keizer,et al.  Evaluating the effectiveness of a tailored multifaceted performance feedback intervention to improve the quality of care: protocol for a cluster randomized trial in intensive care , 2011, Implementation science : IS.

[5]  Nick Goodwin,et al.  Improving quality of care , 2022, Pathy's Principles and Practice of Geriatric Medicine.

[6]  Peter J Pronovost,et al.  Analysis & commentary: A road map for improving the performance of performance measures. , 2011, Health affairs.

[7]  Stephanie J. C. Taylor,et al.  The OPERA trial: a protocol for the process evaluation of a randomised trial of an exercise intervention for older people in residential and nursing accommodation , 2011, Trials.

[8]  Heather C Kaplan,et al.  The influence of context on quality improvement success in health care: a systematic review of the literature. , 2010, The Milbank quarterly.

[9]  Sophie Hill,et al.  Taking healthcare interventions from trial to practice , 2010, BMJ : British Medical Journal.

[10]  Robert M Wachter,et al.  Accountability measures--using measurement to promote quality improvement. , 2010, The New England journal of medicine.

[11]  J. Roski,et al.  Current Efforts of Regional and National Performance Measurement Initiatives Around the United States , 2010, American journal of medical quality : the official journal of the American College of Medical Quality.

[12]  N. D. de Keizer,et al.  Implementing quality indicators in intensive care units: exploring barriers to and facilitators of behaviour change , 2010, Implementation science : IS.

[13]  Nicolette de Keizer,et al.  Improving quality of care. A systematic review on how medical registries provide information feedback to health care providers , 2010, Int. J. Medical Informatics.

[14]  Bert Meijboom,et al.  Using quality indicators to improve hospital care: a review of the literature. , 2009, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[15]  Stephane Heritier,et al.  Intensive versus conventional glucose control in critically ill patients. , 2009, The New England journal of medicine.

[16]  Anke J. E. de Veer,et al.  Factors influencing the implementation of clinical guidelines for health care professionals: A systematic meta-review , 2008, BMC Medical Informatics Decis. Mak..

[17]  Anne Frølich,et al.  An international review of projects on hospital performance assessment. , 2008, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[18]  G. Westert,et al.  Quality measurement at intensive care units: which indicators should we use? , 2007, Journal of critical care.

[19]  Marije Bosch,et al.  Tailoring quality improvement interventions to identified barriers: a multiple case analysis. , 2007, Journal of evaluation in clinical practice.

[20]  Rosemary K. Rushmer,et al.  Healthcare professionals’ views on clinician engagement in quality improvement , 2007 .

[21]  Frank Lawrence,et al.  Recognizing Delirium Superimposed on Dementia , 2008 .

[22]  J. Cosby,et al.  Resilience Engineering: Concepts and Precepts , 2006, Quality and Safety in Health Care.

[23]  Jacqueline A Pugh,et al.  Audit and feedback and clinical practice guideline adherence: Making feedback actionable , 2006, Implementation science : IS.

[24]  Elizabeth Allen,et al.  Process evaluation in randomised controlled trials of complex interventions , 2006, BMJ : British Medical Journal.

[25]  M. Berg,et al.  Feasibility first: developing public performance indicators on patient safety and clinical effectiveness for Dutch hospitals. , 2005, Health policy.

[26]  Richard Lilford,et al.  Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma , 2004, The Lancet.

[27]  T. Paulussen,et al.  Determinants of innovation within health care organizations: literature review and Delphi study. , 2004, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[28]  M. Laurant,et al.  Process evaluation on quality improvement interventions , 2003, Quality & safety in health care.

[29]  E. A. Locke,et al.  Building a practically useful theory of goal setting and task motivation. A 35-year odyssey. , 2002, The American psychologist.

[30]  C. Pope,et al.  Qualitative methods in research on healthcare quality , 2002, Quality & safety in health care.

[31]  Tim Freeman,et al.  Using performance indicators to improve health care quality in the public sector: a review of the literature , 2002, Health services management research.

[32]  M Schetz,et al.  Intensive insulin therapy in critically ill patients. , 2001, The New England journal of medicine.

[33]  H. Krumholz,et al.  A qualitative study of increasing beta-blocker use after myocardial infarction: Why do some hospitals succeed? , 2001, JAMA.

[34]  T. Walley,et al.  Why do GPs not implement evidence-based guidelines? A descriptive study. , 2001, Family practice.

[35]  J J Allison,et al.  Improving quality improvement using achievable benchmarks for physician feedback: a randomized controlled trial. , 2001, JAMA.

[36]  H. Krumholz,et al.  A Qualitative Study of Increasing β-Blocker Use After Myocardial Infarction: Why Do Some Hospitals Succeed? , 2001 .

[37]  P. Plsek Quality improvement methods in clinical medicine. , 1999, Pediatrics.

[38]  R. Grol,et al.  Single and combined strategies for implementing changes in primary care: a literature review. , 1994, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[39]  S B Soumerai,et al.  Principles of educational outreach ('academic detailing') to improve clinical decision making. , 1990, JAMA.

[40]  M. Eccles,et al.  Improving patient care , 2013 .

[41]  M. Vos Effective use of quality indicators in intensive care , 2012 .

[42]  M. Rantz,et al.  Nursing home staff's views on quality improvement interventions: a follow-up study. , 2007, Journal of gerontological nursing.

[43]  S. Flottorp,et al.  Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. , 2005, The Cochrane database of systematic reviews.

[44]  B. Bistrian,et al.  Intensive insulin therapy in critically ill patients. , 2002, The New England journal of medicine.

[45]  Andrew V. Dane,et al.  Program integrity in primary and early secondary prevention: are implementation effects out of control? , 1998, Clinical psychology review.