Implementation of Departmental Quality Strategies Is Positively Associated with Clinical Practice: Results of a Multicenter Study in 73 Hospitals in 7 European Countries

Background Given the amount of time and resources invested in implementing quality programs in hospitals, few studies have investigated their clinical impact and what strategies could be recommended to enhance its effectiveness. Objective To assess variations in clinical practice and explore associations with hospital- and department-level quality management systems. Design Multicenter, multilevel cross-sectional study. Setting and Participants Seventy-three acute care hospitals with 276 departments managing acute myocardial infarction, deliveries, hip fracture, and stroke in seven countries. Intervention None. Measures Predictor variables included 3 hospital- and 4 department-level quality measures. Six measures were collected through direct observation by an external surveyor and one was assessed through a questionnaire completed by hospital quality managers. Dependent variables included 24 clinical practice indicators based on case note reviews covering the 4 conditions (acute myocardial infarction, deliveries, hip fracture and stroke). A directed acyclic graph was used to encode relationships between predictors, outcomes, and covariates and to guide the choice of covariates to control for confounding. Results and Limitations Data were provided on 9021 clinical records by 276 departments in 73 hospitals. There were substantial variations in compliance with the 24 clinical practice indicators. Weak associations were observed between hospital quality systems and 4 of the 24 indicators, but on analyzing department-level quality systems, strong associations were observed for 8 of the 11 indicators for acute myocardial infarction and stroke. Clinical indicators supported by higher levels of evidence were more frequently associated with quality systems and activities. Conclusions There are significant gaps between recommended standards of care and clinical practice in a large sample of hospitals. Implementation of department-level quality strategies was significantly associated with good clinical practice. Further research should aim to develop clinically relevant quality standards for hospital departments, which appear to be more effective than generic hospital-wide quality systems.

[1]  O. Arah,et al.  Selection bias modeling using observed data augmented with imputed record-level probabilities. , 2014, Annals of epidemiology.

[2]  María Andrée López,et al.  Deepening our understanding of quality improvement in Europe (DUQuE): overview of a study of hospital quality management in seven countries , 2014, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[3]  C. Wagner,et al.  The use of on-site visits to assess compliance and implementation of quality management at hospital level , 2014, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[4]  R. Mannion,et al.  Development and validation of an index to assess hospital quality management systems , 2014, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[5]  R. Mannion,et al.  A checklist for patient safety rounds at the care pathway level , 2014, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[6]  R. Mannion,et al.  DUQuE quality management measures: associations between quality management at hospital and pathway levels , 2014, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[7]  R. Mannion,et al.  Evidence-based organization and patient safety strategies in European hospitals , 2014, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[8]  Cordula Wagner,et al.  A systematic review of instruments that assess the implementation of hospital quality management systems. , 2013, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[9]  Tor Iversen,et al.  Health care performance comparison using a disease-based approach: the EuroHOPE project. , 2013, Health policy.

[10]  A. Goto,et al.  Severe hypoglycaemia and cardiovascular disease: systematic review and meta-analysis with bias analysis , 2013, BMJ.

[11]  Paresh Dawda,et al.  CareTrack: assessing the appropriateness of health care delivery in Australia. , 2012, The Medical journal of Australia.

[12]  Jeffrey Braithwaite,et al.  CareTrack: assessing the appropriateness of health care delivery in Australia , 2012, The Medical journal of Australia.

[13]  J. Alexander,et al.  The Science of Quality Improvement Implementation: Developing Capacity to Make a Difference , 2011, Medical care.

[14]  Onyebuchi A Arah,et al.  Bias Formulas for Sensitivity Analysis of Unmeasured Confounding for General Outcomes, Treatments, and Confounders , 2011, Epidemiology.

[15]  C. Wagner,et al.  Investigating organizational quality improvement systems, patient empowerment, organizational culture, professional involvement and the quality of care in European hospitals: the 'Deepening our Understanding of Quality Improvement in Europe (DUQuE)' project , 2010, BMC health services research.

[16]  L. Vos,et al.  Longitudinal analysis on the development of hospital quality management systems in the Netherlands. , 2009, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[17]  Wei Huang,et al.  The expanded Global Registry of Acute Coronary Events: baseline characteristics, management practices, and hospital outcomes of patients with acute coronary syndromes. , 2009, American heart journal.

[18]  Cordula Wagner,et al.  Quality management and patient safety: survey results from 102 Hungarian hospitals. , 2009, Health policy.

[19]  A. Thompson,et al.  Impact of quality strategies on hospital outputs , 2009, Quality & Safety in Health Care.

[20]  Anke J. E. de Veer,et al.  Factors influencing the implementation of clinical guidelines for health care professionals: A systematic meta-review , 2008, BMC Medical Informatics Decis. Mak..

[21]  Sander Greenland,et al.  Bias formulas for external adjustment and sensitivity analysis of unmeasured confounders. , 2008, Annals of epidemiology.

[22]  Jennifer E. Drake,et al.  A Survey of Hospital Quality Improvement Activities , 2008, Medical care research and review : MCRR.

[23]  J. Alexander,et al.  Review: How Do Hospital Organizational Structure and Processes Affect Quality of Care? , 2008, Medical care research and review : MCRR.

[24]  Jeffrey Braithwaite,et al.  Health sector accreditation research: a systematic review. , 2008, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[25]  O. Arah.  The role of causal reasoning in understanding Simpson's paradox, Lord's paradox, and the suppression effect: covariate selection in the analysis of observational studies , 2008, Emerging themes in epidemiology.

[26]  M. Macinati,et al.  The relationship between quality management systems and organizational performance in the Italian National Health Service. , 2008, Health policy.

[27]  Ragnar Westerling,et al.  The structure of quality systems is important to the process and outcome, an empirical study of 386 hospital departments in Sweden , 2007, BMC Health Services Research.

[28]  P Barach,et al.  Understanding the complexity of redesigning care around the clinical microsystem , 2006, Quality and Safety in Health Care.

[29]  Bryan J Weiner,et al.  Quality improvement implementation and hospital performance on quality indicators. , 2006, Health services research.

[30]  L. Baker,et al.  Quality Improvement Implementation and Hospital Performance on Patient Safety Indicators , 2006, Medical care research and review : MCRR.

[31]  Luke Vale,et al.  Toward evidence-based quality improvement. Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966-1998. , 2006, Journal of general internal medicine.

[32]  Luke Vale,et al.  Toward evidence-based quality improvement , 2006 .

[33]  P. Basch.  Quality of health care delivered to adults in the United States. , 2003, The New England journal of medicine.

[34]  S. Hohnloser,et al.  T-wave alternans negative coronary patients with low ejection and benefit from defibrillator implantation , 2003, The Lancet.

[35]  David Wennberg,et al.  The Implications of Regional Variations in Medicare Spending. Part 1: The Content, Quality, and Accessibility of Care , 2003, Annals of Internal Medicine.

[36]  David Wennberg,et al.  The Implications of Regional Variations in Medicare Spending. Part 2: Health Outcomes and Satisfaction with Care , 2003, Annals of Internal Medicine.

[37]  Donald M. Berwick,et al.  Connections Between Quality Measurement and Improvement , 2003, Medical care.

[38]  J J Mohr,et al.  Improving safety on the front lines: the role of clinical microsystems , 2002, Quality & safety in health care.

[39]  P. Groenewegen,et al.  A measuring instrument for evaluation of quality systems. , 1999, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[40]  S. Shortell,et al.  Assessing the impact of continuous quality improvement on clinical practice: what it will take to accelerate progress. , 1998, The Milbank quarterly.

[41]  J J Mohr,et al.  Improving health care, Part 1: The clinical value compass. , 1996, The Joint Commission journal on quality improvement.

[42]  José Maria Paganni,et al.  Evaluating the quality of medical care. , 1966, The Milbank Memorial Fund quarterly.

[43]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[44]  A. Donabedian.  Evaluating the quality of medical care. 1966. , 2005, The Milbank quarterly.

[45]  J. Pearl,et al.  Causal diagrams for epidemiologic research. , 1999, Epidemiology.

[46]  G. Shaw,et al.  Maternal pesticide exposure from multiple sources and selected congenital anomalies. , 1999 .

[47]  T. Rickards.  Sense making in organizations , 1997 .

[48]  Causality : Models , Reasoning , and Inference , 2022 .

[49]  R. Grol,et al.  For Personal Use. Only Reproduce with Permission from the Lancet Publishing Group. from Best Evidence to Best Practice: Effective Implementation of Change in Patients' Care , 2022 .