A systematic review of hospital accreditation: the challenges of measuring complex intervention effects

BackgroundThe increased international focus on improving patient outcomes, safety and quality of care has led stakeholders, policy makers and healthcare provider organizations to adopt standardized processes for evaluating healthcare organizations. Accreditation and certification have been proposed as interventions to support patient safety and high quality healthcare. Guidelines recommend accreditation but are cautious about the evidence, judged as inconclusive. The push for accreditation continues despite sparse evidence to support its efficiency or effectiveness.MethodsWe searched MEDLINE, EMBASE and The Cochrane Library using Medical Subject Headings (MeSH) indexes and keyword searches in any language. Studies were assessed using the Cochrane Risk of Bias Tool and AMSTAR framework. 915 abstracts were screened and 20 papers were reviewed in full in January 2013. Inclusion criteria included studies addressing the effect of hospital accreditation and certification using systematic reviews, randomized controlled trials, observational studies with a control group, or interrupted time series. Outcomes included both clinical outcomes and process measures. An updated literature search in July 2014 identified no new studies.ResultsThe literature review uncovered three systematic reviews and one randomized controlled trial. The lone study assessed the effects of accreditation on hospital outcomes and reported inconsistent results. Excluded studies were reviewed and their findings summarized.ConclusionAccreditation continues to grow internationally but due to scant evidence, no conclusions could be reached to support its effectiveness. Our review did not find evidence to support accreditation and certification of hospitals being linked to measurable changes in quality of care as measured by quality metrics and standards. Most studies did not report intervention context, implementation, or cost. This might reflect the challenges in assessing complex, heterogeneous interventions such as accreditation and certification. It is also may be magnified by the impact of how accreditation is managed and executed, and the varied financial and organizational healthcare constraints. The strategies hospitals should impelment to improve patient safety and organizational outcomes related to accreditation and certification components remains unclear.

[1]  David Moher,et al.  Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews , 2007, BMC medical research methodology.

[2]  P. Tavrow,et al.  The Impact of Accreditation on the Quality of Hospital Care : KwaZulu-Natal Province , Republic of South Africa October 2003 , 2003 .

[3]  Isabelle Devreux,et al.  Benchmarking the post-accreditation patient safety culture at King Abdulaziz University Hospital , 2012, Annals of Saudi medicine.

[4]  Harlan M Krumholz,et al.  JCAHO accreditation and quality of care for acute myocardial infarction. , 2003, Health affairs.

[5]  Ellie Scrivens,et al.  Assessing the value of accreditation systems , 1997 .

[6]  D A Rockwell,et al.  The cost of accreditation: one hospital's experience. , 1993, Hospital & community psychiatry.

[7]  M. Eccles,et al.  Effectiveness of external inspection of compliance with standards in improving healthcare organisation behaviour, healthcare professional behaviour or patient outcomes. , 2011, The Cochrane database of systematic reviews.

[8]  C. Shaw,et al.  Health service accreditation: report of a pilot programme for community hospitals , 1995, BMJ.

[9]  Jacobus Pfisterer,et al.  Variations in institutional infrastructure, physician specialization and experience, and outcome in ovarian cancer: a systematic review. , 2009, Gynecologic oncology.

[10]  D. Altman,et al.  Assessing Risk of Bias in Included Studies , 2008 .

[11]  E. Neugebauer,et al.  [Quality management in acute pain therapy: results from a survey of certified hospitals]. , 2012, Schmerz.

[12]  Isabelle Devreux,et al.  An overview of patient safety and accreditation: A literature review study , 2011 .

[13]  Craig R Ramsay,et al.  INTERRUPTED TIME SERIES DESIGNS IN HEALTH TECHNOLOGY ASSESSMENT: LESSONS FROM TWO SYSTEMATIC REVIEWS OF BEHAVIOR CHANGE STRATEGIES , 2003, International Journal of Technology Assessment in Health Care.

[14]  M. Lipsky,et al.  Comparison of US accredited and non-accredited rural critical access hospitals. , 2009, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[15]  Robert M Wachter,et al.  Hospital Performance Trends on National Quality Measures and the Association With Joint Commission Accreditation , 2011, Journal of hospital medicine.

[16]  Jeffrey Braithwaite,et al.  Health sector accreditation research: a systematic review. , 2008, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[17]  A FRAMEWORK FOR DEVELOPMENT AND EVALUATION OF RCTs FOR COMPLEX INTERVENTIONS TO IMPROVE HEALTH , 2000 .

[18]  J. Øvretveit,et al.  Using research to inform quality programmes , 2003, BMJ : British Medical Journal.

[19]  Isabelle Devreux,et al.  Comparison of patient safety and quality of care indicators between pre and post accreditation periods in King Abdulaziz University Hospital , 2011 .

[20]  K. Inder,et al.  An effectiveness analysis of healthcare systems using a systems theoretic approach , 2009, BMC health services research.

[21]  Ernest Baskin,et al.  SWOT Analysis , 2023 .

[22]  B. Cowling,et al.  Factors affecting implementation of accreditation programmes and the impact of the accreditation process on quality improvement in hospitals: a SWOT analysis. , 2013, Hong Kong medical journal = Xianggang yi xue za zhi.

[23]  A. Alkhenizan,et al.  The attitude of health care professionals towards accreditation: A systematic review of the literature , 2012, Journal of family & community medicine.

[24]  Valentina Gokenbach,et al.  The outcomes of Magnet environments and nursing staff engagement: a case study. , 2011, The Nursing clinics of North America.

[25]  S. Grepperud Is the hospital decision to seek accreditation an effective one? , 2015, The International journal of health planning and management.

[26]  D Gustafson,et al.  Evaluation of quality improvement programmes , 2002, Quality & safety in health care.

[27]  Cordula Wagner,et al.  The effect of certification and accreditation on quality management in 4 clinical services in 73 European hospitals , 2014, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[28]  Michele Tarsilla Cochrane Handbook for Systematic Reviews of Interventions , 2010, Journal of MultiDisciplinary Evaluation.

[29]  S. Hohmann,et al.  Outcomes of bariatric surgery performed at accredited vs nonaccredited centers. , 2012, Journal of the American College of Surgeons.

[30]  Jeffrey Braithwaite,et al.  Narrative synthesis of health service accreditation literature , 2012, BMJ quality & safety.

[31]  S. Köpke,et al.  Systematic reviews of case management: Too complex to manage? , 2015, The Cochrane database of systematic reviews.

[32]  John Øvretveit,et al.  Does improving quality save money? A review of evidence of which improvements to quality reduce costs to health service providers , 2009 .

[33]  L. Goldstein,et al.  Outcomes after ischemic stroke for hospitals with and without Joint Commission–certified primary stroke centers , 2011, Neurology.

[34]  Aziz Sheikh,et al.  Can We Systematically Review Studies That Evaluate Complex Interventions? , 2009, PLoS medicine.

[35]  Jeffrey Braithwaite,et al.  Evaluation of current Australian health service accreditation processes (ACCREDIT-CAP): protocol for a mixed-method research project , 2012, BMJ Open.

[36]  Cheng Cheng Tan,et al.  Management of severe sepsis in patients admitted to Asian intensive care units: prospective cohort study , 2011, BMJ : British Medical Journal.

[37]  Harm W.J. van Marwijk,et al.  A SWOT analysis , 2004 .

[38]  M. Ho,et al.  Effects of Hospital Accreditation on Medical Students: A National Qualitative Study in Taiwan , 2014, Academic medicine : journal of the Association of American Medical Colleges.

[39]  J. W. Salmon,et al.  Accrediting organizations and quality improvement. , 2000, The American journal of managed care.

[40]  N. Menachemi,et al.  Quality of care in accredited and nonaccredited ambulatory surgical centers. , 2008, Joint Commission journal on quality and patient safety.

[41]  A. Alkhenizan,et al.  Impact of Accreditation on the Quality of Healthcare Services: a Systematic Review of the Literature , 2011, Annals of Saudi medicine.

[42]  Jeffrey Braithwaite,et al.  A prospective, multi-method, multi-disciplinary, multi-level, collaborative, social-organisational design for researching health sector accreditation [LP0560737] , 2006, BMC Health Services Research.

[43]  M. al Tehewy,et al.  Evaluation of accreditation program in non-governmental organizations' health units in Egypt: short-term outcomes. , 2009, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[44]  L. Goldstein,et al.  Stroke Patient Outcomes in US Hospitals Before the Start of the Joint Commission Primary Stroke Center Certification Program , 2009, Stroke.

[45]  O. Groene,et al.  Accreditation and ISO certification: do they explain differences in quality management in European hospitals? , 2010, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[46]  C. Shaw Evaluating accreditation. , 2003, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[47]  J. Braithwaite,et al.  Developing the evidence base for accreditation of healthcare organisations: a call for transparency and innovation , 2009, Quality & Safety in Health Care.