Narrative synthesis of health service accreditation literature

Aims To systematically identify and synthesise health service accreditation literature. Methods A systematic identification and narrative synthesis of health service accreditation literature published prior to 2012 were conducted. The search identified 122 empirical studies that examined either the processes or impacts of accreditation programmes. Study components were recorded, including: dates of publication; research settings; levels of study evidence and quality using established rating frameworks; and key results. A content analysis was conducted to determine the frequency of key themes and subthemes examined in the literature and identify knowledge-gaps requiring research attention. Results The majority of studies (n=67) were published since 2006, occurred in the USA (n=60) and focused on acute care (n=79). Two thematic categories, that is, ‘organisational impacts’ and ‘relationship to quality measures’, were addressed 60 or more times in the literature. ‘Financial impacts’, ‘consumer or patient satisfaction’ and ‘survey and surveyor issues’ were each examined fewer than 15 times. The literature is limited in terms of the level of evidence and quality of studies, but highlights potential relationships among accreditation programmes, high quality organisational processes and safe clinical care. Conclusions Due to the limitations of the literature, it is not prudent to make strong claims about the effectiveness of health service accreditation. Nonetheless, several critical issues and knowledge-gaps were identified that may help stimulate and inform discussion among healthcare stakeholders. Ongoing effort is required to build upon the accreditation evidence-base by using high quality experimental study designs to examine the processes, effectiveness and financial value of accreditation programmes and their critical components in different healthcare domains.

[1]  Isabelle Devreux,et al.  Comparison of patient safety and quality of care indicators between pre and post accreditation periods in King Abdulaziz University Hospital , 2011 .

[2]  G. Colditz,et al.  How to review the evidence: systematic identification and review of the scientific literature , 2000 .

[3]  S. Cramer,et al.  Stroke care delivery before vs after JCAHO stroke center certification , 2006, Neurology.

[4]  C. Cairns,et al.  An analysis of the Association of Society of Chest Pain Centers Accreditation to American College of Cardiology/American Heart Association non-ST-segment elevation myocardial infarction guideline adherence. , 2009, Annals of Emergency Medicine.

[5]  F. Fesmire,et al.  Chest pain center accreditation is associated with better performance of centers for Medicare and Medicaid services core measures for acute myocardial infarction. , 2008, The American journal of cardiology.

[6]  R. Brugha,et al.  A stakeholder approach towards hospital accreditation in India. , 2001, Health policy and planning.

[7]  A. Alkhenizan,et al.  Impact of Accreditation on the Quality of Healthcare Services: a Systematic Review of the Literature , 2011, Annals of Saudi medicine.

[8]  Harlan M Krumholz,et al.  JCAHO accreditation and quality of care for acute myocardial infarction. , 2003, Health affairs.

[9]  R. Chaplin,et al.  How does an accreditation programme drive improvement on acute inpatient mental health wards? An exploration of members' views , 2010, Journal of Mental Health.

[10]  J. Braithwaite,et al.  What motivates professionals to engage in the accreditation of healthcare organizations? , 2011, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[11]  Mary V. Davis,et al.  Informing the national public health accreditation movement: lessons from North Carolina's accredited local health departments. , 2011, American journal of public health.

[12]  Mary V. Davis,et al.  Incentives to encourage participation in the national public health accreditation model: a systematic investigation. , 2009, American journal of public health.

[13]  Hiroto Ito,et al.  Relationship between accreditation scores and the public disclosure of accreditation reports: a cross sectional study , 2005, Quality and Safety in Health Care.

[14]  M. Geraedts,et al.  Patient experience data in practice accreditation--an international comparison. , 2010, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[15]  Jeffrey Braithwaite,et al.  A prospective, multi-method, multi-disciplinary, multi-level, collaborative, social-organisational design for researching health sector accreditation [LP0560737] , 2006, BMC Health Services Research.

[16]  D. Scanlon,et al.  Health plan accreditation: NCQA, JCAHO, or both? , 1998, Managed care quarterly.

[17]  T M Reynolds,et al.  Is clinical pathology accreditation worth it? A survey of CPA-accredited laboratories. , 2000, Clinical performance and quality health care.

[18]  Upper Midwest,et al.  Pharmacist Staffi ng and the Use of Technology in Small Rural Hospitals: Implications for Medication Safety , 2006 .

[19]  J. Braithwaite,et al.  Developing the evidence base for accreditation of healthcare organisations: a call for transparency and innovation , 2009, Quality & Safety in Health Care.

[20]  B. Everitt,et al.  Statistical methods for rates and proportions , 1973 .

[21]  R. Brand,et al.  Introduction of a quality management system and outcome after hematopoietic stem-cell transplantation. , 2011, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[22]  Jeffrey Braithwaite,et al.  Are accreditation surveys reliable? , 2009, International journal of health care quality assurance.

[23]  François Champagne,et al.  Does accreditation stimulate change? A study of the impact of the accreditation process on Canadian healthcare organizations , 2010, Implementation science : IS.

[24]  K. Hurst The nature and value of small and community hospital accreditation. , 1997, International journal of health care quality assurance incorporating Leadership in health services.

[25]  G. Guyatt,et al.  Users' guides to the medical literature. , 1993, JAMA.

[26]  K. Laserson,et al.  Field experience in implementing ISO 15189 in Kisumu, Kenya. , 2010, American journal of clinical pathology.

[27]  Trisha Greenhalgh,et al.  Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review. , 2005, Social science & medicine.

[28]  L. E. Zayas,et al.  Quality Assurance and Improvement Practice in Mental Health Agencies: Roles, Activities, Targets and Contributions , 2008, Administration and Policy in Mental Health and Mental Health Services Research.

[29]  A practical approach to quality improvement: the experience of the RNZCGP practice standards validation field trial. , 2003, The New Zealand medical journal.

[30]  J. Braithwaite,et al.  Benefits of participating in accreditation surveying. , 2010, International journal of health care quality assurance.

[31]  Nursing practice environment: how does one Australian hospital compare with magnet hospitals? , 2008, International journal of nursing practice.

[32]  Isabelle Devreux,et al.  An overview of patient safety and accreditation: A literature review study , 2011 .

[33]  David J. Miranda,et al.  Hospital Response to Public Reporting of Quality Indicators , 2007, Health care financing review.

[34]  M. Eccles,et al.  Effectiveness of external inspection of compliance with standards in improving healthcare organisation behaviour, healthcare professional behaviour or patient outcomes. , 2011, The Cochrane database of systematic reviews.

[35]  M. Brasure,et al.  Quality oversight: why are rural hospitals less likely to be JCAHO accredited? , 2000, The Journal of rural health : official journal of the American Rural Health Association and the National Rural Health Care Association.

[36]  J. Braithwaite,et al.  Health service accreditation as a predictor of clinical and organisational performance: a blinded, random, stratified study , 2010, Quality and Safety in Health Care.

[37]  A. Bissery,et al.  Comparison of health care professionals’ self-assessments of standards of care and patients’ opinions on the care they received in hospital: observational study , 2004, Quality and Safety in Health Care.

[38]  Steven E. Stemler,et al.  An Overview of Content Analysis. , 2001 .

[39]  A. Contandriopoulos,et al.  Accreditation: a tool for organizational change in hospitals? , 2004, International journal of health care quality assurance incorporating Leadership in health services.

[40]  J. Chriqui,et al.  Does State Certification or Licensure Influence Outpatient Substance Abuse Treatment Program Practices? , 2007, The Journal of Behavioral Health Services & Research.

[41]  P. Bendick,et al.  Reliability of extracranial carotid artery duplex ultrasound scanning: value of vascular laboratory accreditation. , 2004, Journal of vascular surgery.

[42]  Jeffrey Braithwaite,et al.  An empirical test of accreditation patient journey surveys: randomized trial. , 2012, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[43]  H. Pollack,et al.  Changes in methadone treatment practices: results from a national panel study, 1988-2000. , 2002, JAMA.

[44]  S. Burgess “Users’ Guide to the Medical Literature - A Manual for Evidence Based Clinical Practice”. Edited by Gordon Guyatt and Drummond Rennie, 2002, AMA Press, Chicago, 706 pages , 2003 .

[45]  Andrew Georgiou,et al.  Health professional networks as a vector for improving healthcare quality and safety: a systematic review , 2011, BMJ quality & safety.

[46]  Robert J. Stroebel,et al.  Effect of discharge instructions on readmission of hospitalised patients with heart failure: do all of the Joint Commission on Accreditation of Healthcare Organizations heart failure core measures reflect better care? , 2006, Quality and Safety in Health Care.

[47]  D. Longo,et al.  Hospital Patient Safety: Characteristics of Best‐Performing Hospitals , 2007, Journal of healthcare management / American College of Healthcare Executives.

[48]  Jeffrey Braithwaite,et al.  Health sector accreditation research: a systematic review. , 2008, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[49]  E. Lake,et al.  Patient falls: Association with hospital Magnet status and nursing unit staffing. , 2010, Research in nursing & health.

[50]  P. Tavrow,et al.  Implementing a national hospital accreditation program: the Zambian experience. , 2002, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[51]  C. Ko,et al.  Publicly available hospital comparison web sites: determination of useful, valid, and appropriate information for comparing surgical quality. , 2007, Archives of surgery.

[52]  M. Casey,et al.  HMOs serving rural areas: experiences with HMO accreditation and HEDIS reporting. , 2000, Managed care quarterly.

[53]  Jeffrey Braithwaite,et al.  Health care accreditation surveyor styles typology. , 2008, International journal of health care quality assurance.

[54]  F. El-Jardali,et al.  Predictors and outcomes of patient safety culture in hospitals , 2011, BMC health services research.

[55]  Nassera Touati,et al.  Accreditation at a crossroads: are we on the right track? , 2009, Health policy.

[56]  M. Lipsky,et al.  Comparison of US accredited and non-accredited rural critical access hospitals. , 2009, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[57]  Scott C. Williams,et al.  The perceived impact of public reporting hospital performance data: interviews with hospital staff. , 2011, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[58]  J. Alexander,et al.  Do licensing and accreditation matter in outpatient substance abuse treatment programs? , 2007, Journal of substance abuse treatment.

[59]  M. Cerqueira A literature review on the benefits, challenges and trends in accreditation as a quality assurance system , 2006 .

[60]  J. Španjol,et al.  Sunlight and incidence of pterygium on Croatian Island Rab--epidemiological study. , 2007, Collegium antropologicum.

[61]  M. Stasi,et al.  Are Quality Indicators for Radiotherapy Useful in the Evaluation of Service Efficacy in a New Based Radiotherapy Institution? , 2006, Tumori.

[62]  J. Braithwaite,et al.  An empirical test of short notice surveys in two accreditation programmes. , 2012, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[63]  A. Alkhenizan,et al.  Assessment of the accreditation standards of the Central Board for Accreditation of Healthcare Institutions in Saudi Arabia against the principles of the International Society for Quality in Health Care (ISQua) , 2010, Annals of Saudi medicine.

[64]  Steven D. Caldwell,et al.  Influences of context, process and individual differences on nurses' readiness for change to Magnet status. , 2009, Journal of advanced nursing.

[65]  B. Dahn,et al.  Introducing health facility accreditation in Liberia , 2010, Global public health.

[66]  P Deane,et al.  EquIP accreditation: feedback from a Sydney teaching hospital. , 2000, Australian health review : a publication of the Australian Hospital Association.

[67]  F. Strasser,et al.  European Society for Medical Oncology (ESMO) Program for the integration of oncology and Palliative Care: a 5-year review of the Designated Centers' incentive program. , 2010, Annals of oncology : official journal of the European Society for Medical Oncology.

[68]  F. El-Jardali,et al.  Nurses' work environment and intent to leave in Lebanese hospitals: implications for policy and practice. , 2011, International journal of nursing studies.

[69]  N. Menachemi,et al.  Quality of care in accredited and nonaccredited ambulatory surgical centers. , 2008, Joint Commission journal on quality and patient safety.

[70]  Lee Revere,et al.  How Healthcare Organizations Use the Internet to Market Quality Achievements , 2010, Journal of healthcare management / American College of Healthcare Executives.

[71]  Ann S O'Malley,et al.  The impact of quality-reporting programs on hospital operations. , 2006, Health Affairs.

[72]  L. Goldstein,et al.  Outcomes after ischemic stroke for hospitals with and without Joint Commission–certified primary stroke centers , 2011, Neurology.

[73]  B. Schackman,et al.  The quality of highly regarded adolescent substance abuse treatment programs: results of an in-depth national survey. , 2004, Archives of pediatrics & adolescent medicine.

[74]  I. Slaper-Cortenbach,et al.  Current status of JACIE accreditation in Europe: a special report from the Joint Accreditation Committee of the ISCT and the EBMT (JACIE) , 2007, Bone Marrow Transplantation.

[75]  Denys T. Lau,et al.  Potentially inappropriate medication prescriptions among elderly nursing home residents: their scope and associated resident and facility characteristics. , 2004, Health services research.

[76]  K. Jöckel,et al.  Challenging the holy grail of hospital accreditation: A cross sectional study of inpatient satisfaction in the field of cardiology , 2010, BMC health services research.

[77]  A. Epstein,et al.  National Committee on Quality Assurance Health-Plan Accreditation: Predictors, Correlates of Performance, and Market Impact , 2002, Medical care.

[78]  S. Duckett Changing hospitals: the role of hospital accreditation. , 1983, Social science & medicine.

[79]  T. Hadley,et al.  Accreditation, certification, and the quality of care in state hospitals. , 1988, Hospital & community psychiatry.

[80]  P. Tavrow,et al.  The Impact of Accreditation on the Quality of Hospital Care : KwaZulu-Natal Province , Republic of South Africa October 2003 , 2003 .

[81]  D A Rockwell,et al.  The cost of accreditation: one hospital's experience. , 1993, Hospital & community psychiatry.

[82]  David W Bates,et al.  Medication errors observed in 36 health care facilities. , 2002, Archives of internal medicine.

[83]  P. Michel,et al.  Results of the first 100 accreditation procedures in France. , 2003, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[84]  P. Haynes,et al.  A national survey of the effect of sleep medicine specialists and American Academy of Sleep Medicine Accreditation on management of obstructive sleep apnea. , 2006, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[85]  J. Rothschild,et al.  What is the Measure of a Safe Hospital? Medication Errors Missed by Risk Management, Clinical Staff, and Surveyors , 2005, Journal of psychiatric practice.

[86]  A. Peitzman,et al.  Outcome analysis of Pennsylvania trauma centers: factors predictive of nonsurvival in seriously injured patients. , 2001, The Journal of trauma.

[87]  C. Shaw,et al.  A comparative analysis of surveyors from six hospital accreditation programmes and a consideration of the related management issues. , 1998, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[88]  N. Klazinga,et al.  Impact of quality strategies on hospital outputs , 2009, Quality & Safety in Health Care.

[89]  D. Thornlow,et al.  Managing to improve quality: The relationship between accreditation standards, safety practices, and patient outcomes , 2009, Health care management review.

[90]  J. Sprung,et al.  The Impact of the Joint Commission for Accreditation of Healthcare Organizations Pain Initiative on Perioperative Opiate Consumption and Recovery Room Length of Stay , 2005, Anesthesia and analgesia.

[91]  G. Fairbrother,et al.  EQuIP accreditation: feedback from a Sydney teaching hospital. , 2000, Australian health review : a publication of the Australian Hospital Association.

[92]  Albert J Heuer Hospital Accreditation and Patient Satisfaction: Testing the Relationship , 2004, Journal for healthcare quality : official publication of the National Association for Healthcare Quality.

[93]  G. Anderson,et al.  Do quality improvement organizations improve the quality of hospital care for Medicare beneficiaries? , 2005, JAMA.

[94]  T. Thamboo,et al.  Quality indices in a cervicovaginal cytology service: before and after laboratory accreditation. , 2004, Archives of pathology & laboratory medicine.

[95]  M. Hastings,et al.  Assessing quality in nursing home dementia special care units: A pilot test of the joint commission protocol , 2006, The journal of mental health administration.

[96]  J. Henning,et al.  The association between quality improvement activities performed by managed care organizations and quality of care. , 2004, The American journal of medicine.

[97]  M. al Tehewy,et al.  Evaluation of accreditation program in non-governmental organizations' health units in Egypt: short-term outcomes. , 2009, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[98]  Jerod M. Loeb,et al.  Quality of Care in U.S. Hospitals as Reflected by Standardized Measures, 2002-2004 , 2005 .

[99]  M. Titler,et al.  Acute pain assessment and pharmacological management practices for the older adult with a hip fracture: review of ED trends. , 2009, Journal of emergency nursing: JEN : official publication of the Emergency Department Nurses Association.

[100]  C. Sicotte,et al.  Accreditation: a cultural control strategy. , 2008, International journal of health care quality assurance.

[101]  Y. Imanaka,et al.  Impact of hospital accreditation on infection control programs in teaching hospitals in Japan. , 2008, American journal of infection control.

[102]  J. Alexander,et al.  Structural versus Outcomes Measures in Hospitals: A Comparison of Joint Commission and Medicare Outcomes Scores in Hospitals , 2002, Quality management in health care.

[103]  G. Jensen,et al.  The effects of a randomised multi-centre trial and international accreditation on availability and quality of clinical guidelines. , 2005, International journal of health care quality assurance incorporating Leadership in health services.

[104]  S. Campbell,et al.  Primary Medical Care Provider Accreditation (PMCPA): pilot evaluation. , 2010, The British journal of general practice : the journal of the Royal College of General Practitioners.

[105]  T. Greenhalgh How to read a paper: Assessing the methodological quality of published papers , 1997, BMJ.

[106]  J. Alexander,et al.  Factors that influence staffing of outpatient substance abuse treatment programs. , 2005, Psychiatric services.

[107]  Robert M Wachter,et al.  Hospital Performance Trends on National Quality Measures and the Association With Joint Commission Accreditation , 2011, Journal of hospital medicine.

[108]  K. Pongpirul,et al.  Comparison of health care professionals' and surveyors' opinions on problems and obstacles in implementing quality management system in Thailand: A national survey. , 2006, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[109]  Andrew D Oxman,et al.  Users' Guides to the Medical Literature , 2006 .

[110]  Fadi El-Jardali,et al.  The impact of hospital accreditation on quality of care: perception of Lebanese nurses. , 2007, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[111]  N. Tuazon Is Magnet a money‐maker? , 2007, Nursing management.

[112]  K. Jöckel,et al.  Is there an association between hospital accreditation and patient satisfaction with hospital care? A survey of 37,000 patients treated by 73 hospitals. , 2011, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[113]  A. Kirkpatrick,et al.  Relative importance of designation and accreditation of trauma centers during evolution of a regional trauma system. , 2002, The Journal of trauma.

[114]  Jerod M Loeb,et al.  Assessing the reliability of standardized performance indicators. , 2006, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[115]  Sung-il Cho,et al.  National survey of the status of infection surveillance and control programs in acute care hospitals with more than 300 beds in the Republic of Korea. , 2006, American journal of infection control.

[116]  Andrew Murray,et al.  Transformational leadership, transnational culture and political competence in globalizing health care services: a case study of Jordan's King Hussein Cancer Center , 2007, Globalization and health.

[117]  Alain G. Verstraete The attitude of laboratory personnel towards accreditation , 1998, International journal of health care quality assurance incorporating Leadership in health services.

[118]  G. Zarkin,et al.  The Costs of Pursuing Accreditation for Methadone Treatment Sites , 2006, Evaluation review.

[119]  Ebrahim Jaafaripooyan,et al.  Healthcare accreditation systems: further perspectives on performance measures. , 2011, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[120]  Elaine O'connor,et al.  Involving consumers in accreditation: the Irish experience. , 2007, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[121]  A S Detsky,et al.  Users' guides to the medical literature. VII: How to use a clinical decision analysis : a are the results of the study valid ? , 1995 .

[122]  L. Goldstein,et al.  Stroke Patient Outcomes in US Hospitals Before the Start of the Joint Commission Primary Stroke Center Certification Program , 2009, Stroke.

[123]  O. Groene,et al.  Accreditation and ISO certification: do they explain differences in quality management in European hospitals? , 2010, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[124]  R. Pollard,et al.  Organizational and Unit Factors Contributing to Reduction in the Use of Seclusion and Restraint Procedures on an Acute Psychiatric Inpatient Unit , 2007, Psychiatric Quarterly.

[125]  S. Hosford Hospital Progress in Reducing Error: The Impact of External Interventions , 2008, Hospital topics.

[126]  Detsky As,et al.  Users' guides to the medical literature. VII. How to use a clinical decision analysis. A. Are the results of the study valid? Evidence-Based Medicine Working Group. , 1995, JAMA.

[127]  H. Pollack,et al.  Dosage patterns in methadone treatment: results from a national survey, 1988-2005. , 2008, Health services research.

[128]  Scott Zeger,et al.  Relationship Between Performance Measurement and Accreditation: Implications for Quality of Care and Patient Safety , 2005, American journal of medical quality : the official journal of the American College of Medical Quality.