Factors predicting change in hospital safety climate and capability in a multi-site patient safety collaborative: a longitudinal survey study

Objective The study had two specific objectives: (1) To analyse change in a survey measure of organisational patient safety climate and capability (SCC) resulting from participation in the UK Safer Patients Initiative and (2) To investigate the role of a range of programme and contextual factors in predicting change in SCC scores. Design Single group longitudinal design with repeated measurement at 12-month follow-up. Setting Multiple service areas within NHS hospital sites across England, Wales, Scotland and Northern Ireland. Participants Stratified sample of 284 respondents representing programme teams at 19 hospital sites. Intervention A complex intervention comprising a multi-component quality improvement collaborative focused upon patient safety and designed to impact upon hospital leadership, communication, organisation and safety climate. Measures A survey including a 31-item SCC scale was administered at two time-points. Results Modest but significant positive movement in SCC score was observed between the study time-points. Individual programme responsibility, availability of early adopters, multi-professional collaboration and extent of process measurement were significant predictors of change in SCC. Hospital type and size, along with a range of programme preconditions, were not found to be significant. Conclusion A range of social, cultural and organisational factors may be sensitive to this type of intervention but the measurable effect is small. Supporting critical local programme implementation factors may be an effective strategy in achieving development in organisational patient SCC, regardless of contextual factors and organisational preconditions.

[1]  C. Vincent,et al.  The disparity of frontline clinical staff and managers' perceptions of a quality and patient safety initiative. , 2011, Journal of evaluation in clinical practice.

[2]  P. Pronovost,et al.  What context features might be important determinants of the effectiveness of patient safety practice interventions? , 2011, Quality and Safety in Health Care.

[3]  P. Pronovost,et al.  How does context affect interventions to improve patient safety? An assessment of evidence from studies of five patient safety practices and proposals for research , 2011, Quality and Safety in Health Care.

[4]  C. Vincent,et al.  Predictors of the perceived impact of a patient safety collaborative: an exploratory study. , 2011, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[5]  M. Dixon-Woods,et al.  Large scale organisational intervention to improve patient safety in four UK hospitals: mixed method evaluation , 2011, BMJ : British Medical Journal.

[6]  M. Dixon-Woods,et al.  Multiple component patient safety intervention in English hospitals: controlled evaluation of second phase , 2011, BMJ : British Medical Journal.

[7]  C. Vincent,et al.  Improving reliability of clinical care practices for ventilated patients in the context of a patient safety improvement initiative. , 2011, Journal of evaluation in clinical practice.

[8]  R. Wachter,et al.  Improving safety culture on adult medical units through multidisciplinary teamwork and communication interventions: the TOPS Project , 2010, Quality and Safety in Health Care.

[9]  Anam Parand,et al.  Medical engagement in organisation-wide safety and quality-improvement programmes: experience in the UK Safer Patients Initiative , 2010, Quality and Safety in Health Care.

[10]  W. Berta,et al.  The relationship between organizational leadership for safety and learning from patient safety events. , 2010, Health services research.

[11]  C. Vincent,et al.  Organisational readiness: exploring the preconditions for success in organisation-wide patient safety improvement programmes , 2010, Quality and Safety in Health Care.

[12]  Peter J Pronovost,et al.  Sustaining reductions in catheter related bloodstream infections in Michigan intensive care units: observational study , 2010, BMJ : British Medical Journal.

[13]  M Dixon-Woods,et al.  How will it work? A qualitative study of strategic stakeholders' accounts of a patient safety initiative , 2010, Quality and Safety in Health Care.

[14]  F. Davidoff.  Heterogeneity is not always noise: lessons from improvement. , 2009, JAMA.

[15]  Anam Parand,et al.  Studying large-scale programmes to improve patient safety in whole care systems: challenges for research. , 2009, Social science & medicine.

[16]  P. Groenewegen,et al.  Exploring the black box of quality improvement collaboratives: modelling relations between conditions, applied changes and outcomes , 2009, Implementation science : IS.

[17]  B. Weiner,et al.  A theory of organizational readiness for change , 2009, Implementation science : IS.

[18]  C. Vincent,et al.  Perceptions of the impact of a large-scale collaborative improvement programme: experience in the UK Safer Patients Initiative. , 2009, Journal of evaluation in clinical practice.

[19]  D. Farley,et al.  Evaluation of the AHRQ patient safety initiative: synthesis of findings. , 2009, Health services research.

[20]  H. Davies,et al.  Assessing organisational culture for quality and safety improvement: a national survey of tools and tool use , 2009, Quality & Safety in Health Care.

[21]  N. Klazinga,et al.  Differentiating between hospitals according to the “maturity” of quality improvement systems: a new classification scheme in a sample of European hospitals , 2009, Quality & Safety in Health Care.

[22]  R. Lilford,et al.  Evaluating service delivery interventions to enhance patient safety , 2008, BMJ : British Medical Journal.

[23]  Lori S. Cook,et al.  Examining quality improvement programs: the case of Minnesota hospitals. , 2008, Health services research.

[24]  R. Grol,et al.  Evidence for the impact of quality improvement collaboratives: systematic review , 2008, BMJ : British Medical Journal.

[25]  J. Alexander,et al.  Review: How Do Hospital Organizational Structure and Processes Affect Quality of Care? , 2008, Medical care research and review : MCRR.

[26]  Bryan J. Weiner,et al.  Review: Conceptualization and Measurement of Organizational Readiness for Change , 2008, Medical care research and review : MCRR.

[27]  A R Denniss,et al.  Barriers and facilitators to the implementation of the collaborative method: reflections from a single site , 2007, Quality & Safety in Health Care.

[28]  Marije Bosch,et al.  Tailoring quality improvement interventions to identified barriers: a multiple case analysis. , 2007, Journal of evaluation in clinical practice.

[29]  John Øvretveit,et al.  Sustained Improvement? Findings From an Independent Case Study of the Jönköping Quality Program , 2007, Quality management in health care.

[30]  M. Eccles,et al.  Planning and Studying Improvement in Patient Care: The Use of Theoretical Perspectives , 2007, The Milbank quarterly.

[31]  M. Alexander.  To Err is Human. , 2006, Journal of infusion nursing : the official publication of the Infusion Nurses Society.

[32]  Torsten B Neilands,et al.  The Safety Attitudes Questionnaire: psychometric properties, benchmarking data, and emerging research , 2006, BMC Health Services Research.

[33]  R Flin,et al.  Measuring safety climate in health care , 2006, Quality and Safety in Health Care.

[34]  E. Kroch,et al.  Engagement of Leadership in Quality Improvement Initiatives: Executive Quality Improvement Survey Results , 2006 .

[35]  D. Berwick,et al.  The 100,000 lives campaign: setting a goal and a deadline for improving health care quality. , 2006, JAMA.

[36]  W. Weeks,et al.  Measuring patient safety climate: a review of surveys , 2005, Quality and Safety in Health Care.

[37]  Steven F Lewis,et al.  An educational intervention to enhance nurse leaders' perceptions of patient safety culture. , 2005, Health services research.

[38]  C. Anderson‐Cook.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2005 .

[39]  Stephen C Schoenbaum,et al.  Measure, learn, and improve: physicians' involvement in quality improvement. , 2005, Health affairs.

[40]  R. Westrum.  A typology of organisational cultures , 2004, Quality and Safety in Health Care.

[41]  Brian S Mittman,et al.  Creating the Evidence Base for Quality Improvement Collaboratives , 2004, Annals of Internal Medicine.

[42]  D. Ketley,et al.  Influencing sceptical staff to become supporters of service improvement: a qualitative study of doctors’ and managers’ views , 2004, Quality and Safety in Health Care.

[43]  H. Krumholz,et al.  Data feedback efforts in quality improvement: lessons learned from US hospitals , 2004, Quality and Safety in Health Care.

[44]  J. Benneyan,et al.  Statistical process control as a tool for research and healthcare improvement , 2003, Quality & safety in health care.

[45]  K B Haller,et al.  Evaluation of the culture of safety: survey of clinicians and managers in an academic medical center , 2003, Quality & safety in health care.

[46]  Martin Marshall,et al.  The quantitative measurement of organizational culture in health care: a review of the available instruments. , 2003, Health services research.

[47]  David H Gustafson,et al.  Developing and testing a model to predict outcomes of organizational change. , 2003, Health services research.

[48]  D M Gaba,et al.  The culture of safety: results of an organization-wide survey in 15 California hospitals , 2003, Quality & safety in health care.

[49]  M. Laurant,et al.  Process evaluation on quality improvement interventions , 2003, Quality & safety in health care.

[50]  Tim Wilson,et al.  What do collaborative improvement projects do? Experience from seven countries. , 2003, Joint Commission journal on quality and safety.

[51]  S Cretin,et al.  Quality collaboratives: lessons from research , 2002, Quality & safety in health care.

[52]  J. Øvretveit,et al.  Evaluation of quality improvement programmes , 2002, Quality & safety in health care.

[53]  L. Donaldson.  An organisation with a memory. , 2002, Clinical medicine.

[54]  R. Centor,et al.  Relationship of hospital teaching status with quality of care and mortality for Medicare patients with acute MI. , 2000, JAMA.

[55]  P. Plsek.  Quality improvement methods in clinical medicine. , 1999, Pediatrics.

[56]  C M Kilo,et al.  A Framework for Collaborative Improvement: Lessons from the Institute for Healthcare Improvement's Breakthrough Series , 1998, Quality management in health care.

[57]  S M Shortell,et al.  Promoting clinical involvement in hospital quality improvement efforts: the effects of top management, board, and physician leadership. , 1997, Health services research.

[58]  D. Berwick.  About the Institute for Healthcare Improvement , 1993 .

[59]  Jacob Cohen,et al.  Applied multiple regression/correlation analysis for the behavioral sciences , 1979 .

[60]  Mr Paul Walley.  Clinical Systems Improvement in NHS Hospital Trusts and their PCTs-a snapshot of current practice , 2006 .

[61]  K. Shojania,et al.  Evidence-based quality improvement: the state of the science. , 2005, Health affairs.

[62]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[63]  William R. Hendee,et al.  To Err is Human: Building a Safer Health System , 2001 .