Multilevel psychometric properties of the AHRQ hospital survey on patient safety culture

BackgroundThe Agency for Healthcare Research and Quality (AHRQ) Hospital Survey on Patient Safety Culture was designed to assess staff views on patient safety culture in hospital settings. The purpose of this study was to examine the multilevel psychometric properties of the survey.MethodsSurvey data from 331 U.S. hospitals with 2,267 hospital units and 50,513 respondents were analyzed to examine the psychometric properties of the survey's items and composites. Item factor loadings, intraclass correlations (ICCs), design effects, internal consistency reliabilities, and multilevel confirmatory factor analyses (MCFA) were examined as well as intercorrelations among the survey's composites.ResultsPsychometric analyses confirmed the multilevel nature of the data at the individual, unit and hospital levels of analysis. Results provided overall evidence supporting the 12 dimensions and 42 items included in the AHRQ Hospital Survey on Patient Safety Culture as having acceptable psychometric properties at all levels of analysis, with a few exceptions. The Staffing composite fell slightly below cutoffs in a number of areas, but is conceptually important given its impact on patient safety. In addition, one hospital-level model fit indicator for the Supervisor/Manager Expectations & Actions Promoting Patient Safety composite was low (CFI = .82), but all other psychometrics for this scale were good. Average dimension intercorrelations were moderate at .42 at the individual level, .50 at the unit level, and .56 at the hospital level.ConclusionsPsychometric analyses conducted on a very large database of hospitals provided overall support for the patient safety culture dimensions and items included in the AHRQ Hospital Survey on Patient Safety Culture. The survey's items and dimensions overall are psychometrically sound at the individual, unit, and hospital levels of analysis and can be used by researchers and hospitals interested in assessing patient safety culture. Further research is needed to study the criterion-related validity of the survey by analysing the relationship between patient safety culture and patient outcomes and studying how to improve patient safety culture.

[1]  Taeki Lee,et al.  Assessing safety culture in nuclear power stations , 2000 .

[2]  A. Wall,et al.  Book ReviewTo Err is Human: building a safer health system Kohn L T Corrigan J M Donaldson M S Washington DC USA: Institute of Medicine/National Academy Press ISBN 0 309 06837 1 $34.95 , 2000 .

[3]  Torsten B Neilands,et al.  The Safety Attitudes Questionnaire: psychometric properties, benchmarking data, and emerging research , 2006, BMC Health Services Research.

[4]  James T. Reason,et al.  Managing the risks of organizational accidents , 1997 .

[5]  R Flin,et al.  Measuring safety climate in health care , 2006, Quality and Safety in Health Care.

[6]  Sousa,et al.  Reliability and Validity of the Hospital Survey on Patient Safety Culture at a Norwegian Hospital , 2010 .

[7]  V. Nieva,et al.  Safety culture assessment: a tool for improving patient safety in healthcare organizations , 2003, Quality & safety in health care.

[8]  Identifying Barriers to the Success of a Reporting System -- Advances in Patient Safety: From Research to Implementation (Volume 3: Implementation Issues) , 2005 .

[9]  Charles R Denham,et al.  Fair and just culture, team behavior, and leadership engagement: The tools to achieve high reliability. , 2006, Health services research.

[10]  Ann Page,et al.  Keeping patients safe. , 2011, Consumer reports.

[11]  D. L. Simms,et al.  Normal Accidents: Living with High-Risk Technologies , 1986 .

[12]  Y Mlynek.  [Quality and/or safety of health care]. , 1998, Lakartidningen.

[13]  R. Westrum.  A typology of organisational cultures , 2004, Quality and Safety in Health Care.

[14]  P. Groenewegen,et al.  The psychometric properties of the 'Hospital Survey on Patient Safety Culture' in Dutch hospitals , 2008, BMC health services research.

[15]  Director,et al.  Hospital Survey on Patient Safety Culture , 2004 .

[16]  P. Groenewegen,et al.  Measuring patient safety culture: an assessment of the clustering of responses at unit level and hospital level , 2009, Quality & Safety in Health Care.

[17]  L. Kohn,et al.  To Err Is Human : Building a Safer Health System , 2007 .

[18]  Barrett T. Kitch,et al.  Assessing Patient Safety Culture: A Review and Synthesis of the Measurement Tools , 2006 .

[19]  K. Weick.  Organizational Culture as a Source of High Reliability , 1987 .

[20]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[21]  R. Helmreich.  On error management: lessons from aviation , 2000, BMJ : British Medical Journal.

[22]  R. O’Brien,et al.  A Caution Regarding Rules of Thumb for Variance Inflation Factors , 2007 .

[23]  D M Gaba,et al.  The culture of safety: results of an organization-wide survey in 15 California hospitals , 2003, Quality & safety in health care.

[24]  Robert L. Helmreich,et al.  Identifying Barriers to the Success of a Reporting System , 2005 .

[25]  Martin Marshall,et al.  The quantitative measurement of organizational culture in health care: a review of the available instruments. , 2003, Health services research.

[26]  Marybeth Farquhar,et al.  AHRQ Quality Indicators , 2008 .

[27]  Peter J Pronovost,et al.  Creating high reliability in health care organizations. , 2006, Health services research.

[28]  D. Classen,et al.  Methodology and rationale for the measurement of harm with trigger tools , 2003, Quality & safety in health care.

[29]  Niraj L. Sehgal,et al.  AHRQ's Hospital Survey on Patient Safety Culture: Psychometric Analyses , 2009, Journal of patient safety.

[30]  A. Slonim,et al.  Assessing patient safety risk before the injury occurs: an introduction to sociotechnical probabilistic risk modelling in health care , 2003, Quality & safety in health care.

[31]  Jane Garbutt,et al.  Using focus groups to understand physicians' and nurses' perspectives on error reporting in hospitals. , 2004, Joint Commission journal on quality and safety.

[32]  J. Battles,et al.  Adverse-event-reporting practices by US hospitals: results of a national survey , 2008, Quality & Safety in Health Care.

[33]  W. Weeks,et al.  Measuring patient safety climate: a review of surveys , 2005, Quality and Safety in Health Care.

[34]  D. Zohar.  Safety climate in industrial organizations: theoretical and applied implications. , 1980, The Journal of applied psychology.

[35]  R. Peterson.  A Meta-Analysis of Variance Accounted for and Factor Loadings in Exploratory Factor Analysis , 2000 .

[36]  J. Sorra,et al.  Hospital Survey on Patient Safety Culture: 2008 Comparative Database Report , 2008 .

[37]  Johan Hellings,et al.  Challenging patient safety culture: survey results. , 2007, International journal of health care quality assurance.