Development of a methodology for understanding and enhancing safety culture in Air Traffic Management

There is increasing interest in applying the concept of safety culture in Air Traffic Management (ATM). Using a mixed methods approach, this paper describes the development of a safety culture management toolkit that uses questionnaires and safety culture feedback workshops. The development process involved four phases. Phase 1 involved a review of the safety culture literature from 2001 to 2005 to identify relevant safety culture themes. Phase 2 involved conducting interviews with personnel (n = 52) from four geographically disparate European Air Navigation Service Providers (ANSPs) to validate and identify themes relevant to ATM. Follow-up focus groups (n = 3) consolidated the themes, and developed a preliminary set of questionnaire items; Phase 3 involved piloting a safety culture survey instrument with ATM staff (n = 537) in four countries. Construct validity of the questionnaire was tested using both Exploratory and Confirmatory factor analysis (EFA, CFA). Substantial refinement of the item set was required to establish a consistent model, and a second sample (n = 883) was surveyed to replicate the model. Phase 4 involved conducting feedback workshops with ANSP personnel in study locations (n = 7) in order to further validate the themes identified in the questionnaire. These were used to develop qualitative insights (e.g. specific safety problems and solutions) relating to the results of the questionnaire at each ANSP. The study aimed to develop a bespoke quantitative measurement instrument (and qualitative feedback tool) with construct and discriminant validity, and the ability to consistently measure safety culture in ANSPs throughout Europe, and facilitate safety improvements in air traffic management. This aim was partially achieved, and although the safety culture toolkit was perceived as useful for exploring and highlighting safety issues at a local ANSP level, further work is required. This will involve developing the tool to ensure it operates consistently in different national and cultural setting, and designing metrics for testing the criterion validity of the safety culture toolkit.

[1]  Tor-Olav Nævestad,et al.  Mapping Research on Culture and Safety in High-Risk Organizations: Arguments for a Sociotechnical Understanding of Safety Culture , 2009 .

[2]  Gurjeet K. Gill,et al.  Perceptions of safety management and safety culture in the aviation industry in New Zealand , 2004 .

[3]  Gudela Grote,et al.  Understanding and assessing safety culture through the lens of organizational management of uncertainty , 2007 .

[4]  N. Pidgeon.  SAFETY CULTURE: KEY THEORETICAL ISSUES , 1998 .

[5]  Barry Kirwan,et al.  Incident reduction and risk migration , 2011 .

[6]  Curt R Johansson,et al.  Safety culture in air traffic management: Air traffic control , 2003 .

[7]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[8]  P. Bentler,et al.  Significance Tests and Goodness of Fit in the Analysis of Covariance Structures , 1980 .

[9]  A. Glendon,et al.  Human Safety and Risk Management, Second Edition , 2006 .

[10]  John Cairns,et al.  Safety culture and accident risk control: Perceptions of professional divers and offshore workers , 2005 .

[11]  Patrick T. W. Hudson,et al.  A framework for understanding the development of organisational safety culture , 2006 .

[12]  David M. DeJoy,et al.  Behavior change versus culture change: Divergent approaches to managing workplace safety , 2005 .

[13]  Laura Pickup,et al.  Safety culture in railway maintenance , 2005 .

[14]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[15]  M. Crum,et al.  Management practices as antecedents of safety culture within the trucking industry: similarities and differences by hierarchical level. , 2003, Journal of safety research.

[16]  D. Gerbing,et al.  Viability of exploratory factor analysis as a precursor to confirmatory factor analysis , 1996 .

[17]  Dov Zohar,et al.  Thirty years of safety climate research: reflections and future directions. , 2010, Accident; analysis and prevention.

[18]  Christian Koch,et al.  Integration, differentiation and ambiguity in safety cultures , 2004 .

[19]  Stian Antonsen,et al.  Safety Culture Assessment: A Mission Impossible? , 2009 .

[20]  Gudela Grote,et al.  Diagnosis of safety culture in safety management audits , 2000 .

[21]  A. Edmondson.  Psychological Safety and Learning Behavior in Work Teams , 1999 .

[22]  Frank W. Guldenmund,et al.  The use of questionnaires in safety culture research – an evaluation , 2007 .

[23]  D. Zohar.  The effects of leadership dimensions, safety climate, and assigned priorities on minor injuries in work groups , 2002 .

[24]  G. Hutcheson.  The Multivariate Social Scientist: Introductory Statistics Using Generalized Linear Models , 1999 .

[25]  Curt R Johansson,et al.  Safety culture in Swedish air traffic control , 2007 .

[26]  M. D. Cooper.  Towards a model of safety culture , 2000 .

[27]  A. Neal,et al.  A study of the lagged relationships among safety climate, safety motivation, safety behavior, and accidents at the individual and group levels. , 2006, The Journal of applied psychology.

[28]  E. Schein.  Organizational Culture and Leadership , 1991 .

[29]  Gil Luria,et al.  The use of supervisory practices as leverage to improve safety behavior: a cross-level intervention model. , 2003, Journal of safety research.

[30]  A Neal,et al.  Perceptions of safety at work: a framework for linking safety climate to safety performance, knowledge, and motivation. , 2000, Journal of occupational health psychology.

[31]  Sharon Clarke.  A Meta-analytic Review of Safety Climate and Safety Performance , 2004 .

[32]  James T. Reason,et al.  Achieving a safe culture : theory and practice , 1998 .

[33]  Dov Zohar,et al.  Safety climate: Conceptual and measurement issues. , 2011 .

[34]  Alistair Cheyne,et al.  Assessing safety culture in offshore environments. , 2000 .

[35]  S. Clarke.  The relationship between safety climate and safety performance: a meta-analytic review. , 2006, Journal of occupational health psychology.

[36]  Kathryn Mearns,et al.  Measuring safety climate: identifying the common features☆ , 2000 .

[37]  R. Westrum.  A typology of organisational cultures , 2004, Quality and Safety in Health Care.

[38]  Curt R Johansson,et al.  Safety culture in the Swedish air navigation services , 2002 .

[39]  Chris W. Johnson,et al.  A Comparison of the Role of Degraded Modes of Operation in the Causes of Accidents in Rail and Air Traffic Management , 2007 .

[40]  R Flin,et al.  Benchmarking Safety Climate in Hazardous Environments: A Longitudinal, Interorganizational Approach , 2001, Risk analysis : an official publication of the Society for Risk Analysis.

[41]  P. Pronovost,et al.  Assessing safety culture: guidelines and recommendations , 2005, Quality and Safety in Health Care.

[42]  Paul O'Connor,et al.  Identifying and addressing the limitations of safety climate surveys. , 2011, Journal of safety research.

[43]  R J Lilford,et al.  Organizing patient safety research to identify risks and hazards , 2003, Quality & safety in health care.

[44]  F. Guldenmund.  The nature of safety culture: a review of theory and research , 2000 .

[45]  Jill C. Bradley,et al.  Workplace safety: a meta-analysis of the roles of person and situation factors. , 2009, The Journal of applied psychology.

[46]  K. Weick.  Organizational Culture as a Source of High Reliability , 1987 .