Measuring and evaluating safety management system effectiveness using Data Envelopment Analysis

Abstract In January 2015, the FAA released a congressionally mandated, final rule on Safety Management Systems (SMS) for Part 121 air carriers. Since organizations must implement SMS, often at considerable expense, a sound, valid means of measuring SMS effectiveness must be established. The purpose of this research was to develop a model to measure and test SMS effectiveness. It was constructed through a systematic series of steps, ensuring accomplishment of research objectives. While preliminary, this research demonstrates that Data Envelopment Analysis (DEA) models can be produced to help organizations measure the effectiveness of their SMS and determine how to improve SMS-related performance.

[1]  Donald J. Ford.  Evaluating performance improvement , 2004 .

[2]  T. Cox,et al.  Safety, Systems and People , 1996 .

[3]  Ching-Fu Chen,et al.  Scale development of safety management system evaluation for the airline industry. , 2012, Accident; analysis and prevention.

[4]  C. Fornell,et al.  Evaluating structural equation models with unobservable variables and measurement error. , 1981 .

[5]  Thomas R. Sexton,et al.  Data Envelopment Analysis with Reverse Inputs and Outputs , 2004 .

[6]  Maurice Nevile,et al.  Using Conversation Analysis in Data-Driven Aviation Training with Large-Scale Qualitative Datasets , 2017 .

[7]  William W. Cooper,et al.  Handbook on data envelopment analysis , 2011 .

[8]  Paul Raymond Bates,et al.  The relationship between the implementation of a Safety Management System and the attitudes of employees towards unsafe acts in aviation , 2011 .

[9]  J. Hair.  Multivariate data analysis , 1972 .

[10]  Christopher A. Janicak,et al.  Safety Metrics: Tools and Techniques for Measuring Safety Performance , 2003 .

[11]  Michael J. Braunscheidel,et al.  The organizational antecedents of a firm’s supply chain agility for risk mitigation and response , 2009 .

[12]  Don Arendt,et al.  System and Task Analysis , 2016 .

[13]  Barbara M. Byrne,et al.  Structural equation modeling with EQS : basic concepts, applications, and programming , 2000 .

[14]  Ching-Fu Chen,et al.  Measuring the effects of Safety Management System practices, morality leadership and self-efficacy on pilots’ safety behaviors: Safety motivation as a mediator , 2014 .

[15]  Emmanuel Thanassoulis,et al.  Applied data envelopment analysis , 1991 .

[16]  Nicholas J. Bahr.  System Safety Engineering And Risk Assessment: A Practical Approach , 1997 .

[17]  Kristi Jackson,et al.  Qualitative Data Analysis with NVivo , 2007 .

[18]  Emmanuel Manatakis,et al.  Assessment of selected safety performance evaluation methods in regards to their conceptual, methodological and practical characteristics , 2010 .

[19]  W. Paul Vogt,et al.  When to Use What Research Design , 2012 .

[20]  Bob Hunt,et al.  A fresh approach to safety management systems in Hong Kong , 2004 .