Validity and consistency assessment of accident analysis methods in the petroleum industry

Background. Accident analysis is the main aspect of accident investigation. It includes the method of connecting different causes in a procedural way. Therefore, it is important to use valid and reliable methods for the investigation of different causal factors of accidents, especially the noteworthy ones. Objective. This study aimed to prominently assess the accuracy (sensitivity index [SI]) and consistency of the six most commonly used accident analysis methods in the petroleum industry. Methods. In order to evaluate the methods of accident analysis, two real case studies (process safety and personal accident) from the petroleum industry were analyzed by 10 assessors. The accuracy and consistency of these methods were then evaluated. The assessors were trained in the workshop of accident analysis methods. Results. The systematic cause analysis technique and bowtie methods gained the greatest SI scores for both personal and process safety accidents, respectively. The best average results of the consistency in a single method (based on 10 independent assessors) were in the region of 70%. Conclusion. This study confirmed that the application of methods with pre-defined causes and a logic tree could enhance the sensitivity and consistency of accident analysis.

[1]  Neville A Stanton,et al.  Predicting pilot error: testing a new methodology and a multi-methods and analysts approach. , 2009, Applied ergonomics.

[2]  George L. Germain,et al.  Practical loss control leadership , 1996 .

[3]  John M. Bennett,et al.  The Australian Computer Society , 1977, Australian Computer Journal.

[4]  Chris W. Johnson,et al.  A survey of logic formalisms to support mishap analysis , 2003, Reliab. Eng. Syst. Saf..

[5]  Babette Fahlbruch,et al.  SOL – Safety through organizational learning: A method for event analysis , 2011 .

[6]  Mark S. Young,et al.  Predicting design induced pilot error using HET (human error template) – A new formal human error identification method for flight decks , 2006, The Aeronautical Journal (1968).

[7]  Ted S. Ferry,et al.  Modern accident investigation and analysis , 1988 .

[8]  B Kirwan.  The validation of three human reliability quantification techniques--THERP, HEART and JHEDI: Part III--Practical aspects of the usage of the techniques. , 1997, Applied ergonomics.

[9]  B Kirwan,et al.  Human error identification in human reliability assessment. Part 2: Detailed comparison of techniques. , 1992, Applied ergonomics.

[10]  Zahid H. Qureshi,et al.  A review of accident modelling approaches for complex socio-technical systems , 2007 .

[11]  Willem A. Wagenaar,et al.  The goal, and how to get there , 1997 .

[12]  Nikki S. Olsen.  Coding ATC incident data using HFACS: Inter-coder consensus , 2011 .

[13]  Nima Khakzad,et al.  Dynamic risk analysis using bow-tie approach , 2012, Reliab. Eng. Syst. Saf..

[14]  F R Chevreau,et al.  Organizing learning processes on risks by using the bow-tie representation. , 2006, Journal of hazardous materials.

[15]  Tom Kontogiannis,et al.  A comparison of accident analysis techniques for safety-critical man-machine systems , 2000 .

[16]  Controlling the controllable : the management of safety , 1992 .

[17]  J P Doidge,et al.  Successful health and safety management , 1997, Perfusion.

[18]  Andrew Hopkins,et al.  Lessons from Longford: The ESSO Gas Plant Explosion , 2000 .

[19]  Kingsley Hendrick,et al.  Investigating Accidents with Step , 1986 .

[20]  M. Konstantinidou,et al.  Comparison of techniques for accident scenario analysis in hazardous systems , 2004 .

[21]  Jop Groeneweg,et al.  Promoting safety in the oil industry. The Ergonomics Society Lecture Presented at the Ergonomics Society Annual Conference, Edinburgh, 13-16 April 1993 , 1994 .

[22]  William G. Johnson,et al.  Mort Safety Assurance Systems , 1980 .

[23]  Scott A. Shappell,et al.  A HUMAN ERROR APPROACH TO AVIATION ACCIDENT ANALYSIS , 2003 .

[24]  Rolf-Arne Haugen Syvertsen.  Modeling the Deepwater Horizon blowout using STAMP , 2012 .

[25]  I. Svedung,et al.  Proactive Risk Management in a Dynamic Society , 2000 .

[26]  Snorre Sklet,et al.  Comparison of some selected methods for accident investigation. , 2004, Journal of hazardous materials.

[27]  Paul M. Salmon,et al.  Systems-based accident analysis methods: A comparison of Accimap, HFACS, and STAMP , 2012 .

[28]  Keith Cassidy.  Guidelines for Investigating Chemical Process Incidents, 2nd edition Center for Chemical Process Safety of the American Institute of Chemical Engineers AIChE, 2003 452 pp plus CD Rom, £118, ISBN 0 8169 08974 , 2004 .

[29]  Craig W. Johnson,et al.  An investigation into the loss of the Brazilian space programme’s launch vehicle VLS-1 V03 , 2008 .

[30]  A. D. Gower-Jones,et al.  Experience with Tripod BETA Incident Analysis , 1998 .

[31]  I. Svedung,et al.  Graphic representation of accident scenarios: mapping system structure and the causation of accidents , 2002 .

[32]  Barry Kirwan,et al.  Validation of human reliability assessment techniques: Part 1 -- Validation issues , 1997 .

[33]  C Baber,et al.  Human error identification techniques applied to public technology: predictions compared with observed use. , 1996, Applied ergonomics.

[34]  Ali Khavanin,et al.  Selection of the optimal method for analysis of accidents in petroleum industry using fuzzy ANP and TOPSIS multi – criteria decision methods , 2017 .

[35]  N. W. Knox,et al.  MORT user's manual for use with the management oversignt and risk tree analytical logic diagram , 1983 .

[36]  J. R. Buys,et al.  Events and causal factors charting , 1978 .

[37]  Emmanuel Manatakis,et al.  Towards an evaluation of accident investigation methods in terms of their alignment with accident causation models , 2009 .

[38]  S. Munson.  Assessment of accident investigation methods for wildland firefighting incidents by case study method , 2000 .

[39]  Jamil Hassounah.  Encourage Employee Participation , 2002 .

[40]  Zachary A Abecassis,et al.  Fault Tree Analysis , 2017, American journal of medical quality : the official journal of the American College of Medical Quality.

[41]  Lisa M Morrison,et al.  Best practices in incident investigation in the chemical process industries with examples from the industry sector and specifically from Nova Chemicals. , 2004, Journal of hazardous materials.

[42]  John A Stoop,et al.  Independent accident investigation: a modern safety tool. , 2004, Journal of hazardous materials.

[43]  John Fox,et al.  Comparing the comprehensiveness of three expert inspection methodologies for detecting errors in interactive systems , 2014 .