Robust data-driven human reliability analysis using credal networks

Despite increasing collection efforts of empirical human reliability data, the available databases are still insufficient for understanding the relationships between human errors and their influencing factors. Currently, probabilistic tools such as Bayesian network are used to model data uncertainty requiring the estimation of conditional probability tables from data that is often not available. The most common solution relies on the adoption of assumptions and expert elicitation to fill the gaps. This gives an unjustified sense of confidence on the analysis. This paper proposes a novel methodology for dealing with missing data using intervals comprising the lowest and highest possible probability values. Its implementation requires a shift from Bayesian to credal networks. This allows to keep track of the associated uncertainty on the available data. The methodology has been applied to the quantification of the risks associated to a storage tank depressurisation of offshore oil & gas installations known as FPSOs and FSOs. The critical task analysis is converted to a cause-consequence structure and used to build a credal network, which extracts human factors combinations from major accidents database defined with CREAM classification scheme. Prediction analysis shows results with interval probabilities rather than point values measuring the effect of missing-data variables. Novel decision-making strategies for diagnostic analysis are suggested to unveil the most relevant variables for risk reduction in presence of imprecision. Realistic uncertainty depiction implies less conservative human reliability analysis and improve risk communication between assessors and decision-makers.

[1]  Marco de Angelis,et al.  An integrated and efficient numerical framework for uncertainty quantification: application to the NASA Langley multidisciplinary uncertainty quantification challenge , 2014 .

[2]  Wondea Jung,et al.  HuREX - A framework of HRA data collection from simulators in nuclear power plants , 2020, Reliab. Eng. Syst. Saf..

[3]  Yochan Kim Considerations for generating meaningful HRA data: Lessons learned from HuREX data collection , 2020 .

[4]  Yang Xiang,et al.  Modeling Causal Reinforcement and Undermining for Efficient CPT Elicitation , 2007, IEEE Transactions on Knowledge and Data Engineering.

[5]  Edoardo Patelli,et al.  COSSAN: A Multidisciplinary Software Suite for Uncertainty Quantification and Risk Management , 2017 .

[6]  Edoardo Patelli,et al.  Learning from major accidents: Graphical representation and analysis of multi-attribute events to enhance risk communication , 2017 .

[7]  Katrina M. Groth,et al.  A hybrid algorithm for developing third generation HRA methods using simulator data, causal models, and cognitive science , 2019, Reliab. Eng. Syst. Saf..

[8]  Luigi Portinale,et al.  Improving the analysis of dependable systems by mapping fault trees into Bayesian networks , 2001, Reliab. Eng. Syst. Saf..

[9]  Olivier Salvi,et al.  A global view on ARAMIS, a risk assessment methodology for industries in the framework of the SEVESO II directive. , 2006, Journal of hazardous materials.

[10]  Luca Podofillini,et al.  Methods for building Conditional Probability Tables of Bayesian Belief Networks from limited judgment: An evaluation for Human Reliability Application , 2016, Reliab. Eng. Syst. Saf..

[11]  Ana Isabel Barros,et al.  Relieving the elicitation burden of Bayesian Belief Networks , 2008, BMA.

[12]  Ali Mosleh,et al.  A human reliability analysis methodology for oil refineries and petrochemical plants operation: Phoenix-PRO qualitative framework , 2020, Reliab. Eng. Syst. Saf..

[13]  J. Siegrist Mixing good data with bad: how to do it and when you should not , 2011 .

[14]  Edoardo Patelli,et al.  Tackling the Lack of Data for Human Error Probability with Credal Network , 2019 .

[15]  Ali Mosleh,et al.  A critique of current practice for the use of expert opinions in probabilistic risk assessment , 1988 .

[16]  Fabio Gagliardi Cozman,et al.  Credal networks , 2000, Artif. Intell..

[17]  Ugur Kuter,et al.  Interactive Course-of-Action Planning Using Causal Models , 2004 .

[19]  Muhammad Usman,et al.  A modified CREAM to human reliability quantification in marine engineering , 2013 .

[20]  Tim Bedford,et al.  Human reliability analysis: A critique and review for managers , 2011 .

[21]  Serafín Moral,et al.  Hill-climbing and branch-and-bound algorithms for exact and approximate inference in credal networks , 2007, Int. J. Approx. Reason..

[22]  Max Henrion,et al.  Some Practical Issues in Constructing Belief Networks , 1987, UAI.

[23]  Luca Podofillini,et al.  A Bayesian approach to treat expert-elicited probabilities in human reliability analysis model construction , 2013, Reliab. Eng. Syst. Saf..

[24]  Norman Fenton,et al.  Risk Assessment and Decision Analysis with Bayesian Networks , 2012 .

[25]  Mario Hellmich,et al.  Human error probabilities from operational experience of German nuclear power plants , 2013, Reliab. Eng. Syst. Saf..

[26]  Paolo Trucco,et al.  A Bayesian Belief Network modelling of organisational factors in risk analysis: A case study in maritime transportation , 2008, Reliab. Eng. Syst. Saf..

[27]  I. J. Myung,et al.  Tutorial on maximum likelihood estimation , 2003 .

[28]  Edoardo Patelli,et al.  An open toolbox for the reduction, inference computation and sensitivity analysis of Credal Networks , 2018, Adv. Eng. Softw..

[29]  Marco Zaffalon,et al.  CREDO: A military decision-support system based on credal networks , 2013, Proceedings of the 16th International Conference on Information Fusion.

[30]  Marco de Angelis,et al.  Pseudo Credal Networks for Inference With Probability Intervals , 2019, ASCE-ASME J Risk and Uncert in Engrg Sys Part B Mech Engrg.

[31]  Marcelo Ramos Martins,et al.  Application of Bayesian Belief networks to the human reliability analysis of an oil tanker operation focusing on collision accidents , 2013, Reliab. Eng. Syst. Saf..

[32]  Fabio Babiloni,et al.  Brain–Computer Interface-Based Adaptive Automation to Prevent Out-Of-The-Loop Phenomenon in Air Traffic Controllers Dealing With Highly Automated Systems , 2019, Front. Hum. Neurosci..

[33]  Sankaran Mahadevan,et al.  Human reliability under sleep deprivation: Derivation of performance shaping factor multipliers from empirical data , 2015, Reliab. Eng. Syst. Saf..

[34]  Vicki M. Bier,et al.  A study of expert overconfidence , 2008, Reliab. Eng. Syst. Saf..

[35]  S. Ferson,et al.  Computing with Confidence: Imprecise Posteriors and Predictive Distributions , 2014 .

[36]  David E Over,et al.  Conditionals and conditional probability. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[37]  John F. Lemmer,et al.  Recursive noisy OR - a rule for estimating complex probabilistic interactions , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[38]  Curtis L. Smith,et al.  A Bayesian method for using simulator data to enhance human error probabilities assigned by existing HRA methods , 2014, Reliab. Eng. Syst. Saf..

[39]  Emilie M. Roth,et al.  The SACADA database for human reliability and human performance , 2014, Reliab. Eng. Syst. Saf..

[40]  Marco Zaffalon,et al.  Approximating Credal Network Inferences by Linear Programming , 2013, ECSQARU.

[41]  Barry Kirwan,et al.  A Guide to Practical Human Reliability Assessment , 1994 .

[42]  Edoardo Patelli,et al.  Probabilistic risk assessment of fire occurrence in residential buildings: Application to the Grenfell tower , 2019 .

[43]  Vinh N. Dang,et al.  Aggregating expert-elicited error probabilities to build HRA models , 2014 .

[44]  Erik Hollnagel,et al.  Cognitive reliability and error analysis method : CREAM , 1998 .

[45]  Snorre Sklet,et al.  Safety barriers: Definition, classification, and performance , 2006 .

[46]  Arnab Majumdar,et al.  Data Based Framework to Identify the Most Significant Performance Shaping Factors in Railway Operations , 2015 .

[47]  Finn V. Jensen,et al.  Bayesian Networks and Decision Graphs , 2001, Statistics for Engineering and Information Science.

[48]  Carole Duval,et al.  Methodological developments for probabilistic risk analyses of socio-technical systems , 2009 .

[49]  Matthias C. M. Troffaes Decision making under uncertainty using imprecise probabilities , 2007, Int. J. Approx. Reason..

[50]  Carol Smidts,et al.  Human reliability modeling for the Next Generation System Code , 2013 .

[51]  Yo Chan Kim,et al.  Estimating the quantitative relation between PSFs and HEPs from full-scope simulator data , 2018, Reliab. Eng. Syst. Saf..

[52]  Marco Zaffalon,et al.  Credal networks for military identification problems , 2009, Int. J. Approx. Reason..

[53]  Antonis Targoutzidis Incorporating human factors into a simplified "bow-tie" approach for workplace risk assessment. , 2010 .

[54]  Edoardo Patelli,et al.  Analysis and Estimation of Human Errors From Major Accident Investigation Reports , 2020 .

[55]  Y Stempfel,et al.  Developing and evaluating the Bayesian Belief Network as a human reliability model using artificial data , 2011 .

[56]  E. Patelli,et al.  Identification of human errors and influencing factors: A machine learning approach , 2022, Safety Science.

[57]  James T. Reason,et al.  Managing the risks of organizational accidents , 1997 .

[58]  Edoardo Patelli,et al.  Learning from major accidents to improve system design , 2016 .

[59]  Barry Kirwan,et al.  Validation of human reliability assessment techniques: Part 1 -- Validation issues , 1997 .

[60]  P. Walley Statistical Reasoning with Imprecise Probabilities , 1990 .

[61]  Ali Mosleh,et al.  Deriving causal Bayesian networks from human reliability analysis data: A methodology and example model , 2012 .

[62]  A. D. Swain,et al.  Handbook of human-reliability analysis with emphasis on nuclear power plant applications. Final report , 1983 .

[63]  Wondea Jung,et al.  Use of a Big Data Mining Technique to Extract Relative Importance of Performance Shaping Factors from Event Investigation Reports , 2017 .

[64]  Luca Podofillini,et al.  Bayesian belief networks for human reliability analysis: A review of applications and gaps , 2015, Reliab. Eng. Syst. Saf..