A hybrid algorithm for developing third generation HRA methods using simulator data, causal models, and cognitive science

Abstract Over the past 10 years, there have been significant international efforts to modernize Human Reliability Analysis (HRA), with most efforts focused on one of two directions: developing new sources of HRA data from control room simulators, and developing new HRA methods based in cognitive science. However, these efforts have proceeded largely independently, and there has been little research into how to leverage these scientific advances in data together with the scientific advances in modeling and methods. This is a significant gap for HRA, and motivates a need for methodologies to unify the efforts of the modeling and data collection communities. In this paper we define a comprehensive hybrid algorithm for using causal models and multiple types of HRA data to provide a rigorous quantitative basis for cognitively based Human Reliability Analysis (HRA) methods such as PHOENIX and IDHEAS. The algorithm uses causal models built from and parameterized by a combination of data from cognitive literature, systems engineering, existing HRA methods, simulator data, and expert elicitation. The main elements of the hybrid algorithm include a comprehensive set of causal factors, human-machine team tasks and events, Bayesian Network causal models, and Bayesian parameter updating methods. The algorithm enhances both the qualitative and the quantitative basis of HRA, adding significant scientific depth and technical traceability to the highly complicated problem of modeling human-machine team failures in complex engineering systems.

[1]  Wondea Jung,et al.  A DATABASE FOR HUMAN PERFORMANCE UNDER SIMULATED EMERGENCIES OF NUCLEAR POWER PLANTS , 2005 .

[2]  A. Mosleh,et al.  Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents: Part 3: IDAC operator response model , 2007, Reliab. Eng. Syst. Saf..

[3]  Yo Chan Kim,et al.  Estimating the quantitative relation between PSFs and HEPs from full-scope simulator data , 2018, Reliab. Eng. Syst. Saf..

[4]  Daniel Straub,et al.  Bayesian Network Enhanced with Structural Reliability Methods: Methodology , 2010, 1203.5986.

[5]  Ali Mosleh,et al.  Model-based human reliability analysis: prospects and requirements , 2004, Reliab. Eng. Syst. Saf..

[6]  James T. Enns,et al.  In sight, out of mind: The role of eye movements in the rapid resumption of visual search , 2007, Perception & psychophysics.

[7]  Ronald L. Boring,et al.  A Research Roadmap for Computation-Based Human Reliability Analysis , 2015 .

[8]  Katrina M. Groth,et al.  Exploration of methods for using SACADA data to estimate HEPs: Final Report , 2018 .

[9]  Curtis L. Smith,et al.  A Bayesian method for using simulator data to enhance human error probabilities assigned by existing HRA methods , 2014, Reliab. Eng. Syst. Saf..

[10]  Johanna Oxstrand,et al.  Model-Based Approach to HRA: Example Application and Quantitative Analysis. , 2012 .

[11]  Emilie M. Roth,et al.  The SACADA database for human reliability and human performance , 2014, Reliab. Eng. Syst. Saf..

[12]  Nadine B. Sarter,et al.  Why Pilots Miss the Green Box: How Display Context Undermines Attention Capture , 2004 .

[13]  Luca Podofillini,et al.  Bayesian belief networks for human reliability analysis: A review of applications and gaps , 2015, Reliab. Eng. Syst. Saf..

[14]  Ali Mosleh,et al.  Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents. Part 4: IDAC causal model of operator problem-solving response , 2007, Reliab. Eng. Syst. Saf..

[15]  Marek J. Druzdzel,et al.  Learning Bayesian network parameters from small data sets: application of Noisy-OR gates , 2001, Int. J. Approx. Reason..

[16]  Ali Mosleh,et al.  Deriving causal Bayesian networks from human reliability analysis data: A methodology and example model , 2012 .

[17]  Ali Mosleh,et al.  A data-informed PIF hierarchy for model-based Human Reliability Analysis , 2012, Reliab. Eng. Syst. Saf..

[18]  Wondea Jung,et al.  A classification scheme of erroneous behaviors for human error probability estimations based on simulator data , 2017, Reliab. Eng. Syst. Saf..

[19]  Francisco Javier Díez,et al.  Parameter adjustment in Bayes networks. The generalized noisy OR-gate , 1993, UAI.

[20]  A. D. Swain,et al.  Handbook of human-reliability analysis with emphasis on nuclear power plant applications. Final report , 1983 .

[21]  Wondea Jung,et al.  OPERA - a human performance database under simulated emergencies of nuclear power plants , 2007, Reliab. Eng. Syst. Saf..

[22]  Ali Mosleh,et al.  Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents. Part 2: IDAC performance influencing factors model , 2007, Reliab. Eng. Syst. Saf..

[23]  Susan M. Stevens-Adams,et al.  Challenges in leveraging existing human performance data for quantifying the IDHEAS HRA method , 2015, Reliab. Eng. Syst. Saf..

[24]  Ross D. Shachter Evaluating Influence Diagrams , 1986, Oper. Res..

[25]  Ali Mosleh,et al.  A Model-Based Approach to HRA: Qualitative Analysis Methodology , 2012 .

[26]  Nsimah J. Ekanem,et al.  A model-based human reliability analysis methodology (phoenix method) , 2013 .

[27]  Ali Mosleh,et al.  Phoenix - A model-based Human Reliability Analysis methodology: Qualitative Analysis Procedure , 2016, Reliab. Eng. Syst. Saf..

[28]  Ali Mosleh,et al.  Cognitive modeling and dynamic probabilistic simulation of operating crew response to complex system accidents: Part 1: Overview of the IDAC Model , 2007, Reliab. Eng. Syst. Saf..

[29]  Carol Smidts,et al.  Development of a quantitative Bayesian network mapping objective factors to subjective performance shaping factor evaluations: An example using student operators in a digital nuclear power plant simulator , 2020, Reliab. Eng. Syst. Saf..

[30]  Sampath Srinivas,et al.  A Generalization of the Noisy-Or Model , 1993, UAI.

[31]  Erik Hollnagel,et al.  Cognitive reliability and error analysis method : CREAM , 1998 .

[32]  Laura Painton Swiler,et al.  Bridging the gap between HRA research and HRA practice: A Bayesian network version of SPAR-H , 2013, Reliab. Eng. Syst. Saf..

[33]  Wondea Jung,et al.  Qualitative human event analysis with simulator data by using HuRAM+ and HERA , 2013 .

[34]  Daniel Straub,et al.  Capturing cognitive causal paths in human reliability analysis with Bayesian network models , 2017, Reliab. Eng. Syst. Saf..