Estimating the quantitative relation between PSFs and HEPs from full-scope simulator data

Abstract For probabilistically assessing the risks of nuclear power plants, human reliability analyses (HRAs) have been conducted to systematically predict human error probabilities (HEPs) of significant tasks that might affect system safety. To improve quality in the HRA results, solid empirical evidence for quantitative relations between performance shaping factors (PSFs) and HEPs is required. For generating the empirical evidence, the HRA data including human reliability data and contextual data should be collected and the quantitative relations between PSFs and HEPs should be properly estimated. In this study, in order to validate the statistical estimation approach for the relation between PSFs and HEPs, the simulation records of operator training programs that were performed via full-scope simulators were collected and analyzed by the HuREX (Human Reliability data EXtraction) framework. The simulator data including more than 10,000 data points are then statistically analyzed by a logistic regression analysis method. From the statistical process, the significant variables affecting human reliability are deduced, and the PSF multipliers for each significant variable are estimated. The potentials and challenges of the statistical approach are discussed from the obtained results.

[1]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[2]  Wondea Jung,et al.  A classification scheme of erroneous behaviors for human error probability estimations based on simulator data , 2017, Reliab. Eng. Syst. Saf..

[3]  Richard Burns,et al.  Business Research Methods and Statistics Using SPSS , 2008 .

[4]  Emilie M. Roth,et al.  The SACADA database for human reliability and human performance , 2014, Reliab. Eng. Syst. Saf..

[5]  O. Sträter.  A Method for Human Reliability Data Collection and Assessment , 1996 .

[6]  Wondea Jung,et al.  OPERA - a human performance database under simulated emergencies of nuclear power plants , 2007, Reliab. Eng. Syst. Saf..

[7]  John A. Forester,et al.  Human Reliability Analysis (HRA) Good Practices , 2004 .

[8]  Julian J. Faraway,et al.  Practical Regression and Anova using R , 2002 .

[9]  Barry Kirwan,et al.  The development of a nuclear chemical plant human reliability management approach: HRMS and JHEDI☆ , 1997 .

[10]  E. A. Trager.  The Human Performance Event Database (HPED) , 1997, Proceedings of the 1997 IEEE Sixth Conference on Human Factors and Power Plants, 1997. 'Global Perspectives of Human Factors in Power Generation'.

[11]  Daeil Lee,et al.  An experimental investigation on relationship between PSFs and operator performances in the digital main control room , 2017 .

[12]  Wondea Jung,et al.  A framework to estimate task opportunities from the operational experience of domestic nuclear power plants , 2016 .

[13]  Salvatore Miranda,et al.  An Overview of Human Reliability Analysis Techniques in Manufacturing Operations , 2013 .

[14]  A. J. Spurgin,et al.  Advances in human reliability analysis methodology. Part I: frameworks, models and data , 1994 .

[15]  Yanchang Zhao.  R and Data Mining: Examples and Case Studies , 2012 .

[16]  Wondea Jung,et al.  Use of a Big Data Mining Technique to Extract Relative Importance of Performance Shaping Factors from Event Investigation Reports , 2017 .

[17]  D.I. Gertman,et al.  NUCLARR and human reliability: data sources and data profile , 1988, Conference Record for 1988 IEEE Fourth Conference on Human Factors and Power Plants,.

[18]  Li Zhang,et al.  Human Reliability Analysis for Digitized Nuclear Power Plants: Case Study on the LingAo II Nuclear Power Plant , 2017 .

[19]  Poong Hyun Seong,et al.  An empirical study on the human error recovery failure probability when using soft controls in NPP advanced MCRs , 2014 .

[20]  Zhizhong Li,et al.  Human Error Data Collection and Comparison with Predictions by SPAR‐H , 2014, Risk analysis : an official publication of the Society for Risk Analysis.

[21]  Poong Hyun Seong,et al.  Quantification of performance shaping factors (PSFs)’ weightings for human reliability analysis (HRA) of low power and shutdown (LPSD) operations , 2017 .

[22]  Viv Bewick,et al.  Statistics review 14: Logistic regression , 2005, Critical care.

[23]  Wondea Jung,et al.  A Survey of Data-based Human Reliability Analysis Approaches , 2014 .

[24]  Ali Mosleh,et al.  Development of a Leading Performance Indicator from Operational Experience and Resilience in a Nuclear Power Plant , 2016 .

[25]  Erik Hollnagel,et al.  Cognitive reliability and error analysis method : CREAM , 1998 .

[26]  C. Mood.  Logistic Regression: Why We Cannot Do What We Think We Can Do, and What We Can Do About It , 2010 .

[27]  B. Kirwan,et al.  CORE-DATA: a computerised human error database for human reliability support , 1997, Proceedings of the 1997 IEEE Sixth Conference on Human Factors and Power Plants, 1997. 'Global Perspectives of Human Factors in Power Generation'.

[28]  Inseok Jang,et al.  A statistical approach to estimating effects of performance shaping factors on human error probabilities of soft controls , 2015, Reliab. Eng. Syst. Saf..

[29]  E. Ramaraj,et al.  Predictive Analytics Using Rule Based Classification And Hybrid Logistic Regression(HLR) Algorithm For Decision Making , 2019 .

[30]  NUREG/CR-6949, "The Employment of Empirical Data and Bayesian Methods in Human Reliability Analysis: A Feasibility Study." , 2008 .

[31]  Erasmia Lois,et al.  The use of empirical data sources in HRA , 2004, Reliab. Eng. Syst. Saf..

[32]  B. G. Gilbert,et al.  Nuclear Computerized Library for Assessing Reactor Reliability (NUCLARR): Data manual. Part 2: Human error probability (HEP) data; Volume 5, Revision 4 , 1990 .

[33]  Cosma Rohilla Shalizi,et al.  Advanced Data Analysis from an Elementary Point of View , 2012 .

[34]  A. D. Swain,et al.  Handbook of human-reliability analysis with emphasis on nuclear power plant applications. Final report , 1983 .

[35]  Wondea Jung,et al.  HuREX - A framework of HRA data collection from simulators in nuclear power plants , 2020, Reliab. Eng. Syst. Saf..

[36]  Mario Hellmich,et al.  Human error probabilities from operational experience of German nuclear power plants , 2013, Reliab. Eng. Syst. Saf..