A statistical approach to estimating effects of performance shaping factors on human error probabilities of soft controls

Despite recent efforts toward data collection for supporting human reliability analysis, there remains a lack of empirical basis in determining the effects of performance shaping factors (PSFs) on human error probabilities (HEPs). To enhance the empirical basis regarding the effects of the PSFs, a statistical methodology using a logistic regression and stepwise variable selection was proposed, and the effects of the PSF on HEPs related with the soft controls were estimated through the methodology. For this estimation, more than 600 human error opportunities related to soft controls in a computerized control room were obtained through laboratory experiments. From the eight PSF surrogates and combinations of these variables, the procedure quality, practice level, and the operation type were identified as significant factors for screen switch and mode conversion errors. The contributions of these significant factors to HEPs were also estimated in terms of a multiplicative form. The usefulness and limitation of the experimental data and the techniques employed are discussed herein, and we believe that the logistic regression and stepwise variable selection methods will provide a way to estimate the effects of PSFs on HEPs in an objective manner.

[1]  Erasmia Lois,et al.  The use of empirical data sources in HRA , 2004, Reliab. Eng. Syst. Saf..

[2]  Rolf Johan Bye,et al.  Operational and organizational barriers as means of enhancing safety and learning , 2014 .

[3]  Poong Hyun Seong,et al.  An empirical study on the basic human error probabilities for NPP advanced main control room operation using soft control , 2013 .

[4]  Poong Hyun Seong,et al.  An empirical study on the human error recovery failure probability when using soft controls in NPP advanced MCRs , 2014 .

[5]  C. Mood.  Logistic Regression: Why We Cannot Do What We Think We Can Do, and What We Can Do About It , 2010 .

[6]  Kyung S. Park,et al.  Considering performance shaping factors in situation-specific human error probabilities , 1996 .

[7]  Curtis L. Smith,et al.  A Bayesian method for using simulator data to enhance human error probabilities assigned by existing HRA methods , 2014, Reliab. Eng. Syst. Saf..

[8]  Zhizhong Li,et al.  Human Error Data Collection and Comparison with Predictions by SPAR‐H , 2014, Risk analysis : an official publication of the Society for Risk Analysis.

[9]  Jaewhan Kim,et al.  Empirical investigation of communication characteristics under a computer-based procedure in an advanced control room , 2012 .

[10]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[11]  Barry Kirwan,et al.  Nuclear action reliability assessment (NARA): a data-based HRA tool , 2005 .

[12]  Andreas Bye,et al.  A Study on How Time Pressure and Information Load Affects Operators Performance in Accident Scenarios (PSAM-0344) , 2006 .

[13]  Ronald L. Boring,et al.  Human Reliability Analysis for Control Room Upgrades , 2009 .

[14]  Ronald L. Boring,et al.  Framework for the Human Event Repository and Analysis (HERA) System and Its Use to Quantify Human Actions (PSAM-0224) , 2006 .

[15]  Richard Burns,et al.  Business Research Methods and Statistics Using SPSS , 2008 .

[16]  Julian J. Faraway,et al.  Practical Regression and Anova using R , 2002 .

[17]  Sophia Rabe-Hesketh,et al.  Structural Equation Models , 2005 .

[18]  Huafei Liao,et al.  Leveraging Existing Human Performance Data for Quantifying the IDHEAS HRA Method. , 2013 .

[19]  Ronald L. Boring,et al.  Extracting and converting quantitative data into human error probabilities , 2007, 2007 IEEE 8th Human Factors and Power Plants and HPRCT 13th Annual Meeting.

[20]  Andreas Bye,et al.  Capturing control room simulator data with the HERA System , 2007, 2007 IEEE 8th Human Factors and Power Plants and HPRCT 13th Annual Meeting.

[21]  Paolo Trucco,et al.  Modelling and assessment of dependent performance shaping factors through Analytic Network Process , 2011, Reliab. Eng. Syst. Saf..

[22]  Jinkyun Park.  Scrutinizing inter-relations between performance influencing factors and the performance of human operators pertaining to the emergency tasks of nuclear power plant – An explanatory study , 2011 .

[23]  Wondea Jung,et al.  OPERA - a human performance database under simulated emergencies of nuclear power plants , 2007, Reliab. Eng. Syst. Saf..

[24]  Sankaran Mahadevan,et al.  Inclusion of fatigue effects in human reliability analysis , 2011, Reliab. Eng. Syst. Saf..

[25]  B. Kirwan,et al.  CORE-DATA: a computerised human error database for human reliability support , 1997, Proceedings of the 1997 IEEE Sixth Conference on Human Factors and Power Plants, 1997. 'Global Perspectives of Human Factors in Power Generation'.

[26]  Luca Podofillini,et al.  A Bayesian approach to treat expert-elicited probabilities in human reliability analysis model construction , 2013, Reliab. Eng. Syst. Saf..

[27]  Viv Bewick,et al.  Statistics review 14: Logistic regression , 2005, Critical care.

[28]  Barry Kirwan,et al.  The development of a nuclear chemical plant human reliability management approach: HRMS and JHEDI☆ , 1997 .

[29]  Luca Podofillini,et al.  MEASURING THE INFLUENCE OF TASK COMPLEXITY ON HUMAN ERROR PROBABILITY: AN EMPIRICAL EVALUATION , 2013 .

[30]  Carol Smidts,et al.  Human reliability modeling for the Next Generation System Code , 2013 .

[31]  Wondea Jung,et al.  Measuring variability of procedure progression in proceduralized scenarios , 2012 .

[32]  Jinkyun Park.  The Complexity of Proceduralized Tasks , 2009 .

[33]  Emilie M. Roth,et al.  The SACADA database for human reliability and human performance , 2014, Reliab. Eng. Syst. Saf..

[34]  B Kirwan,et al.  The validation of three human reliability quantification techniques--THERP, HEART and JHEDI: Part II--Results of validation exercise. , 1997, Applied ergonomics.

[35]  Barry Kirwan,et al.  Nuclear Action Reliability Assessment (NARA): A Data-Based HRA Tool , 2005 .

[36]  Oliver Sträter,et al.  Assessment of human reliability based on evaluation of plant experience: requirements and implementation , 1999 .

[37]  Poong Hyun Seong,et al.  ADVANCED MMIS TOWARD SUBSTANTIAL REDUCTION IN HUMAN ERRORS IN NPPS , 2013 .

[38]  Wondea Jung,et al.  A Survey of Data-based Human Reliability Analysis Approaches , 2014 .

[39]  David Heckerman,et al.  A Tutorial on Learning with Bayesian Networks , 1998, Learning in Graphical Models.

[40]  Mario Hellmich,et al.  Human error probabilities from operational experience of German nuclear power plants , 2013, Reliab. Eng. Syst. Saf..

[41]  Cosma Rohilla Shalizi,et al.  Advanced Data Analysis from an Elementary Point of View , 2012 .

[42]  Ali Mosleh,et al.  A data-informed PIF hierarchy for model-based Human Reliability Analysis , 2012, Reliab. Eng. Syst. Saf..

[43]  Wondea Jung,et al.  A taxonomy of performance influencing factors for human reliability analysis of emergency tasks , 2003 .

[44]  P. Clare Goodman,et al.  Human Factors Information System: A Tool to Assess Error Related to Human Performance in U.S. Nuclear Power Plants , 1991 .

[45]  A. D. Swain,et al.  Handbook of human-reliability analysis with emphasis on nuclear power plant applications. Final report , 1983 .

[46]  Ali Mosleh,et al.  Deriving causal Bayesian networks from human reliability analysis data: A methodology and example model , 2012 .

[47]  L. Mkrtchyan,et al.  A survey of Bayesian Belief Network Applications in Human Reliability Analysis , 2014 .

[48]  Wondea Jung,et al.  Empirical investigation of workloads of operators in advanced control rooms , 2014 .

[49]  John Quigley,et al.  Merging expert and empirical data for rare event frequency estimation: Pool homogenisation for empirical Bayes models , 2011, Reliab. Eng. Syst. Saf..

[50]  B Kirwan,et al.  Human error identification in human reliability assessment. Part 1: Overview of approaches. , 1992, Applied ergonomics.

[51]  B Kirwan,et al.  Human error identification in human reliability assessment. Part 2: Detailed comparison of techniques. , 1992, Applied ergonomics.

[52]  Per Øivind Braarud,et al.  Task Complexity: What Challenges the Crew and How Do They Cope , 2010 .

[53]  M. Kendall.  Statistical Methods for Research Workers , 1937, Nature.