Applicability of human reliability assessment methods to human–computer interfaces

The UK Office of Nuclear Regulation (ONR) has undertaken a Generic Design Assessment of two nuclear power station designs for prospective construction in the UK. This assessment included a review of the Human Reliability Assessments (HRAs) submitted as part of the probabilistic safety assessments (PSAs). Both reactor designs have human–system interfaces driven by digital technology. However, the data and methods for assessing human error probability (HEP) pre-date such technology. Therefore, the ONR sought to establish whether existing HRA methods remain applicable to modern human–interface interactions and hence continue to provide a credible insight into the risk contribution from human error. An extensive literature review was undertaken to identify or derive relevant HEPs. Data have ranged from those associated with particular interface objects, plant start-ups and post-fault diagnoses. There appear to be some interesting paradoxes within the data explored in this paper. Based upon the data reviewed, it is concluded that existing human reliability assessment methods are likely to be optimistic in their estimates of HEPs where diagnosis is involved or where process control is dependent on human–computer interaction. Shortfalls in the availability of published relevant data and the scope of existing HRA methods have been identified by this work.

[1]  Peter W. Fach,et al.  The influence of design decisions on the usability of direct manipulation user interfaces , 1995, Behav. Inf. Technol..

[2]  S J Westerman,et al.  Task analysis for the investigation of human error in safety-critical software design: a convergent methods approach. , 1998, Ergonomics.

[3]  Sheue-Ling Hwang,et al.  A real-time warning model for teamwork performance and system safety in nuclear power plants. , 2009 .

[4]  Stanley R. Parkinson,et al.  Effects of Help Fields on Navigating Through Hierarchical Menu Structures , 1985, Int. J. Man Mach. Stud..

[5]  Mats Lind,et al.  Displaying meta-information in context , 2001, Behav. Inf. Technol..

[6]  Michael Workman,et al.  The effects from technology-mediated interaction and openness in virtual team performance measures , 2007, Behav. Inf. Technol..

[7]  A. D. Swain,et al.  Handbook of human-reliability analysis with emphasis on nuclear power plant applications. Final report , 1983 .

[8]  Susan Wiedenbeck,et al.  The use of icons and labels in an end user application program: An empirical study of learning and retention , 1999, Behav. Inf. Technol..

[9]  Steve J. Westerman,et al.  Age and cognitive ability as predictors of computerized information retrieval , 1995, Behav. Inf. Technol..

[10]  The origins of the SPAR-H method’s performance shaping factor multipliers , 2007, 2007 IEEE 8th Human Factors and Power Plants and HPRCT 13th Annual Meeting.

[11]  Klaus Kaasgaard,et al.  Comparative usability evaluation , 2004, Behav. Inf. Technol..

[12]  Shari Trewin,et al.  A model of keyboard configuration requirements , 1998, Assets '98.

[13]  Vassilis Moustakis,et al.  An experimental evaluation of comprehensibility aspects of knowledge structures derived through induction techniques: A case study of industrial fault diagnosis , 2002, Behav. Inf. Technol..

[14]  Karen Renaud,et al.  Now what was that password again? A more flexible way of identifying and authenticating our seniors , 2007, Behav. Inf. Technol..

[15]  Anker Helms Jørgensen,et al.  Using mouse and keyboard under time pressure: Preference, strategies and learning , 2002, Behav. Inf. Technol..

[16]  John C. McCarthy,et al.  Measuring the quality of computer-mediated communication , 1994, Behav. Inf. Technol..

[17]  Denis Javaux,et al.  A method for predicting errors when interacting with finite state systems. How implicit learning shapes the user's knowledge of a system , 2002, Reliab. Eng. Syst. Saf..

[18]  Sebastian Fischer,et al.  Adaptively shortened pull down menus: location knowledge and selection efficiency , 2008, Behav. Inf. Technol..

[19]  Emilie M. Roth,et al.  An empirical investigation of operator performance in cognitively demanding simulated emergencies , 1994 .

[20]  Knut Nordby,et al.  The expanding telephone number Part 1: Keying briefly presented multiple-digit numbers , 2002, Behav. Inf. Technol..

[21]  Yuan-Liang Su,et al.  The effect of time pressure on expert system based training for emergency management , 1998, Behav. Inf. Technol..

[22]  J.C. Williams,et al.  A data-based method for assessing and reducing human error to improve operational performance , 1988, Conference Record for 1988 IEEE Fourth Conference on Human Factors and Power Plants,.

[23]  Noam Tractinsky,et al.  A theoretical framework and empirical examination of the effects of foreign and translated interface language , 2000, Behav. Inf. Technol..

[24]  Avi Parush,et al.  An empirical evaluation of textual display configurations for supervisory tasks , 2004, Behav. Inf. Technol..

[25]  A. D. Swain Accident Sequence Evaluation Program: Human reliability analysis procedure , 1987 .

[26]  Jochen Müsseler,et al.  Complexity of user interfaces: Can it be reduced by a mode key? , 1996, Behav. Inf. Technol..

[27]  I. Scott MacKenzie,et al.  An empirical investigation of the novice experience with soft keyboards , 2001, Behav. Inf. Technol..