Review of Methods Related to Assessing Human Performance in Nuclear Power Plant Control Room Simulations

With the increased use of digital systems in Nuclear Power Plant (NPP) control rooms comes a need to thoroughly understand the human performance issues associated with digital systems. A common way to evaluate human performance is to test operators and crews in NPP control room simulators. However, it is often challenging to characterize human performance in meaningful ways when measuring performance in NPP control room simulations. A review of the literature in NPP simulator studies reveals a variety of ways to measure human performance in NPP control room simulations including direct observation, automated computer logging, recordings from physiological equipment, self-report techniques, protocol analysis and structured debriefs, and application of model-based evaluation. These methods and the particular measures used are summarized and evaluated.

[1]  Emilie M. Roth.  Operator Performance in Cognitively Complex Simulated Emergencies; Implications for Computer-Based Support Systems , 1994 .

[2]  A Sebok,et al.  Team performance in process control: influences of interface design and staffing levels , 2000, Ergonomics.

[3]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[4]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[5]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[6]  David I. Gertman.  Conversion of a mainframe simulation for maintenance performance to a PC environment , 1992 .

[7]  W. Kintsch,et al.  The representation of meaning in memory , 1974 .

[8]  S. A. Converse,et al.  Evaluation of the computerized procedures Manual II (COPMA II) , 1995 .

[9]  David N. Hogg,et al.  Development of a situation awareness measure to evaluate advanced alarm systems in nuclear power plant control rooms , 1995 .

[10]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[11]  David E. Kieras,et al.  The GOMS family of user interface analysis techniques: comparison and contrast , 1996, TCHI.

[12]  John M. O'Hara,et al.  Computer-Based Procedure Systems: Technical Basis and Human Factors Review Guidance , 2000 .

[13]  Mustapha Mouloua,et al.  Automation Technology and Human Performance: Current Research and Trends , 1999 .

[14]  J. Persensky,et al.  Network Modeling of Nuclear Operator Procedures , 1994 .

[15]  John R. Anderson,et al.  Human memory: An adaptive perspective. , 1989 .

[16]  Ron Henderson,et al.  A comparison of the four prominent user-based methods for evaluating the usability of computer software , 1995 .

[17]  F. Jeffroy,et al.  From safety assessment to research in the domain of human factors: the case of operation with computerised procedures , 1997, Proceedings of the 1997 IEEE Sixth Conference on Human Factors and Power Plants, 1997. 'Global Perspectives of Human Factors in Power Generation'.