Trends in HFE Methods and Tools and Their Applicability to Safety Reviews

The U.S. Nuclear Regulatory Commission's (NRC) conducts human factors engineering (HFE) safety reviews of applicant submittals for new plants and for changes to existing plants. The reviews include the evaluation of the methods and tools (M&T) used by applicants as part of their HFE program. The technology used to perform HFE activities has been rapidly evolving, resulting in a whole new generation of HFE M&Ts. The objectives of this research were to identify the current trends in HFE methods and tools, determine their applicability to NRC safety reviews, and identify topics for which the NRC may need additional guidance to support the NRC's safety reviews. We conducted a survey that identified over 100 new HFE M&Ts. The M&Ts were assessed to identify general trends. Seven trends were identified: Computer Applications for Performing Traditional Analyses, Computer-Aided Design, Integration of HFE Methods and Tools, Rapid Development Engineering, Analysis of Cognitive Tasks, Use of Virtual Environments and Visualizations, and Application of Human Performance Models. We assessed each trend to determine its applicability to the NRC's review by considering (1) whether the nuclear industry is making use of M&Ts for each trend, and (2) whether M&Ts reflecting the trend can be reviewed using themore » current design review guidance. We concluded that M&T trends that are applicable to the commercial nuclear industry and are expected to impact safety reviews may be considered for review guidance development. Three trends fell into this category: Analysis of Cognitive Tasks, Use of Virtual Environments and Visualizations, and Application of Human Performance Models. The other trends do not need to be addressed at this time.« less

[1]  Kevin Crowston,et al.  What is coordination theory and how can it help design cooperative work systems? , 1990, CSCW '90.

[2]  Margaret S. Salter,et al.  Training and Assessment of Decision-Making Skills in Virtual Environments , 2001 .

[3]  Jens Rasmussen,et al.  Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[4]  M. T. Lawless,et al.  Using micro saint to predict performance in a nuclear power plant control room , 1995 .

[5]  David Notkin,et al.  Software Reflexion Models: Bridging the Gap between Design and Implementation , 2001, IEEE Trans. Software Eng..

[6]  Elizabeth Bowman,et al.  Command and Control in Complex and Urban Terrain: Human Performance Modeling , 2005 .

[7]  Howard Eisner.  Managing Complex Systems: Thinking outside the Box , 2005 .

[8]  L. F. Hanes,et al.  Capturing undocumented worker-job-knowledge at electric utilities: the EPRI strategic project , 2002, Proceedings of the IEEE 7th Conference on Human Factors and Power Plants.

[9]  F Kockler,et al.  Systems Engineering Management Guide , 1990 .

[10]  John M. O'Hara,et al.  Human Factors Engineering Program Review Model , 2004 .

[11]  Gerrit C. van der Veer,et al.  DUTCH: Designing for Users and Tasks from Concepts to Handles , 2003 .

[12]  Jens Rasmussen,et al.  The role of hierarchical knowledge representation in decisionmaking and system management , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[13]  Jean Hollis Weber.  Is the Help Helpful?: How to Create Online Help That Meets Your Users' Needs , 2004 .

[14]  M. van Welie,et al.  Task-based User Interface Design , 2001 .

[15]  J. M. OHara,et al.  Human-system interface design review guideline: The development of draft revision 1 to NUREG-0700 , 1996 .

[16]  L. F. Hanes,et al.  Use of 2.5-D and 3-D technology to evaluate control room upgrades , 2006 .

[17]  T. Balkin,et al.  Fatigue models for applied research in warfighting. , 2004, Aviation, space, and environmental medicine.

[18]  Gary Klein,et al.  Working Minds: A Practitioner's Guide to Cognitive Task Analysis , 2006 .

[19]  Douglas Schuler,et al.  Participatory Design: Principles and Practices , 1993 .

[20]  Barbara Miller.  Defense Technical Information Center (DTIC) , 2008 .

[21]  W. E. Carnes,et al.  Lessons learned: improving performance through organizational learning , 2002, Proceedings of the IEEE 7th Conference on Human Factors and Power Plants.

[22]  Albrecht Schmidt,et al.  Multi-Sensor Context-Awareness in Mobile Devices and Smart Artifacts , 2002, Mob. Networks Appl..

[23]  Michael D. Harrison,et al.  Allocation of function: scenarios, context and the economics of effort , 2000, Int. J. Hum. Comput. Stud..

[24]  Richard W. Pew,et al.  Human-system integration in the system development process : a new look , 2007 .

[25]  R. Laughery,et al.  Discrete event simulation as a tool to determine necessary nuclear power plant operating crew size , 1996, Proceedings Winter Simulation Conference.

[26]  R. J. Eckenrode,et al.  A status report regarding industry implementation of safety parameter display systems , 1989 .

[27]  Brett Walters,et al.  An Evaluation of Task Network Modeling for Use in Simulating Situation Awareness , 2000 .

[28]  Andrew S. Gordon.  Authoring branching storylines for training applications , 2004 .

[29]  Cecile Paris,et al.  Environments for the Construction and Use of Task Models , 2003 .

[30]  Frank Spillers,et al.  Task Analysis through Cognitive Archeology. , 2003 .

[31]  Wesley E. Woodson,et al.  Human Factors Design Handbook , 1981 .

[32]  Barry Kirwan,et al.  A Guide To Task Analysis: The Task Analysis Working Group , 1992 .

[33]  B. Nardi.  Context and consciousness: activity theory and human-computer interaction , 1995 .

[34]  Brett Walters,et al.  Predicting nuclear power-plant operator performance using discrete event simulation , 2005, Cognition, Technology & Work.

[35]  Eamonn O'Neill,et al.  Participatory task modelling: users and developers modelling users' tasks and domains , 2004, TAMODIA '04.

[36]  Tom Olzak.  Keystroke Logging , 2011, Encyclopedia of Cryptography and Security.

[37]  Perry Edwards.  Systems Analysis, Design and Development with Structured Concepts , 1985 .

[38]  Karel Vredenburg,et al.  The state of user-centered design practice , 2005, IEEE Engineering Management Review.

[39]  Donald Davidson,et al.  The Effect of Vehicle Noise and Vibration (Caused by Moving Operations) on Cognitive Performance in the Command and Control Vehicle. , 1995 .

[40]  Kent Larson,et al.  MITes: Wireless Portable Sensors for Studying Behavior , 2004 .

[41]  Mark E. Sampson,et al.  INCOSE Tools Database Working Group Report , 1997 .

[42]  Joshua R. Smith,et al.  RFID-based techniques for human-activity detection , 2005, Commun. ACM.

[43]  Teresa Alley.  Directory of Design Support Methods , 2005 .

[44]  J. C. Higgins,et al.  Human Factors Considerations with Respect to Emerging Technology in Nuclear Power Plants , 2008 .

[45]  Robert W. Bailey,et al.  Human performance engineering: A guide for system designers , 1982 .

[46]  Robert H. McKim,et al.  Human engineering guide to equipment design , 1963 .

[47]  R. Sola,et al.  Learning organizations for nuclear safety , 2002, Proceedings of the IEEE 7th Conference on Human Factors and Power Plants.

[48]  Randall J. Mumaw,et al.  Evaluation Issues for Computer-Based Control Rooms , 1991 .

[49]  Robert J. Pleban,et al.  Using Virtual Environments for Conducting Small Unit Dismounted Mission Rehearsals , 2003 .

[50]  W. Lepecki.  Determination of technological know-how of ELETRONUCLEAR , 2002, Proceedings of the IEEE 7th Conference on Human Factors and Power Plants.

[51]  Dimitrios Tsoumakos,et al.  A Framework for Distributed Human Tracking , 2005, PDPTA.

[52]  Albert Rainer.  Business Process Modeling for E-Business , 2001 .

[53]  A. W. Melton,et al.  Psychological Principles in System Development , 1962 .

[54]  Harold R. Booher,et al.  Handbook of Human Systems Integration , 2003 .

[55]  Jens Rasmussen,et al.  Cognitive Systems Engineering , 2022 .

[56]  Colin Renfrew,et al.  The Ancient Mind: Elements of Cognitive Archaeology , 1997 .

[57]  Penelope M. Sanderson.  Cognitive work analysis and the analysis, design, and evaluation of human-computer interactive systems , 1998, Proceedings 1998 Australasian Computer Human Interaction Conference. OzCHI'98 (Cat. No.98EX234).

[58]  J. Persensky,et al.  Network Modeling of Nuclear Operator Procedures , 1994 .

[59]  J. D. Beattie,et al.  Development of a Human Factors Engineering Program for the Canadian Nuclear Industry , 1991 .

[60]  Kim J. Vicente,et al.  Ecological Interface Design: Progress and Challenges , 2002, Hum. Factors.

[61]  Neville A. Stanton,et al.  Book preview , 2003, INTR.

[62]  Shelly Scott-Nash,et al.  Discrete event simulation as a tool to determine necessary nuclear power plant operating crew size , 1996, Winter Simulation Conference.

[63]  John W. Satzinger,et al.  Systems Analysis and Design in a Changing World , 2000 .

[64]  IEEE Std 1220-2005 IEEE Standard for Application and Management of the Systems Engineering Process , 2007 .

[65]  Robert G. Kinkade,et al.  Human Engineering Guide to Equipment Design , 1973 .

[66]  John H. Bailey,et al.  Virtual spaces and real world places: transfer of route knowledge , 1996, Int. J. Hum. Comput. Stud..