Using Eye-Tracking to Investigate Strategy and Performance of Expert and Novice Control Room Operators

The strategies of expert and novice petrochemical control room operators were investigated using eye-tracking as they monitored and corrected a crude refinement simulation. Plotted scan paths were used to investigate the differences in eye behavior of three expert control room operators and six novice students. The effects of expertise and interface type on participant eye movements were evaluated. Scan path analysis revealed that monitoring strategy and interface type influenced how quickly participants were able to detect changes on-screen, though monitoring strategy did not depend on expertise level. Overall, eye-tracking successfully identified the effects of monitoring strategy and interface type on performance.

[1]  Stuart Oskamp,et al.  The relationship of clinical experience and training methods to several criteria of clinical prediction. , 1962 .

[2]  Terry C. Lansdown,et al.  The mind's eye: cognitive and applied aspects of eye movement research , 2005 .

[3]  S. Kay.  On the Nature of Expertise. , 1992 .

[4]  P. Chapman,et al.  Visual Search of Driving Situations: Danger and Experience , 1998, Perception.

[5]  Shailey Minocha,et al.  Combining Eye Tracking and Conventional Techniques for Indications of User-Adaptability , 2005, INTERACT.

[6]  Sheue-Ling Hwang,et al.  An experimental study on the information design of CRT display in process control systems , 1995 .

[7]  Himalaya Patel,et al.  An Improved Usability Measure Based on Novice and Expert Performance , 2011, Int. J. Hum. Comput. Interact..

[8]  S. Kumar.  Advances in Occupational Ergonomics and Safety , 1998 .

[9]  Linden J. Ball,et al.  Eye Tracking in Human-Computer Interaction and Usability Research : Current Status and Future Prospects , 2004 .

[10]  M. Chi,et al.  The Nature of Expertise , 1988 .

[11]  J. Shanteau.  The Psychology of Experts An Alternative View , 1992 .

[12]  Haruhiko Takeuchi,et al.  A Quantitative Method for Analyzing Scan Path Data Obtained by Eye Tracker , 2007, 2007 IEEE Symposium on Computational Intelligence and Data Mining.

[13]  Joseph C. Hickox,et al.  Eye Scan Patterns of Experienced and Novice Pilots during Visual Flight Rules (VFR) Navigation , 1999 .

[14]  K. A. Ericsson,et al.  Recent advances in expertise research: a commentary on the contributions to the special issue , 2005 .

[15]  John R. Anderson.  ACT: A simple theory of complex cognition. , 1996 .

[16]  Rajkumar S. Pant,et al.  A Comparative Study of Cognitive Strategies Used to Resolve Air Traffic Conflict between Air Traffic Controllers and General Population Using Eye Tracking Machine , 2010 .

[17]  R. Säljö,et al.  Expertise Differences in the Comprehension of Visualizations: a Meta-Analysis of Eye-Tracking Research in Professional Domains , 2011 .

[18]  Daniel G. Morrow,et al.  Expertise Differences in Attentional Strategies Related to Pilot Decision Making , 2008, Hum. Factors.

[19]  Ebbe B. Ebbesen,et al.  Decision Making and Information Integration in the Courts: The Setting of Bail , 1975 .

[20]  Melroy E. D'Souza.  The Design of a Visual Display for the Presentation of Statistical Quality Control Information to Operators on the Plant Floor , 1999, Hum. Factors.

[21]  Hélène Eyrolle,et al.  Expertise in dynamic environments , 1997 .

[22]  Gary Klein,et al.  Naturalistic Decision Making , 2008, Hum. Factors.

[23]  Dianne Cyr,et al.  Colour appeal in website design within and across cultures: A multi-method evaluation , 2010, Int. J. Hum. Comput. Stud..

[24]  Catherine M. Burns,et al.  Navigation strategies with ecological displays , 2000, Int. J. Hum. Comput. Stud..

[25]  D C Hampton.  Expertise: The true essence of nursing art , 1994, ANS. Advances in nursing science.

[26]  Janet A. Sniezek,et al.  Revision, Weighting, and commitment in consensus group judgment , 1990 .

[27]  K J Vicente,et al.  Memory recall in a process control system: a measure of expertise and display effectiveness , 1992, Memory & cognition.

[28]  Christine M. Mitchell,et al.  Cognitive Attributes: Implications for Display Design in Supervisory Control Systems , 1986, Int. J. Man Mach. Stud..

[29]  Stefano Federici,et al.  Gaze and eye-tracking solutions for psychological research , 2012, Cognitive Processing.

[30]  Mehmet Gokturk,et al.  Eye-tracking measures and human performance in a vigilance task. , 2002, Aviation, space, and environmental medicine.

[31]  Alexander Pollatsek,et al.  Novice Driver Crashes: Failure to Divide Attention or Failure to Recognize Risks , 2006 .

[32]  Craig M. Harvey,et al.  Performance Metrics for Evaluating Petro-chemical Control Room Displays , 2013 .

[33]  Hirotaka Aoki,et al.  Eye-tracking analysis of skilled performance in clinical extracorporeal circulation , 2012, Journal of Artificial Organs.

[34]  Michael Day,et al.  Training simulation for helicopter navigation by characterizing visual scan patterns. , 2011, Aviation, space, and environmental medicine.

[35]  C. Wickens,et al.  Visual scanning and pilot expertise: the role of attentional flexibility and mental model development. , 1997, Aviation, space, and environmental medicine.

[36]  Gunnar Johannsen.  Conceptual design of multi-human machine interfaces , 1995 .

[37]  Jerzy Grobelny,et al.  The role of colour preattentive processing in human-computer interaction task efficiency: a preliminary study , 2008, ArXiv.

[38]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[39]  Christopher D. Wickens,et al.  Pilots' Monitoring Strategies and Performance on Automated Flight Decks: An Empirical Study Combining Behavioral and Eye-Tracking Data , 2007, Hum. Factors.

[40]  Paul M. Fitts,et al.  Eye movements of aircraft pilots during instrument-landing approaches. , 1950 .

[41]  Margaret A. Nemeth,et al.  Applied Multivariate Methods for Data Analysis , 1998, Technometrics.

[42]  Rain Chen,et al.  Effects of color sample display and color sample grouping on screen layout usability for customized product color selection , 2010, Comput. Hum. Behav..

[43]  Colin Swindells,et al.  Surgeon's vigilance in the operating room. , 2011, American journal of surgery.