Single operator, multiple robots: an eye movement based theoretic model of operator situation awareness

For a single operator to effectively control multiple robots, operator situation awareness is a critical component of the human-robot system. There are three levels of situation awareness: perception, comprehension, and projection into the future [1]. We focus on the perception level to develop a theoretic model of the perceptual-cognitive processes underlying situation awareness. Eye movement measures were developed as indicators of cognitive processing and these measures were used to account for operator situation awareness on a supervisory control task. The eye movement based model emphasizes the importance of visual scanning and attention allocation as the cognitive processes that lead to operator situation awareness and the model lays the groundwork for real-time prediction of operator situation awareness.

[1]  Johnell Brooks,et al.  Effects of remote and in-person verbal interactions on verbalization rates and attention to dynamic spatial scenes. , 2004, Accident Analysis and Prevention.

[2]  Carl Nehme,et al.  Modeling human supervisory control in heterogeneous unmanned vehicle systems , 2009 .

[3]  Glenn F. Wilson,et al.  Operator Functional State Classification Using Multiple Psychophysiological Features in an Air Traffic Control Task , 2003, Hum. Factors.

[4]  Mary L. Cummings,et al.  Predicting Controller Capacity in Supervisory Control of Multiple UAVs , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[5]  Mica R. Endsley,et al.  Distribution of Attention, Situation Awareness and Workload in a Passive Air Traffic Control Task: Implications for Operational Errors and Automation , 1998 .

[6]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.

[7]  C. Y. Peng,et al.  An Introduction to Logistic Regression Analysis and Reporting , 2002 .

[8]  Michael A. Goodrich,et al.  Validating human-robot interaction schemes in multitasking environments , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[9]  K. Rayner.  Eye movements in reading and information processing. , 1978, Psychological bulletin.

[10]  Christopher D. Wickens,et al.  Attentional Models of Multitask Pilot Performance Using Advanced Display Technology , 2003, Hum. Factors.

[11]  Leo Gugerty.  Situational Awareness in Driving , 2011 .

[12]  J. Gregory Trafton,et al.  Preparing to resume an interrupted task: effects of prospective goal encoding and retrospective rehearsal , 2003, Int. J. Hum. Comput. Stud..

[13]  Mica R. Endsley,et al.  Attention Distribution and Decision Making in Tactical Air Combat , 1996, Hum. Factors.

[14]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[15]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[16]  Leo Gugerty.  Evidence from a Partial Report Task for Forgetting in Dynamic Spatial Memory , 1998, Hum. Factors.

[17]  Christopher D. Wickens,et al.  Display Formatting Techniques for Improving Situation Awareness in the Aircraft Cockpit , 1991 .

[18]  Neville Stanton,et al.  Situation awareness measurement: a review of applicability for C4i environments. , 2006, Applied ergonomics.

[19]  Raj M. Ratwani,et al.  Developing a Predictive Model of Postcompletion Errors , 2009 .

[20]  Mica R. Endsley,et al.  Measurement of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[21]  L. Gugerty.  Situation Awareness During Driving: Explicit and Implicit Knowledge in Dynamic Spatial Memory , 1997 .

[22]  Gregory J. Zelinsky,et al.  Using eye movements to study working memory rehearsal for objects in visual scenes , 2009 .

[23]  C. Wickens,et al.  Situation Awareness, Mental Workload, and Trust in Automation: Viable, Empirically Supported Cognitive Engineering Constructs , 2008 .

[24]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[25]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[26]  Raj M. Ratwani,et al.  Predicting postcompletion errors using eye movements , 2008, CHI.

[27]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[28]  M R Endsley,et al.  Sources of situation awareness errors in aviation. , 1996, Aviation, space, and environmental medicine.

[29]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[30]  Christopher D. Wickens,et al.  Eye-tracking and Individual Differences in off-Normal Event Detection when Flying with a Synthetic Vision System Display , 2004 .

[31]  Glenn F. Wilson,et al.  Performance Enhancement in an Uninhabited Air Vehicle Task Using Psychophysiologically Determined Adaptive Aiding , 2007, Hum. Factors.

[32]  William J Horrey,et al.  Modeling drivers' visual attention allocation while interacting with in-vehicle technologies. , 2006, Journal of experimental psychology. Applied.