Improving Human-Robot Interaction through Interface Evolution

In remote robot operations, the human operator(s) and robot(s) are working in different locations that are not within line of sight of each other. In this situation, the human’s knowledge of the robot’s surroundings, location, activities and status is gathered solely through the interface. Depending on the work context, having a good understanding of the robot’s state can be critical. Insufficient knowledge in an urban search and rescue (USAR) situation, for example, may result in the operator driving the robot into a shaky support beam, causing a secondary collapse. While the robot‘s sensors and autonomy modes should help avoid collisions, in some cases the human must direct the robots‘ operation. If the operator does not have good awareness of the robot’s state, the robot can be more of a detriment to the task than a benefit. The human’s comprehension of the robot’s state and environment is known as situation awareness (SA). Endsley developed the most generally accepted definition for SA: “The perception of elements in the environment within a volume of time and space [Level 1 SA], the comprehension of their meaning [Level 2 SA ] and the projection of their status in the near future [Level 3 SA]” (Endsley, 1988). Drury, Scholtz, and Yanco (2003) redefined this definition of situation awareness to make it mo re specific to robot operations, breaking it into five categories: human-robot awareness (the human’s understanding of the robot), human-human awareness, robot-human awareness (the robot’s information about the human), robot-robot awareness, and the humans’ overall mission awareness. In this chapter, we focus on two of the five types of awarene ss that relate to a case in which one human operator is working with one robot: human-robot awareness and the human’s overall mission awareness. Adams (2007) discusses the implications for human-unmanned vehicle SA at each of the three levels of SA (perception, comprehension, and projection). In Drury, Keyes, and Yanco (2007), human-robot awareness is further decomposed into five types to aid in assessing the operator’s understanding of the robot: location awareness, activity awareness, surroundings awareness, status awareness and overall mission awareness (LASSO). The two types that are primarily addressed in this chapter are location awareness and surroundings awareness. Location awareness is the operator’s knowledge of where the robot is situated on a larger scale (e.g., knowing where the robot is from where it started or that it is at a certain point on a map). Surroundings awareness is the knowledge the operator has of the robot’s circumstances in a local sense, such as when there is an

[1]  Ben Shneiderman,et al.  Direct Manipulation: A Step Beyond Programming Languages , 1983, Computer.

[2]  H. Yanco,et al.  Camera Placement and Multi-Camera Fusion for Remote Robot Operation , 2006 .

[3]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[4]  Jean Scholtz,et al.  Beyond usability evaluation: analysis of human-robot interaction at a major robotics competition , 2004 .

[5]  Claude Sammut,et al.  Effective user interface design for rescue robotics , 2006, HRI '06.

[6]  Adam Jacoff,et al.  A Standard Test Course for Urban Search and Rescue Robots , 2000 .

[7]  Holly A. Yanco,et al.  LASSOing HRI: Analyzing situation awareness in map-centric and video-centric interfaces , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[8]  Donald D. Dudenhoeffer,et al.  Dynamic-Autonomy for Urban Search and Rescue , 2002, AAAI Mobile Robot Competition.

[9]  Holly A. Yanco,et al.  A Taxonomy for Human-Robot Interaction , 2002 .

[10]  Holly A. Yanco,et al.  Multi-touch interaction for robot control , 2009, IUI.

[11]  J. Adams Unmanned Vehicle Situation Awareness : A Path Forward , 2007 .

[12]  Michael A. Goodrich,et al.  Ecological Interfaces for Improving Mobile Robot Teleoperation , 2007, IEEE Transactions on Robotics.

[13]  Woohun Lee,et al.  Design guidelines for map-based human–robot interfaces: A colocated workspace perspective , 2007 .

[14]  Holly A. Yanco,et al.  "Where am I?" Acquiring situation awareness using a remote robot platform , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[15]  Holly A. Yanco,et al.  Rescuing interfaces: A multi-year study of human-robot interaction at the AAAI Robot Rescue Competition , 2007, Auton. Robots.

[16]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[17]  Jean Scholtz,et al.  Evaluation of human-robot interaction awareness in search and rescue , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[18]  Laurel D. Riek,et al.  Evaluating Human-Robot Interaction in a Search-and-Rescue Context * , 2003 .

[19]  Michael A. Goodrich,et al.  Comparing the usefulness of video and map information in navigation tasks , 2006, HRI '06.

[20]  Jean Scholtz,et al.  Beyond Usability Evaluation: Analysis of Human-Robot Interaction at a Major Robotics Competition , 2004, Hum. Comput. Interact..

[21]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[22]  Michael A. Goodrich,et al.  Snapshots for semantic maps , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[23]  Jefferson Y. Han Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[24]  Holly A. Yanco,et al.  Evolving interface design for robot search tasks , 2007, J. Field Robotics.

[25]  Ludek Zalud,et al.  ARGOS - System for Heterogeneous Mobile Robot Teleoperation , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[27]  Jean Scholtz,et al.  Awareness in human-robot interactions , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[28]  Adam Jacoff,et al.  Reference test courses for autonomous mobile robots , 2001, SPIE Defense + Commercial Sensing.