Enhancing robot teleoperator situation awareness and performance using vibro-tactile and graphical feedback

Most of the feedback received by operators of current robot-teleoperation systems is graphical. When a large variety of robot data needs to be displayed however, this may lead to operator overload. The research presented in this paper focuses on off-loading part of the feedback to other human senses, specifically to the sense of touch, to reduce the load due to the interface, and as a consequence, to increase the level of operator situation awareness. Graphical and vibro-tactile versions of feedback delivery for collision interfaces were evaluated in a search task using a virtual teleoperated robot. Parameters measured included task time, number of collisions between the robot and the environment, number of objects found and the quality of post-experiment reports through the use of sketch maps. Our results indicate that the combined use of both graphical and vibro-tactile feedback interfaces led to an increase in the quality of sketch maps, a possible indication of increased levels of operator situation awareness, but also a slight decrease in the number of robot collisions.

[1]  Jean Scholtz,et al.  Beyond usability evaluation: analysis of human-robot interaction at a major robotics competition , 2004 .

[2]  H. Yanco,et al.  Analysis of Human-Robot Interaction for Urban Search and Rescue , 2006 .

[3]  François Michaud,et al.  Telepresence Robot for Home Care Assistance , 2007, AAAI Spring Symposium: Multidisciplinary Collaboration for Socially Assistive Robotics.

[4]  Mark Billinghurst,et al.  The use of sketch maps to measure cognitive maps of virtual environments , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[5]  Jean Scholtz,et al.  Design guidelines for improved human-robot interaction , 2004, CHI EA '04.

[6]  Michael Lewis,et al.  An Experimental Comparison of Three Methods for Collision Handling in Virtual Environments , 1997 .

[7]  Z. Zenn Bien,et al.  Effective learning system techniques for human-robot interaction in service environment , 2007, Knowl. Based Syst..

[8]  Stefano Carpin,et al.  USARSim: a robot simulator for research and education , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[9]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[10]  Brian A. Weiss,et al.  Test arenas and performance metrics for urban search and rescue robots , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[11]  Matthew O. Ward,et al.  A Multi-sensorial HRI Interface for Teleoperated Robots , 2009 .

[12]  Michael A. Goodrich,et al.  Comparing the usefulness of video and map information in navigation tasks , 2006, HRI '06.

[13]  Masatoshi Ishikawa,et al.  Augmenting spatial awareness with Haptic Radar , 2006, 2006 10th IEEE International Symposium on Wearable Computers.

[14]  Holly A. Yanco,et al.  Changing shape: improving situation awareness for a polymorphic robot , 2006, HRI '06.

[15]  Robert W. Lindeman,et al.  Effectiveness of directional vibrotactile cuing on a building-clearing task , 2005, CHI.

[16]  Daniel C. Asmar,et al.  A robot's spatial perception communicated via human touch , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[17]  Robert W. Lindeman,et al.  Controller design for a wearable, near-field haptic display , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[18]  Jean Scholtz,et al.  Common metrics for human-robot interaction , 2006, HRI '06.

[19]  Robert W. Lindeman,et al.  Wearable vibrotactile systems for virtual contact and information display , 2006, Virtual Reality.

[20]  Robert W. Lindeman.  Virtual Contact: The Continuum from Purely Visual to Purely Physical , 2003 .

[21]  Norman I. Badler,et al.  Collision Awareness Using Vibrotactile Arrays , 2007, 2007 IEEE Virtual Reality Conference.

[22]  Mica R. Endsley,et al.  Theoretical Underpinnings of Situation Awareness, A Critical Review , 2000 .

[23]  I. Herbst,et al.  Comparing force magnitudes by means of vibro-tactile, auditory, and visual feedback , 2005, IEEE International Workshop on Haptic Audio Visual Environments and their Applications.

[24]  Kazuhiko Kawamura,et al.  Evaluation of an enhanced human-robot interface , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[25]  Kristopher J. Blom,et al.  Virtual collision notification , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[26]  Gerard Jounghyun Kim,et al.  Using a vibro-tactile display for enhanced collision perception and presence , 2004, VRST '04.

[27]  Erika Rogers,et al.  Cooperative Assistance for Remote Robot Supervision , 1995, Presence: Teleoperators & Virtual Environments.

[28]  Michael A. Goodrich,et al.  A characterization of dynamic human braking behavior with implications for ACC design , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[29]  Jean C. Scholtz,et al.  Evaluation Methods for Human-System Performance of Intelligent Systems , 2002 .

[30]  Michael A. Goodrich,et al.  Ecological Interfaces for Improving Mobile Robot Teleoperation , 2007, IEEE Transactions on Robotics.

[31]  Linda R. Elliott,et al.  Comparing the effects of visual-auditory and visual-tactile feedback on user performance: a meta-analysis , 2006, ICMI '06.