Immersive 3-D teleoperation of a search and rescue robot using a head-mounted display

This paper proposes an alternative approach to common teleoperation methods found in search and rescue (SAR) robots. Using a head mounted display (HMD) the operator is capable of perceiving rectified images of the robot world in 3-D, as transmitted by a pair of stereo cameras onboard the robot. The HMD is also equipped with an integrated head-tracker, which permits controlling the robot motion in such a way that the cameras follow the operator's head movements, thus providing an immersive sensation to him. We claim that this approach is a more intuitive and less error prone teleoperation of the robot. The proposed system was evaluated by a group of subjects, and the results suggest that it may yield significant benefits to the effectiveness of the SAR mission. In particular, the user's depth perception and situational awareness improved significantly when using the HMD, and their performance during a simulated SAR operation was also enhanced, both in terms of operation time and on successful identification of objects of interest.

[1]  Adam Jacoff,et al.  Experiences in Deploying Test Arenas for Autonomous Mobile Robots , 2001 .

[2]  R.R. Murphy,et al.  Human-robot interaction in USAR technical search: two heads are better than one , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[3]  Mel W. Siegel,et al.  Just enough reality: comfortable 3-D viewing via microstereopsis , 2000, IEEE Trans. Circuits Syst. Video Technol..

[4]  Shugen Ma,et al.  Current research, key performances and future development of search and rescue robots , 2007, Frontiers of Mechanical Engineering in China.

[5]  L. Kopecny,et al.  Orpheus Reconnissance Robots , 2008, 2008 IEEE International Workshop on Safety, Security and Rescue Robotics.

[6]  Jeffrey S. McVeigh,et al.  Algorithm for automated eye-strain reduction in real stereoscopic images and sequences , 1996, Electronic Imaging.

[7]  Robin R. Murphy,et al.  Human-robot interaction in rescue robotics , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  S. J. Merhav,et al.  Adaptive suppression of biodynamic interference in helmet-mounted displays and head teleoperation , 1991 .

[9]  Ludek Zalud,et al.  ARGOS - System for Heterogeneous Mobile Robot Teleoperation , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Mark Fiala.  Pano-presence for teleoperation , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Margrit Gelautz,et al.  Video-based 3 D Reconstruction of Moving Scenes Using Multiple Stationary Cameras , 2003 .

[12]  Brian A. Weiss,et al.  Test arenas and performance metrics for urban search and rescue robots , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[13]  Michael Lewis,et al.  Camera control and decoupled motion for teleoperation , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[14]  J. Rolland,et al.  Head-worn displays: a review , 2006, Journal of Display Technology.

[15]  Lyndon Hill,et al.  3-D Liquid Crystal Displays and Their Applications , 2006, Proceedings of the IEEE.

[16]  Ludek Zalud,et al.  3D proximity scanner integration to rescue robotic system , 2005 .

[17]  Jean Scholtz,et al.  Evaluation of human-robot interaction awareness in search and rescue , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[18]  Pedro U. Lima,et al.  A search and rescue robot with tele-operated tether docking system , 2007, Ind. Robot.

[19]  Ludek Zalud,et al.  Augmented Reality User Interface for Reconnaissance Robotic Missions , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[20]  Elena Casiraghi,et al.  CORNER LOCALIZATION IN CHESSBOARDS FOR CAMERA CALIBRATION , 2005 .

[21]  Graham R Jones,et al.  Controlling perceived depth in stereoscopic images , 2001, IS&T/SPIE Electronic Imaging.