Multi-modal user interface for teleoperation of ROBHAZ-DT2 field robot system

This paper describes a multi-modal interface design and its implementation to a teleoperated field robot system. The ROBHAZ-DT2 is developed as a teleoperated mobile manipulator for hazard environment applications (e.g. rescue, explosive ordnance disposal, security). To complete these missions in outdoor environment, the robot system must have appropriate functions, accuracy and reliability. However, the more functions it has, the more difficulties for the operator to control the functions. To cope up with this problem, an effective user interface should be developed. The main challenge of this research is to make a simple and intuitive user interface and teleoperate the slave robot easily. This paper provides multi-modalities such as visual, auditory and haptic sense. It enables an operator to control every functions of a field robot, ROBHAZ-DT2 more easily. In this paper, an EOD (explosive ordinance disposal) demonstration is conducted to verify the validity of the proposed multimodal interface.

[1]  Toshi Takamori,et al.  Multi-modal human robot interaction for map generation , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[2]  Christiaan J. J. Paredis,et al.  Interactive Multimodal Robot Programming , 2005, Int. J. Robotics Res..

[3]  Y. Takahashi,et al.  A visual interface for security robots , 1992, [1992] Proceedings IEEE International Workshop on Robot and Human Communication.

[4]  Nobuhiro Shimoi,et al.  Development of teleoperated six-legged walking robot for mine detection and mapping of mine field , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[5]  Munsang Kim,et al.  Kinematic analysis and design of a 6 DOF haptic master for teleoperation of a mobile manipulator , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[6]  Helge J. Ritter,et al.  Multi-modal human-machine communication for instructing robot grasping tasks , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Sungchul Kang,et al.  ROBHAZ-DT2: design and integration of passive double tracked mobile manipulator system for explosive ordnance disposal , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).