Visual Support System for Tele-operated Hand Robot

In situations such as disaster site and outer space, tele-operated robots can be effective tools. Authors develop a master-slave system consisting of a multi-fingered haptic interface and a humanoid hand robot. Tele-operation using a 2D image received from a remote site is difficult to understand in terms of the robot’s relative position, posture and environment on remote site. In work involving grasping and manipulating objects, there is a risk of collision between the robot and the environment. This research construct an environmental model that enables binocular stereopsis by 3D information received from an RGB-D camera. This paper proposes a visual support system for a tele-operated humanoid hand robot that presents the operator with the closest point between the robot and environment.

[1]  Tang Xinxing,et al.  Tele-operation Construction Robot Control System with Virtual Reality , 2009 .

[2]  Haruhisa Kawasaki,et al.  Bilateral Tele-operated Hand Robot with Communicational Time Delay , 2017 .

[3]  F. Matsuno,et al.  Study on effective camera images for mobile robot teleoperation , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[4]  Haruhisa Kawasaki,et al.  Five-Fingered Haptic Interface Robot: HIRO III , 2009, IEEE Transactions on Haptics.

[5]  Yang Liu,et al.  Vision-based predictive assist control on master-slave systems , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Haruhisa Kawasaki,et al.  Design and Control of Five-Fingered Haptic Interface Opposite to Human Hand , 2007, IEEE Transactions on Robotics.

[7]  Cheng-Hsuan Yang,et al.  A Stereo Vision-Based Support System for Tele-Operation of Unmanned Vehicle , 2015 .

[8]  Yukie Nagai,et al.  Panoramic view reconstruction for stereoscopic teleoperation of a humanoid robot , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[9]  Long Quan,et al.  Quasi-Dense Reconstruction from Image Sequence , 2002, ECCV.

[10]  Soh-Khim Ong,et al.  Immersive Augmented Reality Environment for the Teleoperation of Maintenance Robots , 2017 .

[11]  Haruhisa Kawasaki,et al.  Study on stiffness visualization and safety control based on will-consensus building for tele-palpation robot system , 2015, Artificial Life and Robotics.

[12]  Naoji Shiroma,et al.  Synthesized Scene Recollection for Vehicle Teleoperation , 2005 .