Development of fast-response master-slave system using high-speed non-contact 3D sensing and high-speed robot hand

In this paper we focus on master-slave robot hand systems that can realize non-contact sensing and intuitive mapping between human hand motion and robot hand motion. Such a master-slave robot hand system can be effective from a viewpoint of usability. However, conventional systems are not able to adapt to dynamically changing environments because they have high latency from input to output. Therefore, we developed a fast-response master-slave robot hand system using a high-speed vision system and a high-speed robot hand. The latency of the proposed system is so small that humans cannot recognize it. The motion of a human hand is obtained with high-speed non-contact 3D sensing, and this motion is mapped to a high-speed robot hand, while taking account of structural differences between the human hand and the robot hand. We confirmed the effectiveness of our proposed system through experiments.

[1]  Yoshiro Imai,et al.  Development of a high-speed multifingered hand system and its application to catching , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[2]  W. Ribarsky,et al.  Development of anthropomorphic multi-D.O.F master-slave arm for mutual telexistence , 2005, IEEE Transactions on Visualization and Computer Graphics.

[3]  Keng Peng Tee,et al.  Human-aided robotic grasping , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[4]  Michael Zyda,et al.  Inertial and magnetic posture tracking for inserting humans into networked virtual environments , 2001, VRST '01.

[5]  N. Kanwisher,et al.  PSYCHOLOGICAL SCIENCE Research Article Visual Recognition As Soon as You Know It Is There, You Know What It Is , 2022 .

[6]  Naoki Kawakami,et al.  Development of Anthropomorphic Multi-D.O.F. Master-Slave Arm for Mutual Telexistence , 2005, IEEE Trans. Vis. Comput. Graph..

[7]  Kian Hsiang Low,et al.  A Mapping Method for Telemanipulation of the Non-Anthropomorphic Robotic Hands with Initial Experimental Validation , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[8]  K. Hoshino,et al.  Copycat hand - robot hand generating imitative behavior , 2007, IECON 2007 - 33rd Annual Conference of the IEEE Industrial Electronics Society.

[9]  Jonathan Kofman,et al.  Teleoperation of a robot manipulator using a vision-based human-robot interface , 2005, IEEE Transactions on Industrial Electronics.

[10]  Toshio Tsuji,et al.  A human-assisting manipulator teleoperated by EMG signals and arm motions , 2003, IEEE Trans. Robotics Autom..

[11]  Masatoshi Ishikawa,et al.  High-speed Human / Robot Hand Interaction System , 2015, HRI.

[12]  Mark R. Cutkosky,et al.  Calibration and Mapping of a Human Hand for Dexterous Telemanipulation , 2000, Dynamic Systems and Control: Volume 2.

[13]  Martin Buss,et al.  Multi-fingered telemanipulation - mapping of a human hand to a three finger gripper , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.