Mapping Grasping Motion of Hand between Master and Slave in a Low-Dimensional Latent Space

In recent years, the demand for master-slave robots capable of performing various tasks has been increasing. However, mapping the motion of a master human hand to a slave robot hand is difficult for two reasons. The first reason is the different kinematic structures of the human and robot hands, which leads to a different dimensionality representation of motions of the hands. The second reason is the difficulty of modeling the hand's motion; since the natural motion of the human hand is complex, an accurate representation of it has high dimensionality. In recent studies, it has been shown that some specific commonly used motions, such as handling and grasping of objects, can be represented in a lower-dimensional non-linear manifold in hand posture space. In this study, considering the problem mentioned above, we propose a method for modeling hand motion in a low-dimensional latent space by using Gaussian Process Latent Variable Models (GPLVMs), and learning the relationship between the grasping motion of master hand and the slave hand by using Gaussian Mixture Regression (GMR).

[1]  Manuel G. Catalano,et al.  Adaptive synergies: An approach to the design of under-actuated robotic hands , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Martin Buss,et al.  Multi-fingered telemanipulation - mapping of a human hand to a three finger gripper , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[3]  Ryan J. Murphy,et al.  Approaches to robotic teleoperation in a disaster scenario: From supervised autonomy to direct control , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Monica Malvezzi,et al.  An Object-Based Approach to Map Human Hand Synergies onto Robotic Hands with Dissimilar Kinematics , 2012, Robotics: Science and Systems.

[5]  Haruhisa Kawasaki,et al.  Control of High Output Robot Hand with Retention Mechanism , 2017 .

[6]  Yang Liu,et al.  Vision-based predictive assist control on master-slave systems , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Matei T. Ciocarlie,et al.  Hand Posture Subspaces for Dexterous Robotic Grasping , 2009, Int. J. Robotics Res..

[8]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Aude Billard,et al.  Dynamical System Modulation for Robot Learning via Kinesthetic Demonstrations , 2008, IEEE Transactions on Robotics.

[10]  Kouta Minamizawa,et al.  Design of TELESAR V for transferring bodily consciousness in telexistence , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Yang Liu,et al.  Assist control for ball catching using high-speed vision on a master-slave robot , 2016, 2016 IEEE/SICE International Symposium on System Integration (SII).

[12]  Manuel G. Catalano,et al.  Adaptive synergies for a humanoid robot hand , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[13]  David J. Fleet,et al.  Topologically-constrained latent variable models , 2008, ICML '08.