An Optimization Approach to Teleoperation of the Thumb of a Humanoid Robot Hand: Kinematic Mapping and Calibration

The complex kinematic structure of a human thumb makes it difficult to capture and control the thumb motions. A further complication is that mapping the fingertip position alone leads to inadequate grasping postures for current robotic hands, many of which are equipped with tactile sensors on the volar side of the fingers. This paper aimed to use a data glove as the input device to teleoperate the thumb of a humanoid robotic hand. An experiment protocol was developed with only minimum hardware involved to compensate for the differences in kinematic structures between a robotic hand and a human hand. A nonlinear constrained-optimization formulation was proposed to map and calibrate the motion of a human thumb to that of a robotic thumb by minimizing the maximum errors (minimax algorithms) of fingertip position while subject to the constraint of the normals of the surfaces of the thumb and the index fingertips within a friction cone. The proposed approach could be extended to other teleoperation applications, where the master and slave devices differ in kinematic structure.

[1]  Kevin Montgomery,et al.  Using Registration, Calibration, and Robotics to Build a More Accurate Virtual Reality Simulation for Astronaut Training and Telemedicine , 2003, WSCG.

[2]  Robert Rohling,et al.  Calibrating the Human Hand for Haptic Interfaces , 1993, Presence: Teleoperators & Virtual Environments.

[3]  Antonio Bicchi,et al.  Online robotic experiments for tele-education at the university of pisa , 2005 .

[4]  J. Napier The prehensile movements of the human hand. , 1956, The Journal of bone and joint surgery. British volume.

[5]  Judy M. Vance,et al.  Spatial mechanism design in virtual reality with networking , 2002 .

[6]  Vijay Kumar,et al.  On the stability of grasped objects , 1996, IEEE Trans. Robotics Autom..

[7]  E. Chao,et al.  Biomechanical analysis of static forces in the thumb during hand function. , 1977, The Journal of bone and joint surgery. American volume.

[8]  Jian S. Dai Surgical robotics and its development and progress , 2010, Robotica.

[9]  Jian S. Dai,et al.  Kinematics of a Fully-Decoupled Remote Center-of-Motion Parallel Manipulator for Minimally Invasive Surgery , 2012 .

[10]  J. Heindl,et al.  Multisensory telerobotic techniques , 1990 .

[11]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[12]  Jian S. Dai,et al.  Geometry and Constraint Analysis of the Three-Spherical Kinematic Chain Based Parallel Mechanism , 2010 .

[13]  Shuxin Wang,et al.  A Family of Remote Center of Motion Mechanisms Based on Intersecting Motion Planes , 2013 .

[14]  Curtis L. Collins,et al.  The singularity analysis of an in-parallel hand controller for force-reflected teleoperation , 1995, IEEE Trans. Robotics Autom..

[15]  Jiawei Hong,et al.  Calibrating a VPL DataGlove for teleoperating the Utah/MIT hand , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[16]  Hamza Erol,et al.  Stature estimation based on hand length and foot length , 2005, Clinical anatomy.

[17]  Fengfeng Xi,et al.  Optimal Calibration of Parallel Kinematic Machines , 2005 .

[18]  Jeffrey C. Trinkle,et al.  Grasp analysis as linear matrix inequality problems , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[19]  Arash Kalantari,et al.  ResQuake: A Tele-Operative Rescue Robot , 2009 .

[20]  Gerd Hirzinger,et al.  Learning techniques in a dataglove based telemanipulation system for the DLR hand , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[21]  J. Duffy,et al.  An Optimization Approach to the Determination of the Boundaries of Manipulator Workspaces , 2000 .

[22]  Y.C. Eldar,et al.  Blind minimax estimators: improving on least-squares estimation , 2005, IEEE/SP 13th Workshop on Statistical Signal Processing, 2005.

[23]  Lillian Y. Chang,et al.  Robust estimation of dominant axis of rotation. , 2007, Journal of biomechanics.

[24]  Robert O. Ambrose,et al.  Evolution of the NASA/DARPA Robonaut control system , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[25]  Jian S. Dai,et al.  Analysis of Force Distribution in Grasps Using Augmentation , 1996 .

[26]  Patrick Olivier,et al.  Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor , 2012, UIST.

[27]  Imin Kao,et al.  Computing and controlling compliance of a robotic hand , 1989, IEEE Trans. Robotics Autom..

[28]  Jian S. Dai,et al.  Stiffness Design for a Spatial Three Degrees of Freedom Serial Compliant Manipulator Based on Impact Configuration Decomposition , 2013 .

[29]  Jian S. Dai,et al.  Orientation and Workspace Analysis of the Multifingered Metamorphic Hand—Metahand , 2009, IEEE Transactions on Robotics.

[30]  Nicola J. Ferrier,et al.  Design and Control of a Force-Reflecting Haptic Interface for Teleoperational Grasping , 2002 .

[31]  Ferdinand Freudenstein,et al.  Kinematic Synthesis of Linkages , 1965 .

[32]  Carl A. Nelson,et al.  Multiple-Criteria Kinematic Optimization for the Design of Spherical Serial Mechanisms Using Genetic Algorithms , 2011 .

[33]  Francisco J. Valero Cuevas,et al.  Reported anatomical variability naturally leads to multimodal distributions of Denavit-Hartenberg parameters for the human thumb , 2006, IEEE Transactions on Biomedical Engineering.

[34]  Karsten Schmidt,et al.  A comparison of minimax and least squares estimators in linear regression with polyhedral prior information , 1996 .

[35]  Jian S. Dai,et al.  Reciprocity-Based Singular Value Decomposition for Inverse Kinematic Analysis of the Metamorphic Multifingered Hand , 2012 .

[36]  Riko Safaric,et al.  Virtual environment for telerobotics , 2001, Integr. Comput. Aided Eng..

[37]  Matteo Zoppi,et al.  Design of a Microrobotic Wrist for Needle Laparoscopic Surgery , 2008 .

[38]  Jian S. Dai,et al.  Posture, Workspace, and Manipulability of the Metamorphic Multifingered Hand With an Articulated Palm , 2011 .

[39]  R. L. Linscheid,et al.  The kinesiology of the thumb trapeziometacarpal joint. , 1981, The Journal of bone and joint surgery. American volume.

[40]  Jian S. Dai,et al.  Geometric analysis and synthesis of the metamorphic robotic hand , 2007 .

[41]  Hui Shao,et al.  Master-slave hand system of different structures, grasp recognition by neural network and grasp mapping , 2004, Robotica.

[42]  Jian S. Dai,et al.  Fine motion control based on constraint criteria under pre-loading configurations , 2000 .

[43]  Taylor Cl,et al.  The anatomy and mechanics of the human hand. , 1955 .

[44]  Paolo Dario,et al.  A Survey of Glove-Based Systems and Their Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[45]  Yonina C. Eldar,et al.  Minimax estimators dominating the least-squares estimator , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[46]  Z. M. Bi,et al.  Integrated design toolbox for tripod-based parallel kinematic machines , 2007 .

[47]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[48]  Lillian Y. Chang,et al.  Constrained least-squares optimization for robust estimation of center of rotation. , 2007, Journal of biomechanics.

[49]  Jian S. Dai,et al.  Kinematic Analysis and Prototype of a Metamorphic Anthropomorphic Hand with a Reconfigurable Palm , 2011, Int. J. Humanoid Robotics.

[50]  Nicholas Krouglicof,et al.  Kinematic Synthesis of Nonspherical Orientation Manipulators: Maximization of Dexterous Regular Workspace by Multiple Response Optimization , 2012 .