Synergy-based interface for bilateral tele-manipulations of a master-slave system with large asymmetries

In this work a novel synergy-based bilateral tele-manipulation strategy is introduced. The proposed algorithm has been primarily developed to remotely control the Pisa/IIT SoftHand (SH) using a 3-finger hand exoskeleton as master device. With a single actuator and a sensory system limited to a position encoder and a current sensor, the SH minimalist design promotes robustness but challenges traditional teleoperation strategies. To tackle this challenge, the concept of Cartesian-based hand synergies is introduced as a projection tool which maps the fingertip Cartesian space to the directions oriented along the grasp principal components. The unconstrained motion of the operator's hand is projected on this space to extract the SH's motor position reference. Conversely, the interaction force estimated at the robotic hand as a 1-dimensional force along the first synergy is projected to the 9D fingertip Cartesian space through an inverse projection. The resultant finger-individualized forces form a synergy based weighted representation of the grasping effort applied by the SH and are displayed to the operators fingertips using the force feedback hand exoskeleton. The system's ability to reflect the environment's impedance has been experimentally validated during a ball squeezing experiment. To assess the overall effectiveness of the proposed system as a manipulation interface, the SoftHand was mounted on the humanoid robot COMAN and the setup was subsequently enriched with a vision-based tracking system monitoring the operators wrist trajectory. Experimental results indicate that the proposed body-machine bilateral interface allows for the intuitive performance of stable grasps and transport of a large range of diversely shaped objects.

[1]  H. Harry Asada,et al.  Inter-finger coordination and postural synergies in robot hands via mechanical implementation of principal components analysis , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Kostas J. Kyriakopoulos,et al.  Kinematic analysis and position/force control of the Anthrobot dextrous hand , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[3]  Antonio Bicchi,et al.  Hands for dexterous manipulation and robust grasping: a difficult road toward simplicity , 2000, IEEE Trans. Robotics Autom..

[4]  Manuel G. Catalano,et al.  Adaptive synergies for a humanoid robot hand , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[5]  Nikolaos G. Tsagarakis,et al.  Exploring Teleimpedance and Tactile Feedback for Intuitive Control of the Pisa/IIT SoftHand , 2014, IEEE Transactions on Haptics.

[6]  Stephen C. Jacobsen,et al.  The UTAH/M.I.T. Dextrous Hand: Work in Progress , 1984 .

[7]  Amy J Bastian,et al.  Multidigit Movement Synergies of the Human Hand in an Unconstrained Haptic Exploration Task , 2008, The Journal of Neuroscience.

[8]  Hong Liu,et al.  DLR-Hand II: next generation of a dextrous robot hand , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[9]  Kian Hsiang Low,et al.  A Mapping Method for Telemanipulation of the Non-Anthropomorphic Robotic Hands with Initial Experimental Validation , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[10]  Toshiyuki Murakami,et al.  Torque sensorless control in multidegree-of-freedom manipulator , 1993, IEEE Trans. Ind. Electron..

[11]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[12]  Allison M. Okamura,et al.  An overview of dexterous manipulation , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[13]  Nikolaos G. Tsagarakis,et al.  COMpliant huMANoid COMAN: Optimal joint stiffness tuning for modal frequency control , 2013, 2013 IEEE International Conference on Robotics and Automation.

[14]  Matei T. Ciocarlie,et al.  Hand Posture Subspaces for Dexterous Robotic Grasping , 2009, Int. J. Robotics Res..

[15]  Monica Malvezzi,et al.  Mapping Synergies From Human to Robotic Hands With Dissimilar Kinematics: An Approach in the Object Domain , 2013, IEEE Transactions on Robotics.

[16]  Antonio Bicchi,et al.  Modelling natural and artificial hands with synergies , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.

[17]  Nikolaos G. Tsagarakis,et al.  Tele-manipulation with a humanoid robot under autonomous joint impedance regulation and vibrotactile balancing feedback , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[18]  Matei T. Ciocarlie,et al.  Dimensionality reduction for hand-independent dexterous robotic grasping , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.