Learning Grasp Configuration Through Object-Specific Hand Primitives for Posture Planning of Anthropomorphic Hands

The proposal of postural synergy theory has provided a new approach to solve the problem of controlling anthropomorphic hands with multiple degrees of freedom. However, generating the grasp configuration for new tasks in this context remains challenging. This study proposes a method to learn grasp configuration according to the shape of the object by using postural synergy theory. By referring to past research, an experimental paradigm is first designed that enables the grasping of 50 typical objects in grasping and operational tasks. The angles of the finger joints of 10 subjects were then recorded when performing these tasks. Following this, four hand primitives were extracted by using principal component analysis, and a low-dimensional synergy subspace was established. The problem of planning the trajectories of the joints was thus transformed into that of determining the synergy input for trajectory planning in low-dimensional space. The average synergy inputs for the trajectories of each task were obtained through the Gaussian mixture regression, and several Gaussian processes were trained to infer the inputs trajectories of a given shape descriptor for similar tasks. Finally, the feasibility of the proposed method was verified by simulations involving the generation of grasp configurations for a prosthetic hand control. The error in the reconstructed posture was compared with those obtained by using postural synergies in past work. The results show that the proposed method can realize movements similar to those of the human hand during grasping actions, and its range of use can be extended from simple grasping tasks to complex operational tasks.

[1]  Stefan Ulbrich,et al.  Master Motor Map (MMM) — Framework and toolkit for capturing, representing, and reproducing human motion on humanoid robots , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[2]  Tamim Asfour,et al.  Unifying Representations and Large-Scale Whole-Body Motion Databases for Studying Human Motion , 2016, IEEE Transactions on Robotics.

[3]  J. F. Soechting,et al.  Postural Hand Synergies for Tool Use , 1998, The Journal of Neuroscience.

[4]  Siddhartha S. Srinivasa,et al.  The YCB object and Model set: Towards common benchmarks for manipulation research , 2015, 2015 International Conference on Advanced Robotics (ICAR).

[5]  Tamim Asfour,et al.  Human-Inspired Representation of Object-Specific Grasps for Anthropomorphic Hands , 2020, Int. J. Humanoid Robotics.

[6]  Fumiya Iida,et al.  From Spontaneous Motor Activity to Coordinated Behaviour: A Developmental Model , 2014, PLoS Comput. Biol..

[7]  H. Harry Asada,et al.  Inter-finger coordination and postural synergies in robot hands via mechanical implementation of principal components analysis , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Ritwik Chattaraj,et al.  Grasp mapping for Dexterous Robot Hand: A hybrid approach , 2014, 2014 Seventh International Conference on Contemporary Computing (IC3).

[9]  Jianwei Zhang,et al.  Precision grasp synergies for dexterous robotic hands , 2013, 2013 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[10]  Ferdinando A Mussa-Ivaldi,et al.  Modular features of motor control and learning , 1999, Current Opinion in Neurobiology.

[11]  Matei T. Ciocarlie,et al.  Hand Posture Subspaces for Dexterous Robotic Grasping , 2009, Int. J. Robotics Res..

[12]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Sven Behnke,et al.  Learning Postural Synergies for Categorical Grasping Through Shape Space Registration , 2018, 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids).

[14]  Giuseppe Averta,et al.  Learning From Humans How to Grasp: A Data-Driven Architecture for Autonomous Grasping With Anthropomorphic Soft Hands , 2019, IEEE Robotics and Automation Letters.

[15]  Alessandro Scano,et al.  Kinematic synergies of hand grasps: a comprehensive study on a large publicly available dataset , 2019, Journal of NeuroEngineering and Rehabilitation.

[16]  Cindy Grimm,et al.  Using Geometric Features to Represent Near-Contact Behavior in Robotic Grasping , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[17]  E. Bizzi,et al.  Muscle synergies encoded within the spinal cord: evidence from focal intraspinal NMDA iontophoresis in the frog. , 2001, Journal of neurophysiology.

[18]  Zhi-Hong Mao,et al.  Linear and Nonlinear Kinematic Synergies in the Grasping Hand , 2015 .

[19]  C. Pylatiuk,et al.  Results of an Internet survey of myoelectric prosthetic hand users , 2007, Prosthetics and orthotics international.

[20]  Milos Zefran,et al.  Grasp taxonomy based on force distribution , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[21]  Christian Cipriani,et al.  Principal components analysis based control of a multi-dof underactuated prosthetic hand , 2010, Journal of NeuroEngineering and Rehabilitation.

[22]  Douglas I. Benn,et al.  The description and representation of particle shape , 1993 .

[23]  Karun B. Shimoga,et al.  Robot Grasp Synthesis Algorithms: A Survey , 1996, Int. J. Robotics Res..

[24]  Jacob L. Segil,et al.  Mechanical design and performance specifications of anthropomorphic prosthetic hands: a review. , 2013, Journal of rehabilitation research and development.

[25]  Danica Kragic,et al.  Spatio-temporal modeling of grasping actions , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Alin Albu-Schäffer,et al.  Neuromodulation and Synaptic Plasticity for the Control of Fast Periodic Movement: Energy Efficiency in Coupled Compliant Joints via PCA , 2016, Front. Neurorobot..

[27]  Purushothaman Geethanjali,et al.  Myoelectric control of prosthetic hands: state-of-the-art review , 2016, Medical devices.

[28]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[29]  Daniel Leidner,et al.  Classifying compliant manipulation tasks for automated planning in robotics , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[30]  D. Pahr,et al.  The effect of the extensor mechanism on maximum isometric fingertip forces: A numerical study on the index finger. , 2016, Journal of biomechanics.

[31]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[32]  Manuel G. Catalano,et al.  Exploring augmented grasping capabilities in a multi-synergistic soft bionic hand , 2020, Journal of NeuroEngineering and Rehabilitation.

[33]  F. Mussa-Ivaldi,et al.  Linear and Non-linear Dimensionality-Reduction Techniques on Full Hand Kinematics , 2020, Frontiers in Bioengineering and Biotechnology.

[34]  E. Todorov,et al.  Analysis of the synergies underlying complex hand manipulation , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[35]  Manuel G. Catalano,et al.  Toward Dexterous Manipulation With Augmented Adaptive Synergies: The Pisa/IIT SoftHand 2 , 2018, IEEE Transactions on Robotics.

[36]  Gabriel Baud-Bovy,et al.  Neural bases of hand synergies , 2013, Front. Comput. Neurosci..

[37]  Dacheng Tao,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS—PART B: CYBERNETICS 1 Cross-Domain Human Action Recognition , 2022 .

[38]  Cindy Grimm,et al.  Near-contact grasping strategies from awkward poses: When simply closing your fingers is not enough* , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[39]  Aaron M. Dollar,et al.  Analysis of Human Grasping Behavior: Object Characteristics and Grasp Type , 2014, IEEE Transactions on Haptics.

[40]  Sven Behnke,et al.  Transferring Category-Based Functional Grasping Skills by Latent Space Non-Rigid Registration , 2018, IEEE Robotics and Automation Letters.

[41]  Anis Sahbani,et al.  Analysis of hand synergies in healthy subjects during bimanual manipulation of various objects , 2014, Journal of NeuroEngineering and Rehabilitation.

[42]  Gerd Hirzinger,et al.  Synergy level impedance control for multifingered hands , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.