Hand Posture Prediction Using Neural Networks within a Biomechanical Model

This paper proposes the use of artificial neural networks (ANNs) in the framework of a biomechanical hand model for grasping. ANNs enhance the model capabilities as they substitute estimated data for the experimental inputs required by the grasping algorithm used. These inputs are the tentative grasping posture and the most open posture during grasping. As a consequence, more realistic grasping postures are predicted by the grasping algorithm, along with the contact information required by the dynamic biomechanical model (contact points and normals). Several neural network architectures are tested and compared in terms of prediction errors, leading to encouraging results. The performance of the overall proposal is also shown through simulation, where a grasping experiment is replicated and compared to the real grasping data collected by a data glove device.

[1]  Jose L. Iserte,et al.  Towards a Realistic and Self-Contained Biomechanical Model of the Hand , 2011 .

[2]  T J Armstrong,et al.  A kinematic model of the human hand to evaluate its prehensile capabilities. , 1992, Journal of biomechanics.

[3]  Wei Zhou,et al.  Development of a Kinematic Hand Model for Study and Design of Hose Installation , 2009, HCI.

[4]  Franck Quaine,et al.  Estimation of finger muscle tendon tensions and pulley forces during specific sport-climbing grip techniques. , 2006, Journal of biomechanics.

[5]  L. M. Myers,et al.  The axes of rotation of the thumb interphalangeal and metacarpophalangeal joints. , 1995, Clinical orthopaedics and related research.

[6]  Philippe Gorce,et al.  Grasping posture learning with noisy sensing information for a large scale of multifingered robotic systems , 2005, J. Field Robotics.

[7]  D J Giurintano,et al.  A 3D biomechanical model of the hand for power grip. , 2003, Journal of biomechanical engineering.

[8]  Mohamed S. Kamel,et al.  An experimental approach to robotic grasping using a connectionist architecture and generic grasping functions , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[9]  Juan López Coronado,et al.  Neural modelling of hand grip formation during reach to grasp , 2007, Neurocomputing.

[10]  Mitul Saha,et al.  Exact Collision Checking of Robot Paths , 2002, WAFR.

[11]  Masayuki Nakajima,et al.  Detection and evaluation of grasping positions for autonomous agents , 2005, 2005 International Conference on Cyberworlds (CW'05).

[12]  Sung Chan Bae,et al.  Investigation of hand posture during reach and grasp for ergonomic applications , 2011 .

[13]  S. Sathiya Keerthi,et al.  A fast procedure for computing the distance between complex objects in three-dimensional space , 1988, IEEE J. Robotics Autom..

[14]  Paul W. Brand,et al.  Clinical mechanics of the hand , 1985 .

[15]  Antonio Morales,et al.  Grasp modelling with a biomechanical model of the hand , 2014, Computer methods in biomechanics and biomedical engineering.

[16]  D. Giurintano,et al.  Scalability of the Muscular Action in a Parametric 3D Model of the Index Finger , 2007, Annals of Biomedical Engineering.

[17]  B. Buchholz,et al.  Anthropometric data for describing the kinematics of the human hand. , 1992, Ergonomics.

[18]  E. G. Cruz,et al.  Impact of finger posture on mapping from muscle activation to joint torque. , 2006, Clinical biomechanics.

[19]  Ren G Dong,et al.  A practical biomechanical model of the index finger simulating the kinematics of the muscle/tendon excursions. , 2010, Bio-medical materials and engineering.

[20]  Marta C. Mora,et al.  STATIC FORCE RESPONSE OF THE PALMAR SIDE OF THE HUMAN HAND , 2012 .

[21]  Carme Torras,et al.  Collision detection algorithms for motion planning , 1998 .

[22]  J. Denavit,et al.  A kinematic notation for lower pair mechanisms based on matrices , 1955 .

[23]  Josep Tornero,et al.  Hough transform for distance computation and collision avoidance , 2002, IEEE Trans. Robotics Autom..

[24]  Vera Kurková,et al.  Kolmogorov's theorem and multilayer neural networks , 1992, Neural Networks.

[25]  Sang Wook Lee,et al.  Estimation of the effective static moment arms of the tendons in the index finger extensor mechanism. , 2008, Journal of biomechanics.

[26]  K N An,et al.  Normative model of human hand for biomechanical analysis. , 1979, Journal of biomechanics.

[27]  Philippe Gorce,et al.  Prediction of fingers posture using artificial neural networks. , 2008, Journal of biomechanics.

[28]  Siaw Meng Chou,et al.  Development of a finger biomechanical model and its considerations. , 2010, Journal of biomechanics.

[29]  A. Miller,et al.  From robotic hands to human hands: a visualization and simulation engine for grasping research , 2005, Ind. Robot.

[30]  E. Torres-Jara,et al.  Challenges for Robot Manipulation in Human Environments , 2006 .

[31]  Charles C. Kemp,et al.  Challenges for robot manipulation in human environments [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[32]  Sang Wook Lee,et al.  Effect of finger posture on the tendon force distribution within the finger extensor mechanism. , 2008, Journal of biomechanical engineering.

[33]  Jaewon Choi,et al.  Developing a 3-Dimensional Kinematic Model of the Hand for Ergonomic Analyses of Hand Posture, Hand Space Envelope, and Tendon Excursion. , 2008 .

[34]  J L Sancho-Bru,et al.  A 3-D dynamic model of human finger for studying free movements. , 2001, Journal of biomechanics.

[35]  Xudong Zhang,et al.  Development and evaluation of an optimization-based model for power-grip posture prediction. , 2005, Journal of biomechanics.

[36]  Francisco J Valero-Cuevas,et al.  An Integrative Approach to the Biomechanical Function and Neuromuscular Control of the Fingers , 2004 .

[37]  Joseph D. Towles,et al.  Quantification of fingertip force reduction in the forefinger following simulated paralysis of extensor and intrinsic muscles. , 2000, Journal of biomechanics.

[38]  D J Giurintano,et al.  Optimum tool handle diameter for a cylinder grip. , 2003, Journal of hand therapy : official journal of the American Society of Hand Therapists.

[39]  Derek G. Kamper,et al.  Muscle activation patterns during force generation of the index finger , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[40]  Franck Quaine,et al.  Biomechanical model for the determination of the forces acting on the finger pulley system. , 2006, Journal of biomechanics.

[41]  M. Kuperstein,et al.  Implementation of an adaptive neural controller for sensory-motor coordination , 1989, International 1989 Joint Conference on Neural Networks.

[42]  Antonio Bicchi,et al.  Hands for dexterous manipulation and robust grasping: a difficult road toward simplicity , 2000, IEEE Trans. Robotics Autom..

[43]  Franck Quaine,et al.  Is the principle of minimization of secondary moments validated during various fingertip force production conditions? , 2008, Human movement science.

[44]  F. Valero-Cuevas Predictive modulation of muscle coordination pattern magnitude scales fingertip force magnitude over the voluntary range. , 2000, Journal of neurophysiology.

[45]  Tsukasa Ogasawara,et al.  Biomechanical analysis of subjective pinching effort based on tendon-skeletal model , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.