Human hand descriptions and gesture recognition for object manipulation

This work focuses on obtaining realistic human hand models that are suitable for manipulation tasks. A 24 degrees of freedom (DoF) kinematic model of the human hand is defined. The model reasonably satisfies realism requirements in simulation and movement. To achieve realism, intra- and inter-finger constraints are obtained. The design of the hand model with 24 DoF is based upon a morphological, physiological and anatomical study of the human hand. The model is used to develop a gesture recognition procedure that uses principal components analysis (PCA) and discriminant functions. Two simplified hand descriptions (nine and six DoF) have been developed in accordance with the constraints obtained previously. The accuracy of the simplified models is almost 5% for the nine DoF hand description and 10% for the six DoF hand description. Finally, some criteria are defined by which to select the hand description best suited to the features of the manipulation task.

[1]  I. Kapandji.  The Physiology of the Joints , 1988 .

[2]  R. Dumas,et al.  A joint coordinate system proposal for the study of the trapeziometacarpal joint kinematics , 2009, Computer methods in biomechanics and biomedical engineering.

[3]  Nicol N. Schraudolph,et al.  Stochastic optimisation for high-dimensional tracking in dense range maps , 2005 .

[4]  D. C. Schoen.  The Hand , 2009, Orthopedic nursing.

[5]  W. Wolovich,et al.  A computational technique for inverse kinematics , 1984, The 23rd IEEE Conference on Decision and Control.

[6]  Aleix M. Martínez,et al.  Where are linear feature extraction methods applicable? , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Philippe Gorce,et al.  Effect of spatial constraints on the underlying joint coordination during reach-to-grasp movements: UCM analysis , 2007 .

[8]  René Malek.  Biomechanics of the thumb , 2008 .

[9]  Ying Wu,et al.  Modeling the constraints of human hand motion , 2000, Proceedings Workshop on Human Motion.

[10]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[11]  Mark R. Cutkosky,et al.  Modeling manufacturing grips and correlations with the design of robotic hands , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[12]  I. Jolliffe.  Principal Component Analysis , 2002 .

[13]  Chin-Shyurng Fahn,et al.  Development of a data glove with reducing sensors based on magnetic induction , 2005, IEEE Transactions on Industrial Electronics.

[14]  Edoardo Charbon,et al.  3D Hand Model Fitting for Virtual Keyboard System , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[15]  Javier Ortego,et al.  Multi-finger Haptic Interface for Collaborative Tasks in Virtual Environments , 2007, HCI.

[16]  C. Fernando,et al.  The Physiology of the Joints Vol 3, The Trunk and the Vertebral Column , 1975 .

[17]  Lianne Jones,et al.  Reduction, classification and ranking of motion analysis data: an application to osteoarthritic and normal knee function data , 2008, Computer methods in biomechanics and biomedical engineering.

[18]  F. B. Ouezdou,et al.  Dynamic simulation of hand-forearm system , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[19]  Fethi Ben Ouezdou,et al.  Muscle forces prediction of the human hand and forearm system in highly realistic simulation , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[20]  W. S. Monkhouse,et al.  GRAY'S ANATOMY , 1947 .

[21]  M. A. Zohdy,et al.  Robust Control of Robotic Manipulators , 1989, 1989 American Control Conference.

[22]  M. Spong,et al.  Robot Modeling and Control , 2005 .

[23]  T. S. Huang,et al.  Human computer interaction via the human hand: a hand model , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[24]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[25]  J. M. Selig.  Geometric Fundamentals of Robotics (Monographs in Computer Science) , 2004 .

[26]  J. Denavit,et al.  A kinematic notation for lower pair mechanisms based on matrices , 1955 .

[27]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..