Dynamic Grasp Recognition Using Time Clustering, Gaussian Mixture Models and Hidden Markov Models

The human hand has the capability of fulfilling various everyday-life tasks using the combination of biological mechanisms, sensors and controls. Autonomously controlling multifingered robots is a challenge, which holds the key to related multidisciplinary research and a wide spectrum of applications in intelligent robotics. We demonstrate the state of the art in recognizing continuous grasping gestures of human hands in this paper. We propose a novel time clustering method (TC) and modified Gaussian mixture models (GMMs) and compare them with hidden Markov models (HMMs). The TC outperforms the GMM and HMM methods in terms of recognition rate and potentially in computational cost. Future work is focused on real-time recognition and grasp qualitative description.

[1]  Suguru Arimoto,et al.  Reaching to Grasp and Preshaping of Multi-DOFs Robotic Hand-Arm Systems Using Approximate Configuration of Objects , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Ying Wu,et al.  Capturing natural hand articulation , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[3]  Youlun Xiong,et al.  Fundamentals of robotic grasping and fixturing , 2007 .

[4]  Graçaliz Pereira Dimuro,et al.  Hand Gesture Recognition in an Interval Fuzzy Approach , 2007 .

[5]  Rüdiger Dillmann,et al.  Towards Cognitive Robots: Building Hierarchical Task Representations of Manipulations from Human Demonstration , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[6]  Heni Ben Amor,et al.  Grasp Recognition with Uncalibrated Data Gloves - A Comparison of Classification Methods , 2007, 2007 IEEE Virtual Reality Conference.

[7]  Shandong Wu,et al.  On Signature Invariants for Effective Motion Trajectory Recognition , 2008, Int. J. Robotics Res..

[8]  Geoffrey E. Hinton,et al.  Glove-TalkII-a neural-network interface which maps gestures to parallel formant speech synthesizer controls , 1997, IEEE Trans. Neural Networks.

[9]  Thea Iberall,et al.  Human Prehension and Dexterous Robot Hands , 1997, Int. J. Robotics Res..

[10]  Geoffrey E. Hinton,et al.  Glove-Talk: a neural network interface between a data-glove and a speech synthesizer , 1993, IEEE Trans. Neural Networks.

[11]  Rainer Palm,et al.  Segmentation and Recognition of Human Grasps for Programming-by-Demonstration using Time-clustering and Fuzzy Modeling , 2007, 2007 IEEE International Fuzzy Systems Conference.

[12]  Yael Edan,et al.  Human Factors for Design of Hand Gesture Human - Machine Interaction , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[13]  Honghai Liu,et al.  A Fuzzy Qualitative Framework for Connecting Robot Qualitative and Quantitative Representations , 2008, IEEE Transactions on Fuzzy Systems.

[14]  Loredana Ungureanu,et al.  The Modeling Process of a Human Hand Prosthesis , 2007, 2007 4th International Symposium on Applied Computational Intelligence and Informatics.

[15]  Rainer Palm,et al.  Perception modeling for human-like artificial sensor systems , 2007, Int. J. Hum. Comput. Stud..

[16]  Honghai Liu,et al.  Fuzzy Qualitative Robot Kinematics , 2008, IEEE Transactions on Fuzzy Systems.

[17]  Katsushi Ikeuchi,et al.  A Hidden Markov Model Based Sensor Fusion Approach for Recognizing Continuous Human Grasping Sequences , 2003 .

[18]  Yen-Ting Chen,et al.  Multiple-angle Hand Gesture Recognition by Fusing SVM Classifiers , 2007, 2007 IEEE International Conference on Automation Science and Engineering.

[19]  Xiangyang Zhu,et al.  An Efficient Algorithm for Grasp Synthesis and Fixture Layout Design in Discrete Domain , 2007, IEEE Transactions on Robotics.

[20]  Benjamín R. C. Bedregal,et al.  Fuzzy Rule-Based Hand Gesture Recognition , 2006, IFIP AI.

[21]  Katsushi Ikeuchi,et al.  A sensor fusion approach for recognizing continuous human grasping sequences using hidden Markov models , 2005, IEEE Transactions on Robotics.

[22]  Antonio Bicchi,et al.  Hands for dexterous manipulation and robust grasping: a difficult road toward simplicity , 2000, IEEE Trans. Robotics Autom..