Real-Time Hand Gesture Recognition Using Finger Segmentation

Hand gesture recognition is very significant for human-computer interaction. In this work, we present a novel real-time method for hand gesture recognition. In our framework, the hand region is extracted from the background with the background subtraction method. Then, the palm and fingers are segmented so as to detect and recognize the fingers. Finally, a rule classifier is applied to predict the labels of hand gestures. The experiments on the data set of 1300 images show that our method performs well and is highly efficient. Moreover, our method shows better performance than a state-of-art method on another data set of hand gestures.

[1]  Ruiduo Yang,et al.  Handling Movement Epenthesis and Hand Segmentation Ambiguities in Continuous Sign Language Recognition Using Nested Dynamic Programming , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Shaun J. Canavan,et al.  Hand Pointing Estimation for Human Computer Interaction Based on Two Orthogonal-Views , 2010, 2010 20th International Conference on Pattern Recognition.

[3]  Chan-Su Lee,et al.  Articulated hand configuration and rotation estimation using extended torus manifold embedding , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[4]  Jörg Stückler,et al.  Learning to interpret pointing gestures with a time-of-flight camera , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[5]  Alberto Del Bimbo,et al.  Real-time hand status recognition from RGB-D imagery , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[6]  Venu Govindaraju,et al.  A Framework for Hand Gesture Recognition and Spotting Using Sub-gesture Modeling , 2010, 2010 20th International Conference on Pattern Recognition.

[7]  Tong-de Tan,et al.  Research of hand positioning and gesture recognition based on binocular vision , 2011, 2011 IEEE International Symposium on VR Innovation.

[8]  M. Panwar.  Hand gesture recognition based on shape parameters , 2012, 2012 International Conference on Computing, Communication and Applications.

[9]  Imran A. Syed,et al.  HCI using hand gesture recognition for Digital Sand Model , 2013, 2013 IEEE Second International Conference on Image Information Processing (ICIIP-2013).

[10]  Anbumani Subramanian,et al.  Dynamic Hand Pose Recognition Using Depth Data , 2010, 2010 20th International Conference on Pattern Recognition.

[11]  Jeng-Shyang Pan,et al.  Dominant Points Based Hand Finger Counting for Recognition under Skin Color Extraction in Hand Gesture Control System , 2012, 2012 Sixth International Conference on Genetic and Evolutionary Computing.

[12]  Hui Li,et al.  Kinect Based Dynamic Hand Gesture Recognition Algorithm Research , 2012, 2012 4th International Conference on Intelligent Human-Machine Systems and Cybernetics.

[13]  Takayoshi Yamashita,et al.  Hand gesture based TV control system — Towards both user- & machine-friendly gesture applications , 2013, The 19th Korea-Japan Joint Workshop on Frontiers of Computer Vision.

[14]  Domenico Prattichizzo,et al.  Using Kinect for hand tracking and rendering in wearable haptics , 2011, 2011 IEEE World Haptics Conference.

[15]  Sangyoun Lee,et al.  3D hand tracking using Kalman filter in depth space , 2012, EURASIP J. Adv. Signal Process..

[16]  Ulrich Neumann,et al.  Real-time Hand Pose Recognition Using Low-Resolution Depth Images , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[17]  Thad Starner,et al.  American sign language recognition with the kinect , 2011, ICMI '11.

[18]  Luc Van Gool,et al.  Real-time sign language letter and word recognition from depth data , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[19]  Cheng Li,et al.  Pixel-Level Hand Detection in Ego-centric Videos , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Junsong Yuan,et al.  Robust Part-Based Hand Gesture Recognition Using Kinect Sensor , 2013, IEEE Transactions on Multimedia.

[21]  Yaoru Sun,et al.  A Natural Hand Gesture System for Intelligent Human-Computer Interaction and Medical Assistance , 2012, 2012 Third Global Congress on Intelligent Systems.

[22]  Ayoub Al-Hamadi,et al.  A Robust Method for Hand Gesture Segmentation and Recognition Using Forward Spotting Scheme in Conditional Random Fields , 2010, 2010 20th International Conference on Pattern Recognition.

[23]  Ankit Chaudhary,et al.  Tracking of Fingertips and Centers of Palm Using KINECT , 2011, 2011 Third International Conference on Computational Intelligence, Modelling & Simulation.

[24]  Lale Akarun,et al.  Real time hand pose estimation using depth sensors , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[25]  Yoshiaki Shirai,et al.  Real-time and precise 3-D hand posture estimation based on classification tree trained with variations of appearances , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[26]  Jong-Il Park,et al.  Hand shape recognition using distance transform and shape decomposition , 2011, 2011 18th IEEE International Conference on Image Processing.

[27]  Ulrich Lang,et al.  Markerless gesture based interaction for design review scenarios , 2009, 2009 Second International Conference on the Applications of Digital Information and Web Technologies.

[28]  Nicolas Pugeault,et al.  Spelling it out: Real-time ASL fingerspelling recognition , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[29]  Radu Horaud,et al.  Hand Motion from 3D Point Trajectories and a Smooth Surface Model , 2004, ECCV.