Real-time hand posture recognition based on hand dominant line using kinect

Depth sensors like Kinect can provide 2.5D depth data, which shows a extreme difference with regular color data. This paper proposes a simple and novel algorithm to perform hand posture classification using depth sensors. We present the notation of hand dominant line which can be used to make our hand descriptor rotation invariant. The recognition system combines our descriptor and SVM classifier and achieves robust hand pose recognition in real time. In cross validation test where half of dataset is used to train while the other half is used to test, we achieve 97.1% success rate on NTU Dataset and 96.2% on a subset of ASL(American Sign Language) dataset.

[1]  Anbumani Subramanian,et al.  Dynamic Hand Pose Recognition Using Depth Data , 2010, 2010 20th International Conference on Pattern Recognition.

[2]  Nicolas Pugeault,et al.  Spelling it out: Real-time ASL fingerspelling recognition , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[3]  Lale Akarun,et al.  Real time hand pose estimation using depth sensors , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[4]  Lale Akarun,et al.  Randomized decision forests for static and dynamic hand shape classification , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[5]  Junsong Yuan,et al.  Robust hand gesture recognition based on finger-earth mover's distance with a commodity depth camera , 2011, ACM Multimedia.

[6]  Kanad K. Biswas,et al.  Gesture recognition using Microsoft Kinect® , 2011, The 5th International Conference on Automation, Robotics and Applications.

[7]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[8]  Xia Liu,et al.  Hand gesture recognition using depth data , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..