Real-time Hand Tracking Using Kinect

Real-time hand tracking is fundamental to human gesture recognition. However, due to the huge computation, previous studies are either off-line or limited to given poses. In order to satisfy the requirement of real-time hand tracking, in this paper we propose a real time hand tracking method using Kinect. Firstly we extract the hand region from the depth image output from Kinect. Then we achieve the hand parameters. During the procedure of hand region extraction, we propose a cascade structure with recursive connected component algorithm to improve the efficiency and reserve connection relationships in 3D space. To determine the fingertips, we use the former 3D connections and geodesic distance over hand skeleton pixels to guarantee the accuracy and robustness, with acceptable loss. Experimental results show that our proposed solution can significantly improve the quality of real-time hand tracking.

[1]  Ankit Chaudhary,et al.  Intelligent Approaches to interact with Machines using Hand Gesture Recognition in Natural way: A Survey , 2011, ArXiv.

[2]  Antti Oulasvirta,et al.  Fast and robust hand tracking using detection-guided optimization , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Wenbing Zhao,et al.  A Survey of Applications and Human Motion Recognition with Microsoft Kinect , 2015, Int. J. Pattern Recognit. Artif. Intell..

[4]  Kook-Yeol Yoo.  Robust hand segmentation and tracking to illumination variation , 2014, 2014 IEEE International Conference on Consumer Electronics (ICCE).

[5]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[6]  Daniel Thalmann,et al.  3D fingertip and palm tracking in depth image sequences , 2012, ACM Multimedia.

[7]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[8]  Rayi Yanu Tara,et al.  Hand Segmentation from Depth Image using Anthropometric Approach in Natural Interface Development , 2012 .

[9]  Richard Bowden,et al.  Multi-touchless: Real-time fingertip detection and tracking using geodesic maxima , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[10]  Rod McCall,et al.  Lightweight palm and finger tracking for real-time 3D gesture control , 2011, 2011 IEEE Virtual Reality Conference.

[11]  Andrew W. Fitzgibbon,et al.  Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences , 2016, ACM Trans. Graph..

[12]  Yunzhe Jia,et al.  A Real-Time Hand Gesture Recognition Approach Based on Motion Features of Feature Points , 2014, 2014 IEEE 17th International Conference on Computational Science and Engineering.