Robust Hand Tracker Using Joint Temporal Weighted Histogram Features

Herein, a novel automatic hand-tracking approach based on temporal histogram features is proposed. Our method utilizes the joint temporal weighted histogram (JTWH) to track the hand robustly. When tracking begins, the hand model is initialized using a hand detector. During the tracking process, the hand model is updated using the most recent frame data and the hand tracker uses the weighted temporal model to track the hand persistently and robustly. The weights are calculated using the temporal and spatial similarity between the hand model and the current tracked hand. Because hand movement can be fast and may produce deformation, a weighted histogram was selected for the single hand model. Experiments demonstrate the proposed algorithm’s ability to track the moving hand robustly in comparison with several traditional hand-tracking algorithms. The proposed approach is robust in the complex background, and it can track the hand quickly and effectively.

[1]  Mircea Nicolescu,et al.  Vision-based hand pose estimation: A review , 2007, Comput. Vis. Image Underst..

[2]  Vittorio Murino,et al.  Decentralized particle filter for joint individual-group tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Jiri Matas,et al.  Face-TLD: Tracking-Learning-Detection applied to faces , 2010, 2010 IEEE International Conference on Image Processing.

[4]  Cordelia Schmid,et al.  DeepFlow: Large Displacement Optical Flow with Deep Matching , 2013, 2013 IEEE International Conference on Computer Vision.

[5]  A. Hadid,et al.  The Local Binary Pattern Approach and its Applications to Face Analysis , 2008, 2008 First Workshops on Image Processing Theory, Tools and Applications.

[6]  N.D. Georganas,et al.  Real-time Vision-based Hand Gesture Recognition Using Haar-like Features , 2007, 2007 IEEE Instrumentation & Measurement Technology Conference IMTC 2007.

[7]  David Zhang,et al.  Texture Enhanced Image Denoising via Gradient Histogram Preservation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Zhuwen Li,et al.  Perspective Motion Segmentation via Collaborative Clustering , 2013, 2013 IEEE International Conference on Computer Vision.

[9]  Shenghuo Zhu,et al.  Efficient Object Detection and Segmentation for Fine-Grained Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Björn Stenger,et al.  Template-Based Hand Pose Recognition Using Multiple Cues , 2006, ACCV.

[11]  Richard Bowden,et al.  A boosted classifier tree for hand shape detection , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[12]  Mubarak Shah,et al.  Video Object Segmentation through Spatially Accurate and Temporally Dense Extraction of Primary Object Regions , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.