RGB-D Hand Pose Estimation Using Fourier Descriptor

The emergence of civil-use depth sensors made vision-based man-machine interaction possible through hand gesture, which relies fundamentally on hand pose estimation techniques. In this work, a novel hand pose estimation method is proposed, based essentially on Fourier-descriptor-based indexing in a pre-built hand template library. The proposed method takes color-depth as input, extracts necessary hand information in preprocessing, and estimate hand pose through two stages, from rough to accurate. This proposed hand pose estimation method is simple and efficient; quantitative and qualitative evaluations exhibit its effectiveness.

[1]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Andrew W. Fitzgibbon,et al.  Efficient and precise interactive hand tracking through joint, continuous optimization of pose and correspondences , 2016, ACM Trans. Graph..

[3]  Karthik Ramani,et al.  DeepHand: Robust Hand Pose Estimation by Completing a Matrix Imputed with Deep Features , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  David C. Hogg,et al.  Towards 3D hand tracking using a deformable model , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[5]  Chen Qian,et al.  Realtime and Robust Hand Tracking from Depth , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Antonis A. Argyros,et al.  Efficient model-based 3D tracking of hand articulations using Kinect , 2011, BMVC.

[7]  Guojun Lu,et al.  A comparative study of curvature scale space and Fourier descriptors for shape-based image retrieval , 2003, J. Vis. Commun. Image Represent..

[8]  Dehui Kong,et al.  Extracting hand articulations from monocular depth images using curvature scale space descriptors , 2016, Frontiers of Information Technology & Electronic Engineering.

[9]  Andrew W. Fitzgibbon,et al.  Accurate, Robust, and Flexible Real-time Hand Tracking , 2015, CHI.

[10]  Lale Akarun,et al.  Hand Pose Estimation and Hand Shape Classification Using Multi-layered Randomized Decision Forests , 2012, ECCV.

[11]  Antonis A. Argyros,et al.  A GPU-powered Computational Framework for Efficient 3D Model-based Vision , 2011 .