Fingertip Detection and Gesture Recognition Based on Contour Approximation

In this paper, a new recognition algorithm was developed based on the skin color model and the fingertip structure detection to improve the hand gesture recognition accuracy based on the traditional Hu's moment features. Firstly, the geometric features and the areas of skin were adopted to segment the skin region from the background. The Douglas–Peucker (D–P) algorithm was utilized to conduct the contour approximation to get a polygonal in the process of feature detection. Then the convexity point inspections were conducted in the polygonal. Secondly, we developed two rules for locating and numbering the fingertips. After that, we built a seven-dimensional feature vector. Finally, the hand gesture was recognized by using the distance matching criterion. The developed recognition algorithm improved the recognition accuracy by 2.7% compared with the traditional Hu's moment features. Additionally, it has good robustness in several manners such as shifting, plane rotation and scaling.

[1]  Stan Sclaroff,et al.  A Unified Framework for Gesture Recognition and Spatiotemporal Gesture Segmentation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Helge J. Ritter,et al.  Visual recognition of continuous hand postures , 2002, IEEE Trans. Neural Networks.

[3]  Prashan Premaratne,et al.  Consumer electronics control system based on hand gesture moment invariants , 2007 .

[4]  Yoji Yamada,et al.  An adaptive visual attentive tracker for human communicational behaviors using HMM-based TD learning with new State distinction capability , 2005, IEEE Transactions on Robotics.

[5]  Chia-Feng Juang,et al.  Computer Vision-Based Human Body Segmentation and Posture Estimation , 2009, SMC 2009.

[6]  Jungsik Park,et al.  iHand: an interactive bare-hand-based augmented reality interface on commercial mobile phones , 2013 .

[7]  Bülent Sankur,et al.  Shape-based hand recognition , 2006, IEEE Transactions on Image Processing.

[8]  Annamária R. Várkonyi-Kóczy,et al.  Human–Computer Interaction for Smart Environment Applications Using Fuzzy Hand Posture and Gesture Models , 2011, IEEE Transactions on Instrumentation and Measurement.

[9]  Zhong Xie,et al.  The improved Douglas-Peucker algorithm based on the contour character , 2011, 2011 19th International Conference on Geoinformatics.

[10]  Daeho Lee,et al.  Vision-based remote control system by motion detection and open finger counting , 2009, IEEE Transactions on Consumer Electronics.

[11]  Jeen-Shing Wang,et al.  An Accelerometer-Based Digital Pen With a Trajectory Recognition Algorithm for Handwritten Digit and Gesture Recognition , 2012, IEEE Transactions on Industrial Electronics.

[12]  B. Prabhakaran,et al.  Hand-Gesture Computing for the Hearing and Speech Impaired , 2008, IEEE MultiMedia.

[13]  Yu Yue.  A comparison of two methods for model matching algorithm , 2012 .

[14]  Jungsik Park,et al.  Bare-hand-based augmented reality interface on mobile phone , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.