3D Depth Information Based 2D Low-Complexity Hand Posture and Gesture Recognition Design for Human Computer Interactions

Owing to the smart applications of human-computer interaction (HCI), the hand posture and gesture recognition technologies have acquired more and more attentions recently. In this work, the 2D low-complexity hand gesture identification technology is proposed based on 3D depth information. The proposed design overcomes the difficulties to separate the integrated palm region from the complex background. First, the proposed system uses the 3D depth camera to obtain the depth information. Then the system uses the depth image of the palm area to extract the contour and features of hand. By the contour and features of hand from geometric relationship, the proposed design recognizes several useful hand postures and gestures effectively. In our experiments, the recognition accuracy of hand gestures can be up to 98%. By implementing with the 4-core PC (Intel i7−4720, 2.6GHz, 8GB RAM), the average processing speed is up to 15 frames per second.

[1]  Ian D. Walker,et al.  Use of kinect depth data and Growing Neural Gas for gesture based robot control , 2012, 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[2]  Jack Sklansky,et al.  Measuring Concavity on a Rectangular Mosaic , 1972, IEEE Transactions on Computers.

[3]  Lale Akarun,et al.  DTW Based Clustering to Improve Hand Gesture Recognition , 2011, HBU.

[4]  T. Pavlidis.  Algorithms for Graphics and Image Processing , 1981, Springer Berlin Heidelberg.

[5]  Stefan Gheorghe Pentiuc,et al.  An Efficient Solution for Hand Gesture Recognition from Video Sequence , 2012 .

[6]  Vassilis Athitsos,et al.  Comparing gesture recognition accuracy using color and depth information , 2011, PETRA '11.

[7]  Luc Van Gool,et al.  Combining RGB and ToF cameras for real-time 3D hand gesture interaction , 2011, WACV.

[8]  Surve Pranjali.  Hand Gesture Recognition Systems: A Survey , 2015 .

[9]  Chih-Hsien Hsia,et al.  Hierarchical Method for Foreground Detection Using Codebook Model , 2011, IEEE Trans. Circuits Syst. Video Technol..

[10]  Janusz Konrad,et al.  A gesture-driven computer interface using Kinect , 2012, 2012 IEEE Southwest Symposium on Image Analysis and Interpretation.

[11]  Mokhtar M. Hasan,et al.  Hand Gesture Modeling and Recognition using Geometric Features: A Review , 2012 .

[12]  Mircea Nicolescu,et al.  Hand-based verification and identification using palm-finger segmentation and fusion , 2009, Comput. Vis. Image Underst..