Finger identification and hand gesture recognition techniques for natural user interface

The natural user interface using hand gesture have been popular field in Human-Computer-Interaction(HCI). Many research papers have been proposed in this field. They proposed vision-based, glove-based and depth-based approach for hand gesture recognition. However, hand gesture itself is simple and not natural way to interact. In otherwise, hand gesture recognition using finger tracking and identification can be implemented more robust and subtle recognition. Recently, new horizons are open with the development of sensors and technology such as Kinect and Depth-Sense. This development has made possible robust recognition, like finger identification and hand gesture recognition in bad conditions such as dark light and rough background as well. In this paper, we proposed a new finger identification and hand gesture recognition techniques with kinect depth data. Our proposed finger identification and gesture recognition methods provide natural interactions and interface by using fingers. We implemented interfaces and designed hand gestures using this method. This paper explains finger identification method and hand gesture recognition in detail. We show the preliminary experiment for evaluating accuracy of finger identification and hand gesture recognition accuracy. Finally, we discuss the result of evaluation and our contributions.

[1]  Sung-Tae Jung,et al.  Real-time gesture recognition using 3D depth camera , 2011, 2011 IEEE 2nd International Conference on Software Engineering and Service Science.

[2]  Shahrokh Valaee,et al.  A Novel Accelerometer-based Gesture Recognition System by , 2010 .

[3]  Hanseok Ko,et al.  Gesture recognition using depth-based hand tracking for contactless controller application , 2012, 2012 IEEE International Conference on Consumer Electronics (ICCE).

[4]  Junsong Yuan,et al.  Robust hand gesture recognition with kinect sensor , 2011, ACM Multimedia.

[5]  Ronald L. Graham,et al.  An Efficient Algorithm for Determining the Convex Hull of a Finite Planar Set , 1972, Inf. Process. Lett..

[6]  Yael Edan,et al.  Vision-based hand-gesture applications , 2011, Commun. ACM.

[7]  Shashank Sonkar,et al.  Hand Gesture Recognition Using Microsoft ’ s Kinect , 2012 .

[8]  D. McNeill.  So you think gestures are nonverbal , 1985 .

[9]  Domenico Prattichizzo,et al.  Using Kinect for hand tracking and rendering in wearable haptics , 2011, 2011 IEEE World Haptics Conference.

[10]  Jiro Tanaka,et al.  Hand Gesture for Taking Self Portrait , 2011, HCI.

[11]  Gregory Goth.  Brave NUI world , 2011, CACM.

[12]  Kikuo Fujimura,et al.  Visual Tracking Using Depth Data , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[13]  Ankit Chaudhary,et al.  Tracking of Fingertips and Centers of Palm Using KINECT , 2011, 2011 Third International Conference on Computational Intelligence, Modelling & Simulation.

[14]  Lars Bretzner,et al.  Computer Vision Based Hand Gesture Interfaces for Human-Computer Interaction , 2002 .

[15]  Holger Kenn,et al.  A glove-based gesture interface for wearable computing applications , 2007 .