A survey of 2D and 3D imaging used in hand gesture recognition for human-computer interaction (HCI)

Interaction of human body movements through any machines or computing device is a man-computer interaction (HCI). Human hand movements or gestures are the best ways of interacting with any machine, which allows the user to communicate and control any remotely placed device. This includes control of any home appliance, to control a robot, track a player or its body position, control movement and orientation of games and also control any man-machine interaction. With the rapid development in a 3D application and virtual environment, there is a need of devices which interact between the human and the computer system. This paper presents the study of the techniques applied for recognizing gesture in real time application. It also highlights on various techniques and the conditions under which the methodologies are employed. Further, the methodologies in terms of rate of recognition and limitations are explored. Finally we highlight the challenges in real-time gesture recognition.

[1]  Chih-Hung Wu,et al.  Depth-based hand gesture recognition , 2015, Multimedia Tools and Applications.

[2]  C. Creider.  Hand and Mind: What Gestures Reveal about Thought , 1994 .

[3]  Stan Sclaroff,et al.  Translation and scale-invariant gesture recognition in complex scenes , 2008, PETRA '08.

[4]  Surve Pranjali.  Hand Gesture Recognition Systems: A Survey , 2015 .

[5]  Chung-Lin Huang,et al.  Hand gesture recognition using a real-time tracking method and hidden Markov models , 2003, Image Vis. Comput..

[6]  Jason Jianjun Gu,et al.  Combining features for Chinese sign language recognition with Kinect , 2014, 11th IEEE International Conference on Control & Automation (ICCA).

[7]  Markus Koskela,et al.  Using Appearance-Based Hand Features for Dynamic RGB-D Gesture Recognition , 2014, 2014 22nd International Conference on Pattern Recognition.

[8]  Jong-Il Park,et al.  Hand shape recognition using distance transform and shape decomposition , 2011, 2011 18th IEEE International Conference on Image Processing.

[9]  Sameem Abdul Kareem,et al.  Feature Extraction Technique for Static Hand Gesture Recognition , 2015 .

[10]  Luís Paulo Reis,et al.  Generic System for Human-Computer Gesture Interaction: Applications on Sign Language Recognition and Robotic Soccer Refereeing , 2015, J. Intell. Robotic Syst..

[11]  Frol Periverzov,et al.  3D Imaging for hand gesture recognition: Exploring the software-hardware interaction of current technologies , 2012 .

[12]  Chen-Chiung Hsieh,et al.  Novel Haar features for real-time hand gesture recognition using SVM , 2012, Journal of Real-Time Image Processing.

[13]  Haitham Hasan,et al.  RETRACTED ARTICLE: Human–computer interaction using vision-based hand gesture recognition systems: a survey , 2013, Neural Computing and Applications.

[14]  Bing Luo,et al.  A real-time dynamic hand gesture recognition system using kinect sensor , 2015, 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[15]  Aldo von Wangenheim,et al.  Comparative evaluation of static gesture recognition techniques based on nearest neighbor, neural networks and support vector machines , 2010, Journal of the Brazilian Computer Society.

[16]  Dan Xu,et al.  Online Dynamic Gesture Recognition for Human Robot Interaction , 2015, J. Intell. Robotic Syst..

[17]  F. Wong,et al.  Hidden Markov Model-Based Gesture Recognition with Overlapping Hand-Head/Hand-Hand Estimated Using Kalman Filter , 2012, 2012 Third International Conference on Intelligent Systems Modelling and Simulation.

[18]  Massimo Panella,et al.  An Accurate Algorithm for the Identification of Fingertips Using an RGB-D Camera , 2013, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[19]  Haitham Hasan,et al.  Retraction Note to: Human–computer interaction using vision-based hand gesture recognition systems: a survey , 2017, Neural Computing and Applications.

[20]  Yuan Yao,et al.  Contour Model-Based Hand-Gesture Recognition Using the Kinect Sensor , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Janusz Konrad,et al.  A gesture-driven computer interface using Kinect , 2012, 2012 IEEE Southwest Symposium on Image Analysis and Interpretation.

[22]  R. S. Jadon,et al.  A REVIEW OF VISION BASED HAND GESTURES RECOGNITION , 2009 .

[23]  N.D. Georganas,et al.  Real-time Vision-based Hand Gesture Recognition Using Haar-like Features , 2007, 2007 IEEE Instrumentation & Measurement Technology Conference IMTC 2007.

[24]  U. A. A. Niroshika,et al.  Enhanced feature extraction method for hand gesture recognition using support vector machine , 2013, 2013 IEEE 8th International Conference on Industrial and Information Systems.

[25]  Lars Bretzner,et al.  Hand gesture recognition using multi-scale colour features, hierarchical models and particle filtering , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[26]  Asadollah Shahbahrami,et al.  Human Computer Interaction Using Vision-Based Hand Gesture Recognition , 2009 .

[27]  Chi-Man Pun,et al.  Real-time Hand Gesture Recognition from Depth Image Sequences , 2012, 2012 Ninth International Conference on Computer Graphics, Imaging and Visualization.

[28]  Mario Menix,et al.  Interpretation of divers' symbolic language by using hidden Markov models , 2014, 2014 37th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).

[29]  Anupam Agrawal,et al.  Vision based hand gesture recognition for human computer interaction: a survey , 2012, Artificial Intelligence Review.

[30]  Xiaolong Zhu,et al.  Single-frame hand gesture recognition using color and depth kernel descriptors , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).