RETRACTED ARTICLE: Human–computer interaction using vision-based hand gesture recognition systems: a survey

Considerable effort has been put toward the development of intelligent and natural interfaces between users and computer systems. In line with this endeavor, several modes of information (e.g., visual, audio, and pen) that are used either individually or in combination have been proposed. The use of gestures to convey information is an important part of human communication. Hand gesture recognition is widely used in many applications, such as in computer games, machinery control (e.g., crane), and thorough mouse replacement. Computer recognition of hand gestures may provide a natural computer interface that allows people to point at or to rotate a computer-aided design model by rotating their hands. Hand gestures can be classified into two categories: static and dynamic. The use of hand gestures as a natural interface serves as a motivating force for research on gesture taxonomy, its representations, and recognition techniques. This paper summarizes the surveys carried out in human--computer interaction (HCI) studies and focuses on different application domains that use hand gestures for efficient interaction. This exploratory survey aims to provide a progress report on static and dynamic hand gesture recognition (i.e., gesture taxonomies, representations, and recognition techniques) in HCI and to identify future directions on this topic.

[1]  Rod McCall,et al.  Lightweight palm and finger tracking for real-time 3D gesture control , 2011, 2011 IEEE Virtual Reality Conference.

[2]  Siddharth Swarup Rautaray,et al.  Real Time Hand Gesture Recognition System for Dynamic Applications , 2012 .

[3]  Mohan M. Trivedi,et al.  3-D Posture and Gesture Recognition for Interactivity in Smart Spaces , 2012, IEEE Transactions on Industrial Informatics.

[4]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[5]  Jens Keil,et al.  Multi-touch gestural interaction in X3D using hidden Markov models , 2008, VRST '08.

[6]  Rafael Radkowski,et al.  Interactive Hand Gesture-based Assembly for Augmented Reality Applications , 2012, ACHI 2012.

[7]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  Lars Bretzner,et al.  Hand gesture recognition using multi-scale colour features, hierarchical models and particle filtering , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[9]  Wu-Chih Hu,et al.  Gabor filter-based hand-pose angle estimation for hand gesture recognition under varying illumination , 2011, Expert Syst. Appl..

[10]  程俊,et al.  Feature Fusion for 3D Hand Gesture Recognition by Learning a Shared Hidden Space , 2012 .

[11]  Luc Van Gool,et al.  Combining RGB and ToF cameras for real-time 3D hand gesture interaction , 2011, WACV.

[12]  Jing Xu,et al.  A real-time command system based on hand gesture recognition , 2011, 2011 Seventh International Conference on Natural Computation.

[13]  Samir Benbelkacem,et al.  Hand gesture interaction using color-based method for tabletop interfaces , 2011, 2011 IEEE 7th International Symposium on Intelligent Signal Processing.

[14]  Bao Jiatong Dynamic Hand Gesture Recognition Based on SURF Tracking , 2011 .

[15]  Sung-Tae Jung,et al.  Real-time gesture recognition using 3D depth camera , 2011, 2011 IEEE 2nd International Conference on Software Engineering and Service Science.

[16]  Patrick Lambert,et al.  Dynamic Hand Gesture Recognition Using the Skeleton of the Hand , 2005, EURASIP J. Adv. Signal Process..

[17]  D. Ramage,et al.  Hidden Markov Models Fundamentals , 2007 .

[18]  Marco Cupelli,et al.  Real-time viewpoint-invariant hand localization with cluttered backgrounds , 2012, Image Vis. Comput..

[19]  Chun-Xia Zhang,et al.  An Application of Classifier Combination Methods in Hand Gesture Recognition , 2012 .

[20]  Dan Ionescu,et al.  A Multimodal Interaction Method that Combines Gestures and Physical Game Controllers , 2011, 2011 Proceedings of 20th International Conference on Computer Communications and Networks (ICCCN).

[21]  Niels Henze,et al.  Gesture recognition with a Wii controller , 2008, TEI.

[22]  Gerard J. Holzmann,et al.  Design and validation of computer protocols , 1991 .

[23]  Michael J. Black,et al.  Analysis of gesture and action in technical talks for video indexing , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  C. Creider Hand and Mind: What Gestures Reveal about Thought , 1994 .

[25]  S. Abdul-Kareem,et al.  Static hand gesture recognition using neural networks , 2012 .

[26]  Jianping Fan,et al.  Human action detection via boosted local motion histograms , 2010, Machine Vision and Applications.

[27]  Siddharth Swarup Rautaray,et al.  A novel human computer interface based on hand gesture recognition using computer vision techniques , 2010, IITM '10.

[28]  Chung-Lin Huang,et al.  A multi-view vision-based hand motion capturing system , 2011, Pattern Recognit..

[29]  Saida Bouakaz,et al.  3D Hand Model Animation with a New Data-Driven Method , 2011, 2011 Workshop on Digital Media and Digital Content Management.

[30]  A K Bourke,et al.  Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm. , 2007, Gait & posture.

[31]  Annamária R. Várkonyi-Kóczy,et al.  Human–Computer Interaction for Smart Environment Applications Using Fuzzy Hand Posture and Gesture Models , 2011, IEEE Transactions on Instrumentation and Measurement.

[32]  Sameem Abdul Kareem,et al.  Fingerprint image enhancement and recognition algorithms: a survey , 2012, Neural Computing and Applications.

[33]  Dan Ionescu,et al.  An intelligent gesture interface for controlling TV sets and set-top boxes , 2011, 2011 6th IEEE International Symposium on Applied Computational Intelligence and Informatics (SACI).

[34]  Konrad P. Körding,et al.  A learning rule for dynamic recruitment and decorrelation , 2000, Neural Networks.

[35]  Aiguo Song,et al.  Dynamic hand gesture recognition based on SURF tracking , 2011 .

[36]  Wen Tang,et al.  Motion Capture of Hand Movements Using Stereo Vision for Minimally Invasive Vascular Interventions , 2011, 2011 Sixth International Conference on Image and Graphics.

[37]  D. Ghosh,et al.  Trajectory modeling in gesture recognition using CyberGloves/sup /spl reg// and magnetic trackers , 2004, 2004 IEEE Region 10 Conference TENCON 2004..

[38]  E. Hall The Silent Language , 1959 .

[39]  Agnès Just,et al.  Two-Handed Gestures for Human-Computer Interaction , 2006 .

[40]  Naomi Krishnarajah,et al.  Capturing Hand Gesture Movement: A Survey on Tools, Techniques and Logical Considerations , 2011 .

[41]  Klaus Hopf,et al.  Near and far distance gesture tracking for 3D applications , 2011, 2011 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[42]  Christian Wöhler,et al.  An adaptable time-delay neural-network algorithm for image sequence analysis , 1999, IEEE Trans. Neural Networks.

[43]  Ankit Chaudhary,et al.  Intelligent Approaches to interact with Machines using Hand Gesture Recognition in Natural way: A Survey , 2011, ArXiv.

[44]  Pavel Senin,et al.  Dynamic Time Warping Algorithm Review , 2008 .

[45]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[46]  Yael Edan,et al.  Vision-based hand-gesture applications , 2011, Commun. ACM.

[47]  Mohamed Kaâniche,et al.  Gesture recognition from video sequences , 2009 .

[48]  Chen-Chiung Hsieh,et al.  A real time hand gesture recognition system using motion history image , 2010, 2010 2nd International Conference on Signal Processing Systems.

[49]  Patrick Boissy,et al.  A smart sensor based on rules and its evaluation in daily routines , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[50]  Zuwen Wang,et al.  Modeling and interaction of virtual hand based on Virtools , 2011, 2011 International Conference on Multimedia Technology.

[51]  Bernard Boulay Human Posture Recognition for Behaviour , 2007 .

[52]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[53]  Maria Karam,et al.  A framework for research and design of gesture-based human-computer interactions , 2006 .

[54]  Shaun J. Canavan,et al.  A Multi-Gesture Interaction System Using a 3-D Iris Disk Model for Gaze Estimation and an Active Appearance Model for 3-D Hand Pointing , 2011, IEEE Transactions on Multimedia.

[55]  Tong-de Tan,et al.  Research of hand positioning and gesture recognition based on binocular vision , 2011, 2011 IEEE International Symposium on VR Innovation.

[56]  G.R.S. Murthy,et al.  Hand gesture recognition using neural networks , 2010, 2010 IEEE 2nd International Advance Computing Conference (IACC).

[57]  Pizzanu Kanongchaiyos,et al.  3D Hand pose modeling from uncalibrate monocular images , 2011, 2011 Eighth International Joint Conference on Computer Science and Software Engineering (JCSSE).

[58]  S. Abdul-Kareem,et al.  RETRACTED ARTICLE: Static hand gesture recognition using neural networks , 2014, Artificial Intelligence Review.

[59]  Konstantinos G. P. Derpanis,et al.  A Review of Vision-Based Hand Gestures , 2004 .