Hand Gesture Recognition for Human Computer Interaction and Its Applications in Virtual Reality

Computers are emerging as the most utilitarian products in the human society and therefore the interaction between humans and computers will have a very significant influence in the society. As a result, enormous amount of efforts are being made to augment the research in the domain of human computer interaction to develop more efficient and effective techniques for the purpose of reducing the barrier of humans and computers. The primary objective is to develop a conducive environment in which there is feasibility of very natural interaction between humans and computers. In order to achieve this goal, gestures play a very pivotal role and are the core area of research in this domain. Hand gesture recognition is a significant component of virtual Reality finds applications in numerous fields including video games, cinema, robotics, education, marketing, etc. Virtual reality also caters to a variety of healthcare applications involving the procedures used in surgical operations including remote surgery, augmented surgery, software emulation of the surgeries prior to actual surgeries, therapies, training in the medical education, medical data visualization and much more. A lot of tools and techniques have. Been developed to cater to the development of the such virtual environments. Gesture recognition signifies the method of keeping track of gestures of humans, to representing and converting the gestures to meaningful signals. Contact based and vision based devices are used for creating and implementing these systems of recognition effectively. The chapter begins with the introduction of hand gesture recognition and the process of carrying out hand gesture recognition. Further, the latest research which is being in carried out in the domain of hand gesture recognition is described. It is followed by the details of applications of virtual reality and hand gesture recognition in the field of healthcare. Then, various techniques which are applied in hand gesture recognition are described. Finally, the challenges in the field of hand gesture recognition have been explained.

[1]  Chung-Lin Huang,et al.  Hand gesture recognition using a real-time tracking method and hidden Markov models , 2003, Image Vis. Comput..

[2]  Thomas S. Huang,et al.  Constructing finite state machines for fast gesture recognition , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[3]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[4]  Luca Maria Gambardella,et al.  Max-pooling convolutional neural networks for vision-based hand gesture recognition , 2011, 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[5]  Nicu Sebe,et al.  Multimodal Human Computer Interaction: A Survey , 2005, ICCV-HCI.

[6]  Joachim Hornegger,et al.  Gesture recognition with a Time-Of-Flight camera , 2008, Int. J. Intell. Syst. Technol. Appl..

[7]  Nicolas D. Georganas,et al.  Real-Time Hand Gesture Detection and Recognition Using Bag-of-Features and Support Vector Machine Techniques , 2011, IEEE Transactions on Instrumentation and Measurement.

[8]  Yang Hong-mei.  Video hand tracking algorithm based on hybrid CamShift and Kalman filter , 2009 .

[9]  Chin-Chen Chang,et al.  New Approach for Static Gesture Recognition , 2006, J. Inf. Sci. Eng..

[10]  Sudhir Sawarkar,et al.  Hand Gesture Recognition Using CAMSHIFT Algorithm , 2010, 2010 3rd International Conference on Emerging Trends in Engineering and Technology.

[11]  Paulo R. S. Mendonça,et al.  Model-Based Hand Tracking Using an Unscented Kalman Filter , 2001, BMVC.

[12]  Z. Zivkovic.  Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[13]  M Haubner,et al.  VR interaction techniques for medical imaging applications. , 1998, Computer methods and programs in biomedicine.

[14]  H. Hoffman,et al.  Virtual reality: teaching tool of the twenty‐first century? , 1997, Academic medicine : journal of the Association of American Medical Colleges.

[15]  Alphonse Chapanis,et al.  Man-machine engineering , 1965 .

[16]  Rosalind W. Picard.  Affective Computing , 1997 .

[17]  Youngmo Han.  A low-cost visual motion data glove as an input device to interpret human hand gestures , 2010, IEEE Transactions on Consumer Electronics.

[18]  Heung-Il Suk,et al.  Hand gesture recognition based on dynamic Bayesian network framework , 2010, Pattern Recognit..

[19]  Robert E. Schapire,et al.  The Boosting Approach to Machine Learning An Overview , 2003 .

[20]  Prabin Kumar Bora,et al.  A robust static hand gesture recognition system using geometry based normalizations and Krawtchouk moments , 2013, Pattern Recognit..

[21]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[22]  Björn Stenger,et al.  Model-based hand tracking using a hierarchical Bayesian filter , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Gang Hua,et al.  Dynamic hand gesture recognition: An exemplar-based approach from motion divergence fields , 2012, Image Vis. Comput..

[24]  Yen-Ting Chen,et al.  Multiple-angle Hand Gesture Recognition by Fusing SVM Classifiers , 2007, 2007 IEEE International Conference on Automation Science and Engineering.

[25]  Nikos Papamarkos,et al.  Hand gesture recognition using a neural network shape fitting technique , 2009, Eng. Appl. Artif. Intell..

[26]  Rafiqul Zaman Khan,et al.  Comparative Study of Hand Gesture Recognition System , 2012 .

[27]  Wali Said,et al.  Moving Target Detection and Tracking , 2015 .

[28]  Karl F. MacDorman,et al.  Review of constraints on vision-based gesture recognition for human-computer interaction , 2018, IET Comput. Vis..

[29]  Sahibsingh A. Dudani.  The Distance-Weighted k-Nearest-Neighbor Rule , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[30]  R. Satava.  Virtual reality surgical simulator , 1993, Surgical Endoscopy.

[31]  M. Panwar.  Hand gesture recognition based on shape parameters , 2012, 2012 International Conference on Computing, Communication and Applications.

[32]  Cyrus Shahabi,et al.  An algorithmic approach for static and dynamic gesture recognition utilising mechanical and biomechanical characteristics , 2007, Int. J. Bioinform. Res. Appl..

[33]  Tieniu Tan,et al.  Real-time hand tracking using a mean shift embedded particle filter , 2007, Pattern Recognit..

[34]  Cheng-Chew Lim,et al.  Segmentation of the face and hands in sign language video sequences using color and motion cues , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[35]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[36]  Mohan M. Trivedi,et al.  Hand Gesture Recognition in Real Time for Automotive Interfaces: A Multimodal Vision-Based Approach and Evaluations , 2014, IEEE Transactions on Intelligent Transportation Systems.

[37]  Anupam Agrawal,et al.  Vision based hand gesture recognition for human computer interaction: a survey , 2012, Artificial Intelligence Review.

[38]  Yen-Wei Chen,et al.  Kinect-Based Gesture Recognition for Touchless Visualization of Medical Images , 2017 .

[39]  Kandarpa Kumar Sarma,et al.  A novel hand segmentation method for multiple-hand gesture recognition system under complex background , 2014, 2014 International Conference on Signal Processing and Integrated Networks (SPIN).

[40]  Mani Shankar,et al.  Human Computer Interaction , 2010, 2010 3rd International Conference on Emerging Trends in Engineering and Technology.

[41]  Ayoub Al-Hamadi,et al.  A Hidden Markov Model-Based Isolated and Meaningful Hand Gesture Recognition , 2008 .

[42]  Emil M. Petriu,et al.  Hand gesture recognition using Bag-of-features and multi-class Support Vector Machine , 2010, 2010 IEEE International Symposium on Haptic Audio Visual Environments and Games.

[43]  Takeo Kanade,et al.  DigitEyes: vision-based hand tracking for human-computer interaction , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[44]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[45]  Rajesh Aggarwal,et al.  Proving the Effectiveness of Virtual Reality Simulation for Training in Laparoscopic Surgery , 2007, Annals of surgery.

[46]  Su Jian-bo.  The Hand Tracking for Humanoid Robot Using Camshift Algorithm and Kalman Filter , 2006 .

[47]  R. Satava,et al.  Virtual Reality Simulation for the Operating Room: Proficiency-Based Training as a Paradigm Shift in Surgical Skills Training , 2005, Annals of surgery.

[48]  Kandarpa Kumar Sarma,et al.  A Conditional Random Field Based Indian Sign Language Recognition System under Complex Background , 2014, 2014 Fourth International Conference on Communication Systems and Network Technologies.