Gesture recognition based on Hidden Markov Model from sparse representative observations

Hand gesture recognition plays an important role in human computer interaction, virtual reality, and so on. In this paper, we focus on how to generate efficient observations after feature extraction in Hidden Markov model (HMM). Vector quantization such as kmeans clustering algorithm is usually applied to generate codebooks in HMM-based methods. Unlike traditional vector quantization, we use sparse coding (SC) and HMM to achieve the task of hand gesture recognition, which we call ScHMM. Sparse coding provides a class of algorithms for finding succinct representations of stimuli. In the training stage, feature-sign search algorithm and Lagrange dual are applied to obtain codebook and in the testing stage, feature-sign algorithm is used to get efficient observations. We evaluated our method on public database. ScHMM compares favorably to state-of-the-art methods, namely HMM, conditional random fields, hidden conditional random fields and latent dynamic conditional random fields.

[1]  Chung-Lin Huang,et al.  Hand gesture recognition using a real-time tracking method and hidden Markov models , 2003, Image Vis. Comput..

[2]  Surendra Ranganath,et al.  Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Ruiduo Yang,et al.  Gesture Recognition using Hidden Markov Models from Fragmented Observations , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[4]  Paolo Dario,et al.  A Survey of Glove-Based Systems and Their Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Narendra Ahuja,et al.  Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  M. S. Sahane,et al.  Visual Interpretation Of Hand Gestures For Human Computer Interaction , 2014 .

[8]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[9]  Trevor Darrell,et al.  Hidden Conditional Random Fields for Gesture Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[10]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Yi-Ping Hung,et al.  Appearance-guided particle filtering for articulated hand tracking , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Jr. G. Forney,et al.  The viterbi algorithm , 1973 .

[13]  Trevor Darrell,et al.  Latent-Dynamic Discriminative Models for Continuous Gesture Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Junwei Han,et al.  Automatic skin segmentation and tracking in sign language recognition , 2009 .

[15]  Ho-Sub Yoon,et al.  Hand gesture recognition using combined features of location, angle and velocity , 2001, Pattern Recognit..

[16]  Ho-Sub Yoon,et al.  Hand gesture recognition using hidden Markov models , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[17]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[18]  Tieniu Tan,et al.  Real-time hand tracking using a mean shift embedded particle filter , 2007, Pattern Recognit..

[19]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[20]  Ayoub Al-Hamadi,et al.  A framework for the integration of gesture and posture recognition using HMM and SVM , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.