Bayesian Sensing Hidden Markov Model for Hand Gesture Recognition

This paper proposes a modified Bayesian Sensing Hidden Markov Model (BS-HMM) to address the problem of hand gestures recognition on few labeled data. In this work, BS-HMM is investigated based on its success to address the problem of large-vocabulary of continuous speech recognition. We introduced error modeling into BS-HMM basis vector to handle the noise that occurs in the data. We also introduced a forgetting factor to preserve important information from previous basis vector and to improve both convergence and representation ability of the BS-HMM basis vector. We modified Moving Pose method to extract the feature descriptor from hand gestures data. To evaluate the performance of our system, we compared our proposed method with previously proposed HMM methods. The experimental result showed the improvement of proposed method over others, even when only a small number of labeled data are available for training dataset.

[1]  Arne Leijon,et al.  Nonnegative HMM for Babble Noise Derived From Speech HMM: Application to Speech Enhancement , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[2]  Anupam Agrawal,et al.  Vision based hand gesture recognition for human computer interaction: a survey , 2012, Artificial Intelligence Review.

[3]  Jen-Tzung Chien,et al.  Bayesian Sensing Hidden Markov Models , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[4]  Ayoub Al-Hamadi,et al.  A Hidden Markov Model-based continuous gesture recognition system for hand motion trajectory , 2008, 2008 19th International Conference on Pattern Recognition.

[5]  Seong-Whan Lee,et al.  Gesture Spotting and Recognition for Human–Robot Interaction , 2007, IEEE Transactions on Robotics.

[6]  Fuchun Sun,et al.  A Fast and Robust Sparse Approach for Hyperspectral Data Classification Using a Few Labeled Samples , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Michael E. Tipping Sparse Bayesian Learning and the Relevance Vector Machine , 2001, J. Mach. Learn. Res..

[8]  Salvador España Boquera,et al.  Improving Offline Handwritten Text Recognition with Hybrid HMM/ANN Models , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Kjersti Engan,et al.  Recursive Least Squares Dictionary Learning Algorithm , 2010, IEEE Transactions on Signal Processing.

[10]  Christian Wolf,et al.  Multi-scale Deep Learning for Gesture Detection and Localization , 2014, ECCV Workshops.

[11]  Stan Sclaroff,et al.  A Unified Framework for Gesture Recognition and Spatiotemporal Gesture Segmentation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Agnès Just,et al.  A comparative study of two state-of-the-art sequence processing techniques for hand gesture recognition , 2009, Comput. Vis. Image Underst..

[13]  Wei Hu,et al.  Automatic user state recognition for hand gesture based low-cost television control system , 2014, IEEE Transactions on Consumer Electronics.

[14]  B. Ionescu,et al.  Using a NIR Camera for Car Gesture Control , 2014, IEEE Latin America Transactions.

[15]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[16]  Cristian Sminchisescu,et al.  The Moving Pose: An Efficient 3D Kinematics Descriptor for Low-Latency Action Recognition and Detection , 2013, 2013 IEEE International Conference on Computer Vision.