Real-time Hand Gesture Recognition from Depth Image Sequences

As a certain case in the domain of human actions, hand gestures can be expressed by the motion of user's hand to provide nature interaction in many applications. In this paper we proposed a real-time hand gesture recognition system based on robust hand tracking from depth image sequences. Using hidden markov models (HMM) with varying states, gesture models are trained online along with user's feedback, and the real-time classification is taken simultaneously. A gesture may be falsely classified as the models are trained insufficiently at beginning, in which case we provide a feedback and update the gesture model with this gesture sample. The performance of the system can always be improved by more updating, and in our experiment we give an appropriate result after a reasonable number of samples are used for training.

[1]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[2]  Sebastian Thrun,et al.  Real time motion capture using a single time-of-flight camera , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Barbara Caputo,et al.  Recognizing human actions: a local SVM approach , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[4]  Li Wang,et al.  Human Action Segmentation and Recognition Using Discriminative Semi-Markov Models , 2011, International Journal of Computer Vision.

[5]  Stan Sclaroff,et al.  A Unified Framework for Gesture Recognition and Spatiotemporal Gesture Segmentation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Ayoub Al-Hamadi,et al.  A Hidden Markov Model-Based Isolated and Meaningful Hand Gesture Recognition , 2008 .

[7]  Barbara Caputo,et al.  Recognizing human actions: a local SVM approach , 2004, ICPR 2004.

[8]  AthitsosVassilis,et al.  A Unified Framework for Gesture Recognition and Spatiotemporal Gesture Segmentation , 2009 .

[9]  Ivan Laptev,et al.  On Space-Time Interest Points , 2005, International Journal of Computer Vision.

[10]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[11]  Serge J. Belongie,et al.  Behavior recognition via sparse spatio-temporal features , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.