Non-intrusive gesture recognition system combining with face detection based on Hidden Markov Model

A non-intrusive gesture recognition human-machine interaction system is proposed in this paper. In order to solve the hand positioning problem which is a difficulty in current algorithms, face detection is used for the pre-processing to narrow the search area and find user’s hand quickly and accurately. Hidden Markov Model (HMM) is used for gesture recognition. A certain number of basic gesture units are trained as HMM models. At the same time, an improved 8-direction feature vector is proposed and used to quantify characteristics in order to improve the detection accuracy. The proposed system can be applied in interaction equipments without special training for users, such as household interactive television

[1]  Aaron F. Bobick,et al.  Parametric Hidden Markov Models for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Chin-Shyurng Fahn,et al.  A Human-Machine Interaction Technique: Hand Gesture Recognition Based on Hidden Markov Models with Trajectory of Hand Motion , 2011 .

[3]  Chao Yan,et al.  Robust real-time multi-user pupil detection and tracking under various illumination and large-scale head motion , 2011, Comput. Vis. Image Underst..

[4]  Xiaoyan Wang,et al.  Hidden-Markov-Models-Based Dynamic Hand Gesture Recognition , 2012 .

[5]  Jin H. Kim,et al.  Augmenting the Discrimination Power of HMM by NN for On-Line Cursive Script Recognition , 2004, Applied Intelligence.

[6]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Youngmo Han.  A low-cost visual motion data glove as an input device to interpret human hand gestures , 2010, IEEE Transactions on Consumer Electronics.

[8]  Ren Hai.  Spatio-Temporal Appearance Modeling and Recognition of Continuous Dynamic Hand Gestures , 2000 .

[9]  Jean-Christophe Pesquet,et al.  A Convex Optimization Approach for Depth Estimation Under Illumination Variation , 2009, IEEE Transactions on Image Processing.

[10]  Ryosuke Aoki,et al.  Expanding kinds of gestures for hierarchical menu selection by unicursal gesture interface , 2011, IEEE Transactions on Consumer Electronics.

[11]  Minerva M. Yeung,et al.  Gesture for video content navigation , 1998, Electronic Imaging.

[12]  Nianjun Liu,et al.  Effect of initial HMM choices in multiple sequence training for gesture recognition , 2004, International Conference on Information Technology: Coding and Computing, 2004. Proceedings. ITCC 2004..

[13]  Ren Hai.  HAND GESTURE SEGMENTATION AND RECOGNITION WITH COMPLEX BACKGROUNDS , 2002 .

[14]  Yuntao Cui,et al.  View-based hand segmentation and hand-sequence recognition with complex backgrounds , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[15]  Wang Yuan-qing.  Face detection method for real-time anti-interference , 2013 .

[16]  Vladimir Pavlovic,et al.  Dynamic bayesian networks for information fusion with applications to human-computer interfaces , 1999 .

[17]  Seungjin Choi,et al.  Gesture-recognizing hand-held interface with vibrotactile feedback for 3D interaction , 2009, IEEE Transactions on Consumer Electronics.

[18]  Alex Bateman,et al.  An introduction to hidden Markov models. , 2007, Current protocols in bioinformatics.

[19]  R. Oka,et al.  Spotting Recognition of Human Gestures from Motion Images , 1994 .