Low Cost Hand Gesture Learning and Recognition System Based on Hidden Markov Model

Focusing on recognizing some typical gestures based on 3-axis MEMS accelerometer to interact with an application of human-machine interactive game, the hand gesture problem is analyzed firstly, then theory basis of HMM is introduced. In order to obtain training gesture data for HMM, and also to provide a hardware basis for gesture recognition, a low cost data acquisition system hardware is researched and designed. The system can get the acceleration data of user’s gesture and transmit them wirelessly to a personal computer. In the hand gesture recognition approach, k-mean algorithms are applied to cluster and abstract the vector data from sensor. And then the quantized vectors are put into a hidden Markov model to learn and recognize user’s gestures. Finally the gesture recognition library is implemented in C# development environment, and is utilized in a human-machine interactive game application. The results show that the typical gesture emerging in the game can be identified in a high rate, and the user can experience more interest and interaction.

[1]  Robert Sabourin,et al.  Off-Line Handwritten Word Recognition Using Hidden Markov Models , 1999, KNOWLEDGE-BASED INTELLIGENT TECHNIQUES in CHARACTER RECOGNITION.

[2]  Zhenyu He,et al.  Writer identification of Chinese handwriting documents using hidden Markov tree model , 2008, Pattern Recognit..

[3]  Lin Zhong,et al.  uWave: Accelerometer-based Personalized Gesture Rec- ognition , 2008 .

[4]  Han Wu He,et al.  Vision-Based Hand Tracking and Gesture Recognition for Augmented Assembly System , 2008 .

[5]  Mark J. F. Gales,et al.  The Application of Hidden Markov Models in Speech Recognition , 2007, Found. Trends Signal Process..

[6]  Chinmoy B. Bose,et al.  Connected and degraded text recognition using hidden Markov model , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[7]  Yangsheng Xu,et al.  Hidden Markov Model for Gesture Recognition , 1994 .

[8]  KwangYun Wohn,et al.  Recognition of space-time hand-gestures using hidden Markov model , 1996, VRST.

[9]  Yan Zhang,et al.  Self-Defined Gesture Recognition on Keyless Handheld Devices using MEMS 3D Accelerometer , 2008, 2008 Fourth International Conference on Natural Computation.

[10]  Zhen Wang,et al.  uWave: Accelerometer-based Personalized Gesture Recognition and Its Applications , 2009, PerCom.

[11]  Shengli Zhou,et al.  Gesture recognition for interactive controllers using MEMS motion sensors , 2009, 2009 4th IEEE International Conference on Nano/Micro Engineered and Molecular Systems.

[12]  Heiga Zen,et al.  A Fully Consistent Hidden Semi-Markov Model-Based Speech Recognition System , 2008, IEICE Trans. Inf. Syst..

[13]  Dan Luo,et al.  Hand-gesture extraction and recognition from the video sequence acquired by a dynamic camera using condensation algorithm , 2009, Electronic Imaging.

[14]  Yangsheng Xu,et al.  Hidden Markov model approach to skill learning and its application to telerobotics , 1993, IEEE Trans. Robotics Autom..

[15]  Niels Henze,et al.  Gesture recognition with a Wii controller , 2008, TEI.

[16]  Yangsheng Xu,et al.  Online, interactive learning of gestures for human/robot interfaces , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[17]  Biing-Hwang Juang,et al.  Hidden Markov Models for Speech Recognition , 1991 .

[18]  Kenneth R. Koedinger,et al.  Adapting handwriting recognition for applications in algebra learning , 2007, Emme '07.

[19]  Jukka Riekki,et al.  MOBILE PHONE CONTROLLER BASED ON ACCELERATIVE GESTURING , 2008 .

[20]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.