Gesture Recognition Using Pseudo 3D Hidden Markov Models

We introduce a novel approach to gesture recognition, based on Pseudo 3D Hidden Markov Models. This technique is capable of integrating spatially and temporally derived features in an elegant way, thus making possible the recognition of static gestures such as standing in a special posture, as well as dynamic gestures such as hand waving. Pseudo 2D Hidden Markov Models have been utilized for two dimensional Problems such as face recognition. P3DHMMs can be considered as an extension of 2D case, where the so-called superstates in P3DHMM encapsulate P2DHMMs. By the means of this structure, image sequences can be generated by the model. The Performance of our approach is demonstrated in this paper by a number of experiments on a gesture database of nine different predefined gestures.

[1]  Ferdinando Silvestro Samaria,et al.  Face recognition using Hidden Markov Models , 1995 .

[2]  Gerhard Rigoll,et al.  Fast online video image sequence recognition with statistical methods , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[3]  Gerhard Rigoll,et al.  High quality face recognition in JPEG compressed images , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[4]  Oscar E. Agazzi,et al.  Keyword Spotting in Poorly Printed Documents using Pseudo 2-D Hidden Markov Models , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Gerhard Rigoll,et al.  High Performance Real-Time Gesture Recognition Using Hidden Markov Models , 1997, Gesture Workshop.

[7]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Gerhard Rigoll,et al.  Pseudo 3-D HMMs for image sequence recognition , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).