A theoretical consideration of pattern space trajectory for gesture spotting recognition

We propose a new appearance-based feature for real-time gesture recognition from motion images. The feature is the shape of the trajectory caused by gesture, in pattern space defined by inner-product between patterns on frame images. It has three merits, (1) invariant for the target human man's position, size and lie, (2) gesture recognition without interpreting frame image contents, (3) no costly statistical calculation. And it gives us a theoretical guarantee about the effectiveness of several time-sequence matching methods using shapes in the eigenspace or results of position tracking. In this paper, we describe the properties of the gesture trajectory feature, and some experimental results in order to show its applicability to gesture recognition with a theoretical consideration.

[1]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[2]  T. Nishimura,et al.  Spotting recognition of human gestures from time-varying images , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[3]  Fumio Kishino,et al.  Sensing of Feeling and "Kansei". Facial Expression Recognition from Image Sequence Using Hidden Markov Model. , 1995 .

[4]  Hiroshi Murase,et al.  Moving object recognition in eigenspace representation: gait analysis and lip reading , 1996, Pattern Recognit. Lett..

[5]  Hiroshi Murase,et al.  Learning and recognition of 3D objects from appearance , 1993, [1993] Proceedings IEEE Workshop on Qualitative Vision.

[6]  Andrew D. Wilson,et al.  Using Connguration States for the Representation and Recognition of Gesture 2 Related Work , 1995 .

[7]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[8]  Alex Pentland,et al.  Recognition of Space-Time Gestures using a Distributed Representation , 1993 .

[9]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  James W. Davis,et al.  An appearance-based representation of action , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[11]  Ryuichi Oka,et al.  A Proposal of Pattern Space Trajectory for Gesture Spotting Recognition , 1996, BMVC.