An Appearance-Based Approach to Gesture-Recognition

This paper describes techniques for the design of a system able to interact with the user by visual recognition of hand gestures. The system is composed of three modules including tracking, posture classification and gesture recognition. A description of each module is given. In order to increase the robustness and the precision of the tracking, several complementary tracking processes are coupled. A classification process is presented for recognizing hand posture using distance in an eigenspace. The classification of hand posture leads to the gesture recognition by a set of finite state machines.

[1]  Pamela Samuelson.  The ups and downs of look and feel , 1993, CACM.

[2]  James L. Crowley,et al.  Integration and Control of Reactive Visual Processes , 1994, ECCV.

[3]  Pierre Wellner.  The DigitalDesk calculator: tangible manipulation on a desk top display , 1991, UIST '91.

[4]  Alex Waibel,et al.  Estimation of the Head Orientation Based on a Face‐Color‐Intensifier , 1995 .

[5]  Tomoichi Takahashi,et al.  Hand gesture coding based on experiments using a hand gesture interface device , 1991, SGCH.

[6]  Pierre Dauchy,et al.  Joint speech and gesture analysis some experimental results on multimodal interface , 1993, EUROSPEECH.

[7]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[8]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[9]  Myron W. Krueger,et al.  Artificial reality II , 1991 .

[10]  James L. Crowley,et al.  Integration and control of reactive visual processes , 1994, Robotics Auton. Syst..

[11]  Anne Braffort,et al.  Reconnaissance et comprehension de gestes, application a la langue des signes , 1996 .

[12]  James L. Crowley,et al.  Coordination of perceptual processes for computer mediated communication , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[13]  J. Foley.  Interfaces for advanced computing , 1987 .

[14]  Takeo Kanade,et al.  DigitEyes: Vision-Based Human Hand Tracking , 1993 .

[15]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[16]  Yoshiaki Shirai,et al.  Hand gesture recognition using computer vision based on model-matching method , 1995 .

[17]  Timothy F. Cootes,et al.  Training Models of Shape from Sets of Examples , 1992, BMVC.